Verisk Financial | Jobs | Data Engineer | BigDataKB.com | 10-02-22

โ€”

by

Job Location: Bangalore/Bengaluru

Great opportunity to work with one of the Leading US product-based Firm@ Bangalore Location

Position: Sr Data Engineer

Experience: 8+ Years

Notice Period: up to 3 Months

Location: Bangalore

Job Description

Minimum Personal Qualifications

โ€ข 8-10 years of experience in design, build and deployment of Python based applications.

โ€ข Strong experience in writing complex SQL queries.

โ€ข Expertise in handling complex large-scale Big Data environments preferably (20Tb+).

โ€ข Experience in Leading and mentoring a team.

โ€ข Strong analytical capability and problem-solving skills.

โ€ข Knowledge of data processing using python.

โ€ข Excellent communication, teamwork, and interpersonal skills.

โ€ข Ability to write abstracted, reusable code components.

โ€ข Able to quickly adapt and learn.

โ€ข Able to jump into an ambiguous situation and able to take the lead.

โ€ข Able to communicate and coordinate across various teams.

โ€ข Basic Understanding of spark architecture with experience in PySpark applications is good to have.

โ€ข Experience in cloud technologies preferably AWS is good to have

โ€ข BE/B.Tech in Computer Science from an accredited college or university.

Technical Qualification

โ€ข Python, Hadoop ecosystem – Hive, HDFS, HBase

โ€ข Strong SQL skills with exposure to any of the RDBMS.

โ€ข Strong technical background on data modelling, database design and optimization of queries.

โ€ข Apache Spark Py-Spark /Scala or Java would be good to have.

โ€ข AWS – EMR, IAM roles, S3, Glue Catalog, Step function, serverless/Lambda, Cloud formation / CI/CD process development

โ€ข OpenStack Other Software & Tools – Docker, GitLab

โ€ข Linux/Unix – Shell scripting +

Responsibilities:

โ€ข Design and Develop Data Ingestion and Processing Code using Python/Pyspark/ language on AWS big data platform.

โ€ข Create and update Design Specs and reference Architecture documents to enable acceleration in solution development.

โ€ข Participate in testing and peer code reviews to identify any bugs and ensure reusability of code.

โ€ข Automate the deployment of the solutions by using Shell scripts/Python and AWS services.

โ€ข Work with IT change Management group to promote the developed code/scripts from non-production to production environments.

โ€ข Work with Architecture team (Application/Security/Infrastructure/Data) to get their approval on the designed solutions.

Prior to arranging a call with you to discuss your application further, can you please confirm the following details:

Total Experience:

Relevant Experience: (In years)

Python (Data Side): (In years)

Project worked in Banking Domain: (In years)

AWS: (in years)

Big data technologies: (In years)

Pyspark: (In years)

Hadoop:

Hive:

Data transformation : (In years)

Data Load in RDBMS: (In years)

Current CTC: including variable –

Expected CTC: including variable –

Current Organization:

Notice Period:

Current location:

Willing to relocate Bangalore:

Reason for relocation:

Holding any offers in hand? (if yes, why are you looking for another opportunity?) – No

I look forward to hearing back from you ASAP.

Stay HomeStay Safe

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *