Seventh Contact Hiring Solutions | Hiring | Sr. Data Engineer (PySpark, Big Data/ETL/DW & Cloud Migration) – Pune | BigDataKB.com | 08-04-2022

Job Location: Pune( Baner Pashan Link Road, Baner, Wakad, Balewadi Phata )

Roles and Responsibilities

The role and responsibilities will include activities within the planning for migration, actual migration and validation.

Planning –

Building the best plan for migration by end-to-end analysis, actionable visualization, end-to-end relationships, dependencies and lineage.

Analyze ETL pipelines to understand the end-to-end data flow, from ingestion to consumption to capture lineage and orchestration sequencing.

Analyze data lake and data warehouse applications and tables to understand object counts and workload dependencies across disparate applications including hot and cold spots.

Analyze BI and Analytics consumers to capture downstream consumption lineage and dependencies between consumer and data source.

Migrating –

Migrate the legacy IBM DataStage pipelines from on-premise to the cloud target.

Modernize legacy applications

Development, testing and deployment of microservices and APIs, to help enable legacy systems and modernize front-end applications.

Externalization of back-end services locked in legacy systems and the subsequent transition to a service-oriented architecture.

Validating –

Defining and validating translated code to ensure maximum performance in the cloud.

Desired Candidate Profile

The best fit for the role should have the following experience and background –

Total 3 to 12 years of IT experience,

Last 3 to 4 years (OR last 2 to 3 projects) using PySpark. (This is a MUST)

Last minimum 4 years experience with various ETL tools, including: Informatica, DataStage, SSIS, SAS, Talend

Experience with any of the Cloud Technologies like -Databricks, Azure, GCP, Snowflake, AWS

Solid understanding of SQL and Data warehousing concepts

Solid understanding of Scala would also be an asset

Candidates with higher experience and ability to lead a small team will be considered for Team Lead roles and candidates with lesser experience will be considered for individual contributors role.

Perks and Benefits – Competitive

Selection Process

1st Round – 1 hour technical test,

2nd Round – Screening/fitment discussion,

3rd Round – In-depth Technical round.

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *