Seventh Contact Hiring Solutions | Jobs | Senior/Lead Data Engineer (PySpark, ETL and Cloud) – Pune | BigDataKB.com | 02-02-22

    0

    Job Location: Pune( Baner Pashan Link Road, Baner, Wakad, Balewadi Phata )

    Roles and Responsibilities

    The role and responsibilities will include activities within the planning for migration, actual migration and validation.

    Planning –

    Building the best plan for migration by end-to-end analysis, actionable visualization, end-to-end relationships, dependencies and lineage.

    Analyze ETL pipelines to understand the end-to-end data flow, from ingestion to consumption to capture lineage and orchestration sequencing.

    Analyze data lake and data warehouse applications and tables to understand object counts and workload dependencies across disparate applications including hot and cold spots.

    Analyze BI and Analytics consumers to capture downstream consumption lineage and dependencies between consumer and data source.

    Migrating –

    Migrate the legacy IBM DataStage pipelines from on-premise to the cloud target.

    Modernize legacy applications

    Development, testing and deployment of microservices and APIs, to help enable legacy systems and modernize front-end applications.

    Externalization of back-end services locked in legacy systems and the subsequent transition to a service-oriented architecture.

    Validating –

    Defining and validating translated code to ensure maximum performance in the cloud.

    Desired Candidate Profile

    The best fit for the role should have the following experience and background –

    Total 4 to 10 years of IT experience,

    Last 3 to 4 years (OR last 2 to 3 projects) using PySpark. (This is a MUST)

    Last minimum 4 years experience with various ETL tools, including: Informatica, DataStage, SSIS, SAS, Talend

    Experience with any of the Cloud Technologies like -Databricks, Azure, GCP, Snowflake, AWS

    Solid understanding of SQL and Data warehousing concepts

    Solid understanding of Scala would also be an asset

    Candidates with higher experience and ability to lead a small team will be considered for Team Lead roles and candidates with lesser experience will be considered for individual contributors role.

    Perks and Benefits – Competitive

    Selection Process

    1st Round – 1 hour technical test,

    2nd Round – Screening/fitment discussion,

    3rd Round – In-depth Technical round.

    Apply Here

    Submit CV To All Data Science Job Consultants Across India For Free

    🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

    LEAVE A REPLY

    Please enter your comment!
    Please enter your name here