Job Location: Bangalore/Bengaluru
Great opportunity to work with one of the Leading US product-based Firm@ Bangalore Location
Position: Sr Data Engineer
Experience: 8+ Years
Notice Period: up to 3 Months
Location: Bangalore
Job Description
Minimum Personal Qualifications
• 8-10 years of experience in design, build and deployment of Python based applications.
• Strong experience in writing complex SQL queries.
• Expertise in handling complex large-scale Big Data environments preferably (20Tb+).
• Experience in Leading and mentoring a team.
• Strong analytical capability and problem-solving skills.
• Knowledge of data processing using python.
• Excellent communication, teamwork, and interpersonal skills.
• Ability to write abstracted, reusable code components.
• Able to quickly adapt and learn.
• Able to jump into an ambiguous situation and able to take the lead.
• Able to communicate and coordinate across various teams.
• Basic Understanding of spark architecture with experience in PySpark applications is good to have.
• Experience in cloud technologies preferably AWS is good to have
• BE/B.Tech in Computer Science from an accredited college or university.
Technical Qualification
• Python, Hadoop ecosystem – Hive, HDFS, HBase
• Strong SQL skills with exposure to any of the RDBMS.
• Strong technical background on data modelling, database design and optimization of queries.
• Apache Spark Py-Spark /Scala or Java would be good to have.
• AWS – EMR, IAM roles, S3, Glue Catalog, Step function, serverless/Lambda, Cloud formation / CI/CD process development
• OpenStack Other Software & Tools – Docker, GitLab
• Linux/Unix – Shell scripting +
Responsibilities:
• Design and Develop Data Ingestion and Processing Code using Python/Pyspark/ language on AWS big data platform.
• Create and update Design Specs and reference Architecture documents to enable acceleration in solution development.
• Participate in testing and peer code reviews to identify any bugs and ensure reusability of code.
• Automate the deployment of the solutions by using Shell scripts/Python and AWS services.
• Work with IT change Management group to promote the developed code/scripts from non-production to production environments.
• Work with Architecture team (Application/Security/Infrastructure/Data) to get their approval on the designed solutions.
Prior to arranging a call with you to discuss your application further, can you please confirm the following details:
Total Experience:
Relevant Experience: (In years)
Python (Data Side): (In years)
Project worked in Banking Domain: (In years)
AWS: (in years)
Big data technologies: (In years)
Pyspark: (In years)
Hadoop:
Hive:
Data transformation : (In years)
Data Load in RDBMS: (In years)
Current CTC: including variable –
Expected CTC: including variable –
Current Organization:
Notice Period:
Current location:
Willing to relocate Bangalore:
Reason for relocation:
Holding any offers in hand? (if yes, why are you looking for another opportunity?) – No
I look forward to hearing back from you ASAP.
Stay HomeStay Safe
Submit CV To All Data Science Job Consultants Across India For Free

