Job Location: Bangalore/Bengaluru
Great opportunity to work with one of the Leading US product-based Firm@ Bangalore Location
Position: Sr Data Engineer
Experience: 8+ Years
Notice Period: up to 3 Months
Location: Bangalore
Job Description
Minimum Personal Qualifications
โข 8-10 years of experience in design, build and deployment of Python based applications.
โข Strong experience in writing complex SQL queries.
โข Expertise in handling complex large-scale Big Data environments preferably (20Tb+).
โข Experience in Leading and mentoring a team.
โข Strong analytical capability and problem-solving skills.
โข Knowledge of data processing using python.
โข Excellent communication, teamwork, and interpersonal skills.
โข Ability to write abstracted, reusable code components.
โข Able to quickly adapt and learn.
โข Able to jump into an ambiguous situation and able to take the lead.
โข Able to communicate and coordinate across various teams.
โข Basic Understanding of spark architecture with experience in PySpark applications is good to have.
โข Experience in cloud technologies preferably AWS is good to have
โข BE/B.Tech in Computer Science from an accredited college or university.
Technical Qualification
โข Python, Hadoop ecosystem – Hive, HDFS, HBase
โข Strong SQL skills with exposure to any of the RDBMS.
โข Strong technical background on data modelling, database design and optimization of queries.
โข Apache Spark Py-Spark /Scala or Java would be good to have.
โข AWS – EMR, IAM roles, S3, Glue Catalog, Step function, serverless/Lambda, Cloud formation / CI/CD process development
โข OpenStack Other Software & Tools – Docker, GitLab
โข Linux/Unix – Shell scripting +
Responsibilities:
โข Design and Develop Data Ingestion and Processing Code using Python/Pyspark/ language on AWS big data platform.
โข Create and update Design Specs and reference Architecture documents to enable acceleration in solution development.
โข Participate in testing and peer code reviews to identify any bugs and ensure reusability of code.
โข Automate the deployment of the solutions by using Shell scripts/Python and AWS services.
โข Work with IT change Management group to promote the developed code/scripts from non-production to production environments.
โข Work with Architecture team (Application/Security/Infrastructure/Data) to get their approval on the designed solutions.
Prior to arranging a call with you to discuss your application further, can you please confirm the following details:
Total Experience:
Relevant Experience: (In years)
Python (Data Side): (In years)
Project worked in Banking Domain: (In years)
AWS: (in years)
Big data technologies: (In years)
Pyspark: (In years)
Hadoop:
Hive:
Data transformation : (In years)
Data Load in RDBMS: (In years)
Current CTC: including variable –
Expected CTC: including variable –
Current Organization:
Notice Period:
Current location:
Willing to relocate Bangalore:
Reason for relocation:
Holding any offers in hand? (if yes, why are you looking for another opportunity?) – No
I look forward to hearing back from you ASAP.
Stay HomeStay Safe
Submit CV To All Data Science Job Consultants Across India For Free

Leave a Reply