Versatile People | Hiring | Big Data Engineer | BigDataKB.com | 2022-09-06

0

Job Location: India

IMPORTANT

  • Please apply to this role if you are serving notice and/or your official notice period is not more than 30 days.
  • Salary: Up to 20 LPA
  • Job type: Remote. If you prefer WFO, Bengaluru will be the base.

ABOUT THE ROLE

Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products

Roles & Responsibilities:

  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services – DynamoDB, RedShift, Kinesis, Lambda, S3 etc.
  • Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments.
  • Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS.
  • Sound knowledge in spark architecture and distributed computing.
  • Proficient in Spark – including RDD and Dataframes core functions, troubleshooting and performance tuning.
  • Good understanding in object-oriented concepts and hands on experience on Scala or on java with excellent programming logic and technique.
  • Good experience in SQL – should be able to write complex queries.
  • Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
  • Able to mentor new members for onboarding to the project.
  • Understand the client requirement and able to design, develop from scratch and deliver.
  • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
  • Managing project timing, client expectations and meeting deadlines.
  • Should have played project and team management roles.
  • Facilitate meetings within the team on regular basis.
  • Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
  • Optimization, maintenance, and support of pipelines.
  • Strong analytical and logical skills.
  • Ability to comfortably tackling new challenges and learn

Must Haves:

Minimum 3 years exp. in:

  • Scala/Java (Primary)
  • Spark (Primary)
  • AWS preferable/any cloud
  • SQL (Primary up to advance level)
  • Object-Oriented Programming (Primary)
  • Good knowledge on ETL/ELT processes and tools

Good to Have:

  • AWS Certification
  • Basic knowledge of streaming
  • Knowledge on hive, Hadoop
  • Git/similar version control tool
  • Knowledge in CI/CD, Microservices

Apply Here

Submit CV To All Data Science Job Consultants Across Bharat For Free

🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

LEAVE A REPLY

Please enter your comment!
Please enter your name here