Mount Talent Consulting Private Limited | Hiring | Data Engineer | BigDataKB.com | 2022-09-06

Job Location: Bangalore/Bengaluru

Role- Data Engineer

Experience- 1-7 Years

Job Type- Full time

Notice Period- Immediate Joiners or up to 30 Days

Location-Bangalore

What does the Data Engineer Do?

Demonetarising the experience in data engineering for developing and maintaining data engineering modules and pipelines for our SAAS offering. The primary focus will be to develop/enhance/optimize data engineering pipelines. The Data Engineer will also be responsible for supporting customers proof of validations and implementations from data engineering perspective.

What are we looking for?

  • Experience of working on public clouds (Azure)
  • Good Coding skills in Python, Pyspark and SQL is must.
  • Experience of writing/maintaining Spark code base in a production environment.
  • Big Data Experience – Spark, Relational Databases (Postgres, etc.)
  • Worked with orchestration technologies like Airflow, Kubeflow etc.
  • Build & support scalable data engineering pipelines (ETLs etc.). This will entail extract, load and transform of โ€˜big dataโ€™ from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies, along with real time monitoring dashboards and alerting.
  • Essential experience of working with distributed systems software development.
  • Demonstrated experience of production experience in big data infrastructure and data modelling.
  • Critical experience performance optimization for both data loading and data ingestion.
  • Know-how of critical tools, in a developerโ€™s toolkit such as GitHub, Dockers, VSCode
  • Ability to work in a fast-paced and deadline driven environment.

What are the key responsibilities?

  • Build & support scalable data engineering pipelines (load, extract, cleaning, transform, ingest etc.) for our SaaS AI Applications and Predictions-as-a-Service Implementations and Product.
  • Build and Deploy the Data Engineering pipelines for scale using Kubeflow
  • Have ownership of multiple data pipelines.
  • Review, audit and improve the Data Engineering pipelines
  • Document and communicate technical and functional design (HLD, LLD), timelines and plans
  • Work closely with AI/ML, DevOps, MLE, other engineering and product team
  • Work with the engineering and implementation team to understand business problems and implement efficient software solutions
  • Follow configurable programming practices (config files, modular programming, parameterization, etc.)
  • Support Maintenance/enhancement of deployed pipelines. This includes bug-fixes and performance improvement.

What are the Good to have skills?

  • Consulting experience
  • Exposure and experience working with international clients / geographies
  • Exposure in building a SAAS product.

Apply Here

Submit CV To All Data Science Job Consultants Across Bharat For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *