AppZen | Jobs | Senior Data Engineer | BigDataKB.com | 09-02-22

โ€”

by

Job Location: Pune

 

Must – Have :

  • Expertise in at least one popular Python framework (like Django, Flask or Pyramid)
  • Data Engineering and Analytics, Building Data Pipelines, Implementing algorithms in a distributed environment.
  • Write Python scripts to parse data and invoke APIs / Scripts and to parse data from Databases.
  • Develop Airflow jobs after gathering and translating end user requirements.
  • NoSQL experience, especially Elasticsearch.
  • Implement CI/CD for Airflow DAG deployment.
  • Familiarity with front-end technologies (like JavaScript and HTML5).
  • Python-based automated ETL pipelines for a wide variety of data sources
  • Work on Agile/Lean development methods using Scrum/Kanban
  • Work directly with engineering teams for design and build their development requirements.
  • Hosting an application on Cloud using Docker and Kubernetes

Technical Skills :

  • Python, Python Libraries like Django/Flask, REST API/Microservices
  • NoSQL or SQL Data base like MongoDB, PostgreSQL, SQLite,Elasticsearch
  • CI/CD platform like Jenkins, Docker Kubernetes.
  • Strong in OOPS and Design Patterns concepts.
  • Data Structures and able to write all logical programming.
  • GIT, Jira (Agile)
  • Unit Test case like PyTest etc.
  • Good to know AWS (Lambda, ECS, EC2, S3, SQS, Elastic Transcoder).
  • Nice to have experience in custom ETL workflow experience.
  • Python libraries like Numpy, Pandas etc.
  • Be responsible for the performance and usability of the system
  • Bring forward ideas to experiment and work in teams to transform ideas to reality
  • Strong problem solving, deductive reasoning, and decision making skills.
  • Should possess very good communication with strong business analyst skills.
  • Maintain high standards of software quality by establishing good practices and habits within the Development team while delivering solutions on time and on budget.
  • Demonstrated ability to quickly learn new tools and paradigms to deploy cutting edge solutions.

Nice to have :

  • Familiar with AWS services, especially S3, big data services and DevOps tools
  • B.E. or in Computer Science, Engineering, or other relevant technical field.
  • Must have 7+ years of relevant industry experience.
  • Superset / Kyligence/ Snowflake/ Redshift nice to have.

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *