INTEGRATED PERSONNEL SERVICES LIMITED | Jobs | Data Engineer | BigDataKB.com | 31-01-22

โ€”

by

Job Location: Pune

Roles and Responsibilities

  • Collaborate with Product Management to understand business requirements and design

appropriate solutions

  • Implementation and enhancement of Data pipelines
  • Designs, codes, tests, supports and documents all new BI systems, applications,

reports and visualizations .

  • Works with cross functional teams to ensure the necessary data and analysis

environments are available

  • Develops the overall data transformation workflows and build appropriate frameworks

for continued new product integrations

  • Responsible for executing technical user stories for sprint.
  • Enforce and follow technical standards for deliverables of projects.
  • Have very good understanding of Continued integration to drive the DevOps

implementation on respective projects using tools – Github, Jenkins

Desired Candidate Profile

3+ years professional experience in Big Data Pipelines using Airflow or similar tools

  • Proficiency in programming languages like PySpark, Python
  • High level of Proficiency in SQL (Advanced) and experience with Semi-structured data
  • ETL/Data Processing Technology for Data warehouse/ Data Lakes:  Apache Spark,

Talend, any other Open source ETL tool.(at least 2 years of experience in any of these

tools),

  • Knowledge of Real-time Data streaming  like Apache Kafka , AWS Kinesis, Spark

Streaming

  • Must have a high degree of initiative to implement solutions in a fast-paced, dynamic

environment.

  • Must be able to understand business requirements and translate them into technical

deliveries.

  • Experience in Large dataset integration with variety of different sources, each with

varying degrees of data quality and cleanliness

  • Knowledge and experience of datastores such as SQL server, PostgreSQL and Cloud

datastores like  Snowflake Datawarehouse/ Big data datastores

  • Desirable: Dimensional modeling methodologies and development for data warehouses
  • Nice to have: Knowledge on Predictive Analytics, ML, Data Mining models
  • Nice to have: Knowledge on Data Catalogging
  • โ€ข Requires strong analytical, conceptual and problem-solving abilities
  • โ€ข Familiarity with Agile concepts, and experience practicing SCRUM.
  • โ€ข Experience working with remote teams.
  • โ€ข Must have excellent communication skills.

Perks and Benefits

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *