Career Infosystem | Jobs | Data Engineer – Etl/python /Big Data | BigDataKB.com | 31-01-22

โ€”

by

Job Location: Bengaluru

The Data Engineer is responsible for execution and management of data delivery, data transformation, and data processing in alignment with the global IT architecture. The Data Engineer works with Subject matter experts, data architects, and data analysts to develop an efficient, scalable, automated and robust data pipleline from source to front end application.

Responsibilities

– Work with subject matter experts to perform data profiling activities to understand source data

– Develop technical requirements and source to target data mapping for processing data from source to target

– Develop data pipeline to populate Analytical data stores in alignement with the data architect’s design

– Deliver data in an optimized form for the development of visualization/reports/dashboards to present business insights

Required Candidate profile

Requirements :

– Bachelor or MS degree in Computer Science, Engineering, Information Systems, Information Technology or equivalent experience

– Minimum 4 years of experience with SQL

– Strong experience in working with both OLTP/OLAP models for both data extraction and ingestion

– Solid ETL skills for high performance data loading ( AWS Glue/ AWS EMR/ Apache Spark preferred)

– Experience with Python programming (Experience in test driven development preferred)

– Experience in AWS Lambda

– Experience with workflow automation (python / Apache Airfolow preferred)

– Experience with data profiling and data quality assessment using AWS tool set

– Strong experience with database design and data architecture (ie. Snowflake, AWS Redshift, AWS Dynamo, Oracle SQL)

– Strong experience with Git source code control and demonstration of different branching strategies

– Strong experience in data curation/aggregation/preparation for use in a Vizualization tool (ie. Tableau, PowerBI, Quicksight)

– Experience and understanding of big data compute frameworks (ie. Apache Spark preferred)

Preferred Skills :

– Experience with high volume processing, performance tuning, and optimization

– Strong understanding of database engineering best practices and software design

– Excellent written/documentation and verbal communication skills

– Ability to exercise sound judgment and to work effectively given general guidance and direction

– The ability to thrive in a collaborative team environment; the right candidate is someone who is willing to take on projects and challenges with the ability to be flexible with change

Skills Experience / Proficiency :

Business Intelligence – 2 Years

Data Warehousing – Healthcare ?3 years

ETL – 3 years

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *