Reflections Info Systems | Jobs | DATA ENGINEER | BigDataKB.com | 10-02-22

BRIEF DESCRIPTION

We are looking for 4+ years experienced Data Engineer

Job Description

• Create and maintain optimal data pipeline architecture
• Assemble large, complex data sets that meet business requirements
• Optimize data delivery and re-design infrastructure for greater scalability
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using kafka and Azure technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs.
• Work closely with business intelligence team, understand their requirements through API and needs to check with the backend postgres and snowflake data warehouses and needs to update the facts and dimensions according to that.
• Strong understanding of data warehouse concepts is needed.

Responsibilities

• The candidate needs to work closely with Business intelligence team, understand their requirements through API and needs to check with the backend postgres and snowflake data warehouses and needs to update the facts and dimensions according to that.
• Strong understand of data warehouse concepts is needed.

Primary Skills

• Databases, Data warehouses, Kafka, Azure Datalake, Postgres , snowflake, API, Data ingestion, python.
• Distributed systems, apache Airflow.

Secondary Skills(If Any)

• Mongo DB , open API, fast API, business intelligence