Job Location: Gurgaon/Gurugram, Bangalore/Bengaluru
Location : Gurgaon & Bangalore
Notice Period : 60 days & less (Please focus on 30 days & lesser Notice period)
Mandate Skill : Python+ ETL+ SQL + AWS
JD :
– Senior Data Engineer
Job Responsibilities :
– To collaborate with various teamsregions in driving facilitating data design, identifying architectural risks and key areas of improvement in data landscape, and developing and refining data models and architecture frameworks
– Technical experience and knowledge in Cloud Data Warehousing, data migration and data transformation
– Develop and test ETL components to high standards of data quality and performance as a hands-on development lead
– Familiarity with Data Lakes, Data Warehouses, MDM, BI, Dashboards, AI, ML
– Design data architecture patterns and ecosystems including data stores (operational systems, data lakes, data warehouses, data marts), ingress patterns (API, streaming, ETLELT), and egress patterns (analyticsdecision tools, BI tools). Lead, consult or oversee multiple architectural engagements
– Oversee and contribute to the creation and maintenance of relevant data artifacts (data lineages, source to target mappings, high level designs, interface agreements, etc.) in compliance with enterprise level architecture standards
– Experience in leading and delivering data centric projects with concentration on Data Quality and adherence to data standards and best practices
– Experience in data modeling, metadata support, development and testing for enterprise wide data solutions
Must have :
– Bachelor’s degree in a technical field (Comp. Science degree preferred not mandatory); Master’s degree is a plus.
– Expertise in ETL, Data architecture and Data modeling
– Expertise working in Relational and Big Data platforms, including MySQL, and large-scale distributed systems such as Hadoop and Spark
– Expertise in Data Engineering, Data Governance, Data Quality, Data Lake, Data Warehousing and ReportingAnalytics concepts
– Expertise building Data pipelines, Data Lakes and Data Warehouses in AWS using Cloud services such as Redshift, Snowflake, S3, RDS, Kinesis, Athena, EMR, Glue etc.
– Expertise in data analysis and writing and developing complex queries using SQL
– Experience in designing Big DataCloud Solution Designs, data models
– Knowledge of Pyspark, Shell scripting, SQL, Python & some of the standard data science packages (Pandas, Numpy, etc.).
– Strong verbal and business communication skills.
Data Engineer :
Job Responsibilities :
– Use different data warehousing concepts to build a data warehouse for reporting purpose.
– Design, develop, and launch efficient and reliable data pipelines to move data across application systems and to provide intuitive analytics to business teams
– Actively develop and test ETL components to high standards of data quality.
– Assist in the creation of design best practices as well as coding and architectural guidelines, standards, and frameworks.
– Provide analytical support like Visualization, Business Insights, Reporting, as needed.
Must have :
– 3+ years of experience in ETL (or) data engineering role in an analytics environment.
– Bachelor’s degree in a technical field (Comp. Sci degree preferred not mandatory)
– Working knowledge of Relational Database Management Systems (RDBMS) like Oracle, SQL server etc.
– Expertise in building data pipelines & data warehousing concepts
– Good understanding of Big data platforms
– Knowledge of SQL, Python & some of the standard data science packages (Pandas, Numpy, etc.).
– Strong verbal and business communication skills.
Good to have :
– Working experience in AWSAzureGCP
– Data ingestion using one or more modern ETL compute and orchestration frameworks (e.g. Apache Airflow, Luigi, Spark, Apache Nifi or Apache Beam)
– Exposure to Visualization tools like Tableau & Power BI
Submit CV To All Data Science Job Consultants Across Bharat For Free