Eli Lilly and Company | Jobs | EDP Cloud Data Engineer | BigDataKB.com | 31-01-22

โ€”

by

Job Location: Bengaluru

Job Summary

  • The Enterprise Data program is developing a fully integrated and intuitive data and analytics platform.
  • This platform will enable Lilly team members to quickly view, access, and analyze data sets in statistical environments, advanced analytics environments, and BI/visualization tools. +
  • Contributors can easily ingest, prepare, and analyze new data sets (cleanse, enhance, publish) for others to utilize.
  • This position is responsible for providing support for ETL / ELT / File Movement of data as part of an enterprise data program.
  • The key responsibilities will be to process and move data between different compute and storage services, as well as on-premises data sources at specified intervals.
  • The employee will also be responsible for the creation, scheduling, orchestration and management of data pipelines.

Competency Summary

  • Data engineers are responsible for ensuring the availability and quality of data needed for analysis and business transactions.
  • This includes data integration, acquisition, cleansing, harmonization and transforming raw data into curated datasets for data science, data discovery, and BI/analytics.
  • Responsible for developing, constructing, testing and maintaining data sets and scalable data processing systems.
  • Data engineers work closest with Data Architects and Data Scientists.
  • They also work with business and IT groups beyond the data sphere, understanding the enterprise infrastructure and the many source systems.
  • Input is raw datasets. Output is analytics-ready, integrated/curated datasets.

Key Capabilities in this Role Family Include:

  • Data Acquisition – is the process of gathering and storing data in a location and format that it can be consumed for data preparation and/or downstream business uses.
  • Data Preparation – is an iterative process for exploring, integrating, cleaning, validating and transforming raw data into curated datasets
  • Data Publishing – is the act of releasing data in consumable form for (re)use by others.

Key Objectives/Deliverables

  • Gather user requirements and translate them into business solutions.
  • Design, develop, test, improve, and maintain new and existing solutions for data integration, data prep, ingestion, cleansing, and transforming raw data into curated datasets for business consumption.
  • Incorporate deep data management expertise into solutions, including permissions, recovery, security, and monitoring.
  • Validate and qualify solutions.
  • Identify, troubleshoot, debug, and resolve technical issues.
  • Work with business and IT groups to understand source systems and enterprise infrastructure offerings.
  • Work with data from multiple data sources to build integrated views that will drive decisions
  • Consult with internal customers who own the data to develop information relationships that lead to actionable insights.
  • Work in Agile Sprints with business facing project teams

Minimum Position Qualifications

  • Bachelor s Degree and 5 years experience in the implementation of modern data ecosystems in AWS/Cloud platforms.
  • Strong experience with AWS ETL/File Movement tools ( GLUE, Athena, Lambda, Kenesis and other AWS integration stack)
  • Strong experience with Agile Development, Cloud formation Template, AWS CodeBuilt, AWS Code Pipeline
  • Strong experience with Two or Three AWS database technologies ( Redshift, Aurora, RDS,S3 & other AWS Data Service ) covering security, policies, access management
  • Strong programming Experience with Python and Spark
  • Experience with Apache Airflow,Ansible & other automation stack.
  • Excellent oral and written communication skills.
  • A high level of intellectual curiosity, external perspective, and innovation interest
  • Strong analytical, problem solving and investigative skills
  • Experience in applying quality and compliance requirements
  • Experience with security models and development on large data sets

Additional Preferences

  • ITIL Certification

Education Requirements:

  • Bachelor s Degree or relevant degree

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *