Job Location: Chennai
Let’s talk about the team and you:
We are passionate and innovative problem solvers that support business units across the globe, providing on-going opportunities to engage with new and challenging projects. You are passionate about data and using it in meaningful ways. You have a deep understanding of a wide-variety of big data tools and technologies which you can implement to achieve desired business outcomes. You are a team player who lifts the entire team through collaboration, mentoring and sharing your experience.
As a Data Engineer within ResMeds Advanced Analytics team, you are responsible for transforming and analyzing data by expanding and optimizing our data and data pipeline in AWS architecture. The Data Engineer will support our architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. Reporting to the Manager of Data Engineering, you will play a key role of developing, constructing, testing and maintaining data on the AWS platform.
Let’s talk about Responsibilities:
- Assemble large, complex data that meet functional/non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing transformation for greater scalability, etc.
- Use the infrastructure/services required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS services.
- Create data for analytics and data scientist team members that assist them in building and optimizing our product.
- Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data requirement needs.
- Create and maintain optimal data pipeline architecture in AWS. Keep our data separated and secure across boundaries through multiple AWS regions.
Let’s talk about Qualifications and Experience:
- Bachelor/Engineering degree in IT / Computer Science/ software engineering or relevant field
- 7+ years of relevant experience in a complex, technical environment
- Must have AWS Certified Solutions Architect – Associate/Professional level
- Industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets
- Excellent working knowledge on Linux
- Experience working with Data Scientist
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Must have experience working on Snowflake
- Must have experience working on Spark/Scala, Kafka, Elasticsearch and Python (at least two)
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets.
- Experience in manipulating, processing and extracting value from large disconnected datasets.
- Experience with AWS cloud services: (Redshift, RDS, EMR, Kinesis, S3, Glue, DMS-Batch/CDC, Athena, EC2, Lambda, SQS, SNS etc.)
- Experience working on AWS Data Lakes
- Experience working on AWS Data Pipeline and CI/CD processes
- Exposure to Hadoop Ecosystem preferably on AWS/EMR, NoSQL-based, SQL-like technologies
- Experience with Data Science tools & technologies on AWS Cloud is plus
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Excellent communication and able to work with stakeholders
Submit CV To All Data Science Job Consultants Across Bharat For Free
