Job Location: Chicago, IL
Equivalent Experience
Description:
This position is responsible for hands on technical development and engineering processes on a team focused on the creation of a data lake repository and related ETL processes using FiveTran, DataBricks and other technologies. In addition to creation of data lake systems this job is also responsible for data ETL, data curation and data quality check processes. This position supports the Data Engineering team and works in an Agile environment.
The ideal candidate will have a solid background in database and data lake development using technologies such as FiveTran, DataBricks, Spark, AWS data lake and traditional technologies like SQL Server. The position will be a contributor on a team building end to end ETL, Data Lake, Data an AWS data lake using Agile Project Management methodologies.
Design and Implement end to end Data Lake solutions using the technologies listed above as well as:
o Data integrity process using DataBricks and related tools/processes
o Integrating Data Lake with 3rd party application APIs for downstream queries
o Access design and integrations for Data Lake users and applications
Experience with AWS and related data technologies and concepts in the following areas is a plus:
o Python
o Athena
o Glue/Crawlers
o Lake Formation
o ETL
o Spark
o Workflows & automation
o Triggers
o Lambda Functions
o IAM data lake security concepts/permissions
Skills:
Databricks, data bricks, spark, python, ETL, AWS, data, big data, informatica, fivetran, talend
Top Skills Details:
Databricks,data bricks,spark,python,ETL
Additional Skills & Qualifications:
Requirements:
- 6+ years of professional experience in Data Engineering and Database processes.
- DataBricks, Spark, Python, and AWS or other related data certifications are highly preferred.
- Understanding of cloud technologies such as IaaS and SaaS.
- Experience working in agile processes.
- 4 year college degree in information technology or equivalent experience.
Knowledge, Skills, Abilities and Behaviors:
- Self-starter who can work independently as well as in a team setting.
- Giving and receiving effective feedback across all interactions.
- Ability to address conflict with peers and others in the organization.
- Interest in understanding business needs to aid in developing solutions that are right for the broader organization
About TEKsystems:
We’re partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That’s the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
Submit CV To All Data Science Job Consultants Across United States For Free