Insight Global | Jr. Data Engineer–Hybrid Chicago! | Chicago, IL | United States | BigDataKB.com | 2023-01-25

0

Job Location: Chicago, IL

Job Detail:

***This position is a permanent/direct hire position. Candidates must be LOCAL to Chicago and willing to go on site in downtown Chicago, 2-3 days per week.**

Qualifications

  • 1+ years as a Data Engineer
  • DataBricks AND/OR AWS Data Lake
  • Python, Athena, Glue, Spark
  • Experience with database and data lake development and/or management
  • Strong Spark Experience
  • Understanding of security concepts around data lakes
  • Data Onboarding
  • LOCAL TO CHICAGOLAND AREA and willing to go on site 2-3 days/week

Plusses:

  • FiveTran
  • Experience with database and data lake development and/or managemet

Day to Day:

This position will be part of a team focused on the creation of a data lake repository and related ETL processes using FiveTran, DataBricks and other technologies. In addition to creation of data lake systems this job is also responsible for data ETL, data curation and data quality check processes. This position supports the Data Engineering team and works in an Agile environment.

  • Participate in the database and data lake development using technologies such as FiveTran, DataBricks, Spark, AWS data lake and traditional technologies like SQL Server
  • Design and Implement end to end Data Lake solutions using the technologies listed above as well as:
  • Data integrity process using DataBricks and related tools/processes
  • Integrating Data Lake with 3rd party application APIs for downstream queries
  • Access design and integrations for Data Lake users and applications
  • Utilizing AWS and related data technologies and concepts
  • Python
  • Athena
  • Glue/Crawlers
  • Lake Formation
  • ETL
  • Spark
  • Workflows & automation
  • Triggers
  • Lambda Functions
  • IAM data lake security concepts/permissions
  • Data Onboarding – define onboarding procedures and work with business stakeholders to onboard new data sources.




Apply Here

Submit CV To All Data Science Job Consultants Across United States For Free

🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

LEAVE A REPLY

Please enter your comment!
Please enter your name here