Before u proceed below to check the jobs/CVs, please select your favorite job categories, whose top job alerts you want in your email & Subscribe to our Email Job Alert Service For FREE
Job Location: Huntsville, AL
Job Detail:
Data Engineer
Job LocationsUS-AL-Redstone Arsenal | US-VA-Chantilly
Requisition ID 2022-128561
Position Category Software Engineering / Development / Architecture
Clearance Top Secret
Sector Space & Intelligence
Responsibilities
GovTact is seeking a Data Engineer who can leverage experience and expertise in data exploration, engineering, and ETL to explore, architect, develop, and deploy scripts for processing structured and unstructured data into usable data formats for long term storage, search, and analysis.
- Creating a custom ingest pipeline to a Big Data platform with consistent performance and scalability
- Understanding of programming and data engineering concepts and best practice.
- Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis.
- Ability to manage and organize data while identifying trends and inconsistencies that will impact downstream analytics
- Ability to work both independently and collaboratively.
- High levels of curiosity, creativity, and problem-solving capabilities.
- Strong written and verbal communication skills.
- Experience with data pipelines or be willing to learn a pipeline from bottom to top
- Be able to trouble shoot files against an architecture to see where the upload process is failing.
- Be able to understand unit tests and add to them to increase stability to the entire pipeline.
- Be prepared to use, GIT, JIRA, Confluence, Anaconda, Spyder, and Microsoft tools.
- Be prepared to express ideas and solutions and walk together with teammates through coding challenges
Qualifications
Required Qualifications:
- Six years experience with ETL with experience in following:
- Oracle 11g/12c, Sun Solaris OS, Linux (CentOS, Red Hat), and Windows environments
Performing software and scripting engineering for data ingest with Java or Python for ETL
Web services and/or microservices
ETL tools such as NiFi or Informatica
Using software repository tools such as GIT or SVN
- A current Top Secret security clearance with SCI eligibility and the ability to obtain a polygraph.
Desired Qualifications:
- Have knowledge of Databricks, Scala, Python, and PySpark
- Have experience tuning complex SQL queries
- Experience with the AWS and Data Ingest/Transformation processes
- Have worked in an Agile environment.
- You have worked on teams that practice Agile methodologies.
Job Type: Full-time
Pay: $69,709.49 – $135,219.64 per year
Benefits:
- 401(k)
- 401(k) matching
- Dental insurance
- Flexible schedule
- Health insurance
- Life insurance
- Paid time off
- Retirement plan
- Tuition reimbursement
- Vision insurance
Schedule:
- Day shift
Ability to commute/relocate:
- Huntsville, AL: Reliably commute or planning to relocate before starting work (Required)
Application Question(s):
- Do you have a TS/SCI Clearance
Experience:
- ETL: 5 years (Required)
Work Location: One location
Submit CV To All Data Science Job Consultants Across United States For Free
