Job Location: Chantilly, VA
You…
As a Data Engineer, you will be joining the team that is deploying and delivering a cloud-based, multi-domain Common Data Fabric (CDF), which provides data sharing services to the entire DoD Intelligence Community (IC). The CDF connects all IC data providers and consumers. It uses fully automated policy-based access controls to create a machine-to-machine data brokerage service, which is enabling the transition away from legacy point-to-point solutions across the IC enterprise.
Us…
We were founded as a fresh alternative in the Government Consulting Community and are dedicated to the belief that results are a product of analytical thinking, agile design principles and that solutions are built in collaboration with, not for, our customers. This mantra drives us to succeed and act as true partners in advancing our client’s missions.
Program Mission…
The CDF program is an evolution for the way DoD programs, services, and combat support agencies access data by providing data consumers (e.g., systems, app developers, etc.) with a “one-stop shop” for obtaining ISR data. The CDF significantly increases the DI2E’s ability to meet the ISR needs of joint and combined task force commanders by providing enterprise data at scale. The CDF serves as the scalable, modular, open architecture that enables interoperability for the collection, processing, exploitation, dissemination, and archiving of all forms and formats of intelligence data. Through the CDF, programs can easily share data and access new sources using their existing architecture. The CDF is a network and end-user agnostic capability that enables enterprise intelligence data sharing from sensor tasking to product dissemination.
Responsibilities…
Primary responsibility is to work with data providers within the IC and DoD Enterprise to identify and ingest data sets into the CDF data broker. In this role you will:
- Develop, optimize, and maintain data ingest flows using Apache Nifi and Python.
- Develop within the components in the cloud platform, such as Apache Kafka, NiFi, and HBase.
- Communicate with data owners to set up and ensure CDF streaming and batching components are working (including configuration parameters).
- Document SOP related to streaming configuration, batch configuration or API management depending on role requirement.
- Document details of each data ingest activity to ensure they can be understood by the rest of the team
What we’d like to see…
- A minimum of 3 years of experience with programming and software development including analysis, design, development, implementation, testing, maintenance, quality assurance, troubleshooting and/or upgrading of software systems
- DoD 8570 IAT Level II Certification (e.g. Security+)
- Demonstrable CentOS command line knowledge
- Working knowledge of web services environments, languages, and formats such as RESTful APIs, SOAP, FTP/SFTP, HTML, JavaScript, XML, and JSON
- Understanding of foundational ETL concepts
- Experience implementing data ignorations with in the IC DoD Enterprise.
Desired Skills:
- Experience or expertise using, managing, and/or testing API Gateway tools and Rest APIs (desired)
- 2+ Experience in Python Development
- Experience or expertise configuring an LDAP client to connect to IPA (desired)
- Advanced organizational skills with the ability to handle multiple assignments
- Strong written and oral communication skills
Years of Experience: 12 years of experience or more.
Education: Bachelor’s degree in systems engineering, computer engineering, or a related technical field
Location: Chantilly, VA
Clearance: Active TS/SCI w/ ability to obtain CI Poly
Submit CV To All Data Science Job Consultants Across United States For Free