Job Location: Reston, VA
We are looking for an Experienced Cloud Data Engineer who will be responsible for standardizing our data ingestion pipelines and improving performance of data storage and retrieval. Our projects ingest structured and unstructured data from multiple sources that eventually ends up in a unified Data Lake. This data is available for reporting and analytics by various other teams. This candidate should be comfortable working with SQL as well as* NoSQL* databases. AWS experience is required.
Your primary focus will be the continuous development/improvement of our data ingestion pipelines, and data parsing. Major technologies involved include AWS CloudFormation, Step Functions, Lambda Functions, AWS Glue, Amazon Athena, Redshift and* RDS.*
Skills and Responsibilities
- Design and develop stream and batch processing data pipelines
- Ability to write intermediate to advanced Python and SQL for data ingestion and processing.
- Support existing and develop new data flows as needed by developing processes that verify, standardize, and scale data input, transformation and storage.
- Collaborate with product managers and other engineers to implement and document complex and evolving requirements
- Research and implement innovative solutions to solve challenges related to ETL, data processing, and analytics.
- Support efforts by the Data Science and Data Analytics teams.
- Ability to debug complex data issues without frequent guidance from senior team members.
- Occasional Linux server management including the review or management of log files, crontab, security configuration, etc.
- Developing techniques to work with both tabular and hierarchical data.
- Strong attention to detail, good work ethic, ability to work on multiple projects simultaneously, and good communication skills
Required Skills
- 3 to 6 years of experience working in Data Engineering or related roles
- 1+ years of Cloud experience required!
- A degree in Computer Science or an equivalent major.
- Must have strong programming & ETL skills in Python & SQL.
- Experience working with various database systems: SQL Server/PostgreSQL/Redshift etc.
- Experience working with Step Functions, Lambda Functions, AWS Glue, & Amazon Athena.
- Experience with agile methodologies and short release cycles
- Distributed System Development for large-scale applications
- Enjoys collaborating with other engineers on architecture and sharing designs with the team
- Hands-on experience with writing CloudFormation
Desired Experience
- Experience working with PHI/Healthcare
- AI / ML
~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~
ACR offers a rewarding employee experience: innovative culture, professional growth potential, competitive compensation and an exceptional benefits package, including a defined contribution pension plan, 403(b); generous paid time off package; insurance plans with the leading providers; flexible spending; tuition reimbursement; training opportunities; and wellness reimbursement.
To learn more about ACR’s rewarding employee experience, culture, and benefits, visit https://www.acr.org/About-ACR/Work-With-Us
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)
Qualifications
Skills
Behaviors
:
Motivations
:
Education
Experience
Licenses & Certifications
Job Type: Full-time
Submit CV To All Data Science Job Consultants Across United States For Free
