Job Location: New York, NY
Job Title: Data Engineer
Location: New York, NY 10154
Duration: 06+ Months Contract
Job Description: Data Engineer
- The job holder is responsible for the timely delivery of high-quality end to end data solutions, while ensuring compliance with company policies.
- This role is housed in the Data and Analytics department, will be working with QA engineers and devops engineers to develop new data product features, support data analysts, data scientists and other business units.
- The position holder must have the initiative and drive necessary to deliver enterprise quality solutions in an agile manner, ready to work in depth with many different AWS resources in development and production environments.
Key Responsibilities
- Maintain and manage end to end data pipelines for structured and unstructured data.
- Work as part of a cross-functional, agile team to swiftly deliver solutions based on requirements defined by various business units.
- Ensure that all solutions are repeatable and scalable across the organization
- Provide robust solution documentation.
- Must exhibit initiative and focus to troubleshoot and seek out solutions while working independently.
- Work with DQ engineers to build test plan for new development.
- Follow code development standard, support, and enhance library
- Work as part of the Data and Analytics team with a focus on data management and solution delivery.
- Keep data protection and cloud security considerations at the forefront of every deliverable.
Qualifications
- Have designed and built scalable data pipelines in the cloud to support a wide variety of data and application solutions.
- Ability to work with different people across multiple teams effectively
- Organized and able to effectively communicate progress throughout project lifecycles
- Proven history of innovative problem solving and solution delivery
- Experience with Windows and Linux operating systems
- Experience working with container (Docker, Kubernetes)
- Strong Python skillset
- Strong SQL on a variety of platforms (such as MSSQL, Athena, Redshift), able to optimize query
- Experience maintaining AWS resources with IaC (CloudFormation, Terraform, AWS CDK)
- Experience with a broad set of AWS resources (Lambda, S3, Glue, Athena, etc.)
- Experience with source code control, Git.
- Ability to write organized, clean, well-commented code
- Experience with bash and AWS CLI
- Familiar with latest big data technology, Hadoop, spark.
- 3 – 5 years of cloud data experience
- BA/BS and ideally advanced degree or equivalent combination of education/experience
- Ability to handle multiple priorities and meet aggressive deadlines.
Submit CV To All Data Science Job Consultants Across United States For Free
🔍 Explore All Related ITSM Jobs Below! 🚀
✅ Select your preferred "Job Category" in the Job Category Filter 🎯
🔎 Hit "Search" to find matching jobs 🔥
➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼