Job Location: Seattle, WA
- Bachelor’s degree in Computer Science, Info Systems, Business, or related field
- 2+ years of experience with one or more query languages (e.g. SQL), schema definition languages (e.g. DDL), and scripting languages (e.g. Python) to build data solutions
- 2+ years of experience with Data Modeling (e.g. Dimensional and 3NF)
- 2+ years of experience in distributed system concepts from a data storage and compute perspective (e.g. data lake architectures)
We’re looking for Data Engineers to help us grow our Data Lake, which is built using a serverless architecture, with 100% native AWS components including Redshift Spectrum, Athena, S3, Lambda, Glue, EMR, Kinesis, SNS, CloudWatch and more! We own a world-class data lake that is used to drive multi-billion-dollar decisions on a regular cadence and we’re looking to improve on filling the lake quickly, with as little human intervention needed and democratize the data in the lake.
AWS Infrastructure’s Supply Chain Automation Organization Data Engineers build the ETL and analytics solutions for our internal customers to answer questions with data and drive critical improvements for the business. Our Data Engineers use best practices in software engineering, data management, data storage, data compute, and distributed systems. We are passionate about solving business problems with data!
Key job responsibilities
- Develop and maintain automated ETL pipelines (with monitoring) using scripting languages such as Python, Spark, SQL and AWS services such as S3, Glue, Lambda, SNS, SQS, KMS.
- Implement and support reporting and analytics infrastructure for internal business customers.
- Develop and maintain data security and permissions solutions for enterprise scale data warehouse and data lake implementations including data encryption and database user access controls and logging.
- Develop data objects for business analytics using data modeling techniques.
- Develop and optimize data warehouse and data lake tables using best practices for DDL, physical and logical tables, data partitioning, compression, and parallelization.
- Develop and maintain data warehouse and data lake metadata, data catalog, and user documentation for internal business customers.
- Work with internal business customers and software development teams to gather and document requirements for data publishing and data consumption via data warehouse, data lake, and analytics solutions.
About the team
AWS Infrastructure helps manage the cloud elastic for AWS customers and products and the Infrastructure services help do so by keeping waste to a minimum. The supply chain automation organization owns and builds software systems that help manage the entire lifecycle of our fleet. This includes forecasting and planning for long range supply resources like power, space, networking and supply chain capacity down the optimization systems that plan for server level placement in data centers across availability zones.
- Check out what AWS’ infrastructure footprint looks like: https://infrastructure.aws
Our team is part of the AWS Infrastructure organization, which is responsible for planning, building, and operating all of our data centers around the world. This includes the global supply chain for physical servers and components, networking gear, power equipment, etc. Lots of big and fascinating data if you’re interested in the world’s largest cloud computing infrastructure.
- What does the supply chain automation organization do? https://www.youtube.com/watch?v=rBm3jlA0-4Y
- Experience building enterprise-scale data warehouse and data lake solutions end-to-end
- Knowledgeable about a variety of strategies for ingesting, modeling, processing, and persisting data
- Experience with native AWS technologies for data and analytics such as Redshift Spectrum, Athena, S3, Lambda, Glue, EMR, Kinesis, SNS, CloudWatch, etc.
- Write secure, stable, testable, maintainable code with minimal defects
- Meets/exceeds Amazon’s functional/technical depth and complexity for this role
- Meets/exceeds Amazon’s leadership principles requirements for this role
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Submit CV To All Data Science Job Consultants Across United States For Free