Job Location: United States
What You Will Do:
The Senior Data Engineer is responsible for the delivery of a business need end-to-end starting from understanding the requirements to deploying the software into production. This role requires you to be fluent in some of the critical technologies with proficiency in others and have a hunger to learn on the job and add value to the business. Critical attributes of being a Senior Data Engineer, among others, is Ownership & Accountability.
In addition to Delivery, the Senior Data Engineer should have an automation first and continuous improvement mindset. They should drive the adoption of CI/CD tools and support the improvement of the tools sets/processes.
Behaviors of a Full Stack Engineer:
Senior Data Engineer is able to articulate clear business objectives aligned to technical specifications and work in an iterative, agile pattern daily. They have ownership over their work tasks, and embrace interacting with all levels of the team and raise challenges when necessary. We aim to be cutting-edge engineer โ not institutionalized developers.
Key Characteristics and duties you will perform:
ยท Analyze source data and data flows, working with structured and unstructured data.
ยท Build data pipelines to extract, transform, crunch and store data in various target systems
ยท Write reference-able & modular code
ยท Design and architect the solution independently
ยท Have a passion to learn, Take ownership and accountability
ยท Deep desire for automation using devops practices and toolsets
ยท Have a desire to simplify; be entrepreneurial / business minded
Skills and Experience You Will Need:
Mandatory:
ยท 2+ years being part of Agile teams โ Scrum or Kanban
ยท 2+ years of solution architecting in cloud technology (eg. AWS, Azure, google cloud)
ยท 6+ years of working in an object-oriented language: Java or Scala and Python
ยท 3+ years of working experience in Apache Spark, PySpark, Apache Airflow
ยท 3+ years of database systems like Hadoop, Teradata, Redshift, Oracle, MySQL, PostgreSQL, MongoDB, Neo4j, Cassandra
ยท 3+ years of devops tool chain: Jenkins, Maven, Artifactory, Docker, Terraform, Ansible
ยท 3+ years of experience in AWS Glue, SNS, SQS, S3, ECS, LAMBDA
ยท 2+ years of working experience with operationalizing Machine learning models
Desired:
ยท Understanding of Machine learning frame works (e.g. Scikit learning, Scipy)
ยท Understanding and 1+ yrs of working experience with Deep learning frameworks
Education:
ยท Minimum degree required for position (bachelorโs degree):
ยท Acceptable Major(s) or Field(s) of Study: Data Science, Computer Science or any related field
Skills/Certifications/Licenses:
ยท Nice to have AWS solution architecture and developer certification
ยท Nice to have data science and Machine learning certification from a reputed institution
Evaluation Benchmarks
Self-Assessment (1-5)
Experience (In years)
Notes/Comments
2+ years being part of Agile teams โ Scrum or Kanban
2+ years of solution architecting in cloud technology (eg. AWS, Azure, google cloud)
6+ years of working in an object-oriented language: Java or Scala and Python
3+ years of working experience in Apache Spark, PySpark, Apache Airflow
3+ years of database systems like Hadoop, Teradata, Redshift, Oracle, MySQL, PostgreSQL, MongoDB, Neo4j, Cassandra
3+ years of devops tool chain: Jenkins, Maven, Artifactory, Docker, Terraform, Ansible
3+ years of experience in AWS Glue, SNS, SQS, S3, ECS, LAMBDA
2+ years of working experience with operationalizing Machine learning models
Desired: Understanding of Machine learning frame works (e.g. Scikit learning, Scipy)
Desired: Understanding and 1+ yrs of working experience with Deep learning frameworks
Minimum degree required for position (bachelorโs degree): Acceptable Major(s) or Field(s) of Study: Data Science, Computer Science or any related field
Nice to have AWS solution architecture and developer certification
Nice to have data science and Machine learning certification from a reputed institution
Submit CV To All Data Science Job Consultants Across United States For Free

Leave a Reply