Job Location: Bangalore
- 1+ years of experience as a Data Engineer or in a similar role
- Experience with data warehousing, and building ETL pipelines
- Experience in SQL
Job summary
- Design, develop, implement, test, and operate large-scale, high-volume, high-performance data structures for analytics and Reporting.
- Implement data structures using best practices in data modeling, ETL processes, and SQL, AWS – Redshift, and OLAP technologies, Model data and metadata for ad hoc and pre-built reporting.
- Work with product tech teams and build robust and scalable data integration (ETL) pipelines using SQL, Python and Spark.
- Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
- Interface with business customers, gathering requirements and delivering complete reporting solutions.
- Collaborate with Analysts, Business Intelligence Engineers, SDEs, and Product Managers to implement algorithms that exploit rich data sets for statistical analysis, and machine learning.
- Communicate effectively with product/business/tech-teams/other Data teams
Key job responsibilities
2+ years of experience as a Data Engineer or in a similar role – Experience with data modeling, data warehousing, and building ETL pipelines – Experience in SQL – Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related technical discipline. – 1+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets – Hands-on experience and advanced knowledge of SQL – Experience in Data Modeling, ETL Development, and Data Warehousing – Experience with one or more big data technologies (Hadoop, Hive, Hbase, Spark etc.) – Experience in one or more scripting or programming language – Solid understanding of data design approaches (and how to best use them) – A desire to work in a collaborative, intellectually curious environment. – Effective analytical, troubleshooting, and problem-solving skills
A day in the life
Design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business intelligence analytics. Incorporate software engineering best practices, data management fundamentals, data modeling, ETL/ELT processes, and data storage principles to implement data structures. Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions that work well within the overall data architecture. Analyze source data systems and drive best practices in source teams. Use query languages including SQL, HiveQL, SPARQL, and/or Oracle. Build data solutions using OLAP technologies, schema definition languages, and scripting languages. Create physical and logical data models and optimize data pipelines that are stable and performant. Use data persistence solutions, data integration techniques, database optimization, and join algorithms to write secure, stable, testable, maintainable code with minimal defects. Optimize operational data storage and processing of semi structured data streams to build self-service business intelligence infrastructure and reusable datasets. Participate in the full development life cycle, end-to-end, from design, implementation and testing, to documentation, delivery, support, and maintenance. Produce comprehensive, usable dataset and metadata documentation. Participate in code and design reviews. Ensure data models have proper access control, data integrity, auditability and testing protocols. Mentor junior data engineers.
About the team
Amazon’s India Ad Tech organization is seeking a highly quantitative, enthusiastic Data Engineer to drive the development of Ads analytics and insights. Be a part of an innovative and passionate team, responsible for building a successful, sustainable and strategic international business for Amazon, from the ground up. You will succeed in this role if you are an organized self-starter who can learn new technologies quickly and excel in a fast-paced environment. In this position, you will be a key contributor and partner in developing analytics and insights that global executive management teams and business leaders will use to define Ad strategies and deep dive businesses. You should be highly analytical, resourceful, customer focused, team oriented, and have an ability to work independently under time constraints to meet deadlines. You will be comfortable learn new technologies, exploring new areas and diving deep. A proven track record in taking on end-to-end ownership and successfully delivering results in a fast-paced, dynamic business environment is strongly preferred. You will be working closely with Product managers, program managers, SDEs and UI engineers to build data engineering solution to provide in depth Ad insights, analytics and recommendations and drive India Ad business.
2+ years of experience as a Data Engineer, BI Engineer or related field in a company with large, complex data sources. – Experience working with AWS big data technologies (Redshift, S3, EMR, Glue) – Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations. – Experience providing technical leadership and mentor other engineers for the best practices on the data engineering space.
Submit CV To All Data Science Job Consultants Across India For Free