Job Location: Bangalore
Senior Data Engineer
Career Level: IN 4
Location: Bangalore
About Global Tech.
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people and put a smile on their face. That’s what we do at Walmart Global Tech. We’re a team of 15,000+ software engineers, data scientists and service professionals within Walmart, the world’s largest retailer, delivering innovations that improve how our customers shop and empower our 2.3 million associates. To others, innovation looks like an app, service or some code, but Walmart has always been about people. People are why we innovate, and people power our innovations.Being human-led is our true disruption.
Team and Position Summary:
iAnalytics : This is the team which delivers analysis and machine learning solutions for the inventory domain in Walmart. The team is responsible for architecture, design and delivery of systems that make up the Data Science pipeline in item inventory.
We are a team of highly experienced Data Scientists and Data Engineers who are actively working on the cutting edge machine learning tools to develop Al/ML solutions. We get to interact with multiple teams across the company to provide scalable robust technical solutions.
Position Responsibilities:
- Through this role you have an opportunity to design, develop, monitor and operate batch & stream data pipelines processing hundreds of millions of records to provide high quality datasets for analytical and machine learning use-cases with low latency.
- You also get to work on cloud-based and on premise tech stacks.
- You also get to collaborate with teams across org, to understand the semantics of data and SLA’s so as to do build valuable insights.
- You also get to evaluate trending tools around data engineering, build quick proof of concepts which contributes to overall engineering excellence.
- You will also be required to seek ways to improve the software and its effectiveness.
- In this role it would be important for you to professionally maintain code repository and manage release cycles regularly in order to meet the project goals.
- You will also coach the team on bringing in design patterns, XP Practices and coding guidelines.
- You will show your skills in analysing and testing programs/products before formal launch to ensure flawless performance
- Troubleshooting coding problems quickly and efficiently will offer you a chance to grow your skills in a high-pace, high-impact environment.
Position Requirements:
Minimum qualifications:
- Minimum 8+ years of solid object-oriented programming experience in Java, Python or other JVM languages
- 5+ years of functional programming using Scala, must have experience in writing effective unit tests using Scala test / Junit.
- 5+ years of experience in big data technologies like Hadoop, Hive, Spark, Spark MLlib, Presto.
- 4+ years of Structured Streaming using Spark.
- 4+ years of experience in workflow management tools like Oozie/Airflow/ Azkaban/Luigi
- 4+ years of experience in interfacing with messaging bus like Apache Kafka/ Rabbit MQ
- 4+ years of experience in systems design, algorithms, and distributed systems.
- 4+ years of experience in all steps of software engineering process including testing, continuous integration/continuous delivery, automated deployments and monitoring.
Additional Qualifications:
- Exposure to bash scripting, Docker, Ansible & kubernetes.
- Large scale distributed systems experience, including scalability and fault tolerance.
- Exposure to cloud infrastructure, such as Open Stack, Azure, GCP.
- A continuous drive to explore, improve, enhance, automate and optimise systems and tools.
- Strong computer science fundamentals in data structures and algorithms, specialised in massive datasets.
- Nice to have experience in building streaming systems using Apache Flink / Apache Beam.
- Knowledge of functors, Monads, Zio, cats, cats-effect is added advantage.
- Excellent oral and written communication skills.
Walmart Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.
Submit CV To All Data Science Job Consultants Across Bharat For Free