Before u proceed below to check the jobs/CVs, please select your favorite job categories, whose top job alerts you want in your email & Subscribe to our Email Job Alert Service For FREE
Job Location: Gurgaon/Gurugram
At Fareportal, we create technology that is driving innovation in the travel industry. Our employees are the core of our organization and together were revolutionizing the way people book travel.
We are looking for a Data Engineer to join our team. You will be handling hundreds of millions of events per day, responsible for creating and supporting data infrastructures that will drive our business.
Data Engineers are at the heart of how Fareportal works and they are part software engineer and part database expert. You will focus on creating and supporting large scale pipelines that we deploy to power our analytics, recommendation, pricing or other systems. The ideal candidate will participate in the design and implementation of the entire data pipeline, from project ideation, figuring out which data to capture and store, coming up with architectures, to creating the final data flows and monitoring.
We are passionate about making data-driven decisions and you will have the opportunity to shape the teams direction and create large impact.
Our team loves Python and Scala (and is not afraid of Functional Programming) and we strongly encourage DevOps approaches.
Responsibilities:
- Support our data modeling efforts to ensure we are capturing the data needed to improve our modeling and analytic capabilities
- Develop and maintain data applications in Python and / or Scala across various data formats and architectures, including:
- SQL, Clickhouse, MongoDB, AWS S3, Azure App Insights, csv, JSON, parquet, Protobuf
- Airflow, Docker, Bash, SFTP, AWS Lambda, ECS
- Evaluate and ensure data integrity across various formats through mature, high quality, well organized application code with fully developed unit and integration testing and telemetry
Our ideal candidate:
Who You Are
- You are smart and love to build systems that are well tested as well as flexible
- You like being around smart people who will challenge you on a daily basis.
- You love to ramp up on new technologies to build awesome things with us!
- Passionate about working with large unstructured and structured data sets and developing new approaches to relevance problems
- You like to share your knowledge and guide other fellow data engineers and scientists
Requirements
- 4+ years’ experience developing, maintaining, and testing big data pipelines.
- A strong technical advocate with a background in Python or Scala + SQL. Preferably familiar with both on-prem and cloud data systems, for example, AWS or Azure; SQL and NoSQL
- Experience with shell scripting and Unix command line, as well as virtual environments.
- Strong understanding of data modeling and ETL / ELT best practices
Nice to have:
- Experience with CI/CD infrastructure and a strong supporter of unit / integration testing
- Experience with Docker, VMs and container technologies (ie Kubernetes)
Submit CV To All Data Science Job Consultants Across India For Free