Job Location: Mumbai (All Areas) (WFH during Covid)
Job Title: Lead Data Engineer
Job Location: Mumbai, India
The opportunity has arisen for a Lead Data Engineer to join this global organization which respects diverse perspectives, experiences, and traditions as essential, and values each employee’s contribution toward achieving our business objectives.
General Description of Responsibilities
As a lead data Engineer, you will be responsible for leading the technical design and implementation of multiple opportunities on the platform. You will be managing a team of application support engineers to address business as usual queries, acting as an escalation point for the users ensuring overall operational excellence. The candidate will work closely with cross-functional teams of Project Management, Business, Enterprise architecture, Development teams to implement IT solutions.
Specific Responsibilities As Lead Data Engineer
- As a BD Engineer you will drive the overarching Engineering strategy for the platform (tools, coding standards, guidelines, quality controls etc.) and set the direction to vendor to maintain the integrity of the Intertek’s BD platform.
- You will be required to work alongside the vendor team, Big Data Architects, data Engineers, Business Analysts and Data Scientists to evaluate and implement new big data frameworks and tools as well as recommend ways to improve existing big data implementation.
- Define and document the pipeline designs for end-to-end data preparation (Ingestion, Curation and consumption)
- Assemble large, complex data sets that meets functional / non-functional business requirements
- Work with data analytics experts to strive for greater functionality in our data systems
- Take ownership of the successful technical implementation of the use cases working closely with Vendor.
As an Application Support Lead
- Manage the support team to ensure that all support or service requests are dealt with according to the agreed procedures and SLAs
- Provide expert advice to the team in solving the critical issues and oversee the solution.
- Review periodic reports on the issues raised and resolved and identify trends of issues raised
Requirements
- Bachelors degree in Information Technology or equivalent work experience required
- 10+ years of overall IT experience
- At least 5 years experience working on Big Data ecosystems like Cloudera/ Hortonworks.
- 2+ years of managing the team of engineers (development/support).
- Hadoop ecosystems and associated architecture such as HDFS, Spark, Hive, Kafka, Oozie, Airflow, MapReduce etc. with the emphasis on consumption i.e. datastores, ingestion tools, streaming technologies etc.
- Experience using Ingestion tools like Attunity, NiFi or Hortonworks Data Flow(HDF)
- Hands on Experience on programming languages like Scala, Java, Python, R
- Expertise using HIVE and SQL (HiveQL, Pig), ideally with optimization performance experience in partitioning, bucketing, indexing etc.
- Knowledge of relational database technologies (e.g. Oracle, SQL Server, Sybase) and NoSQL like HBase and associated analytical techniques and tools
- Exposure to visualization tools like PowerBI, Tableau etc.
- Exposure to Continuous Integration/Continuous Delivery methodologies and technologies (Jenkins, Git etc.)
- Experience of Big Data Modelling and management systems for data Curation and Consumption is advantageous
- Exposure to AI/ML algorithms is advantageous.
Competencies
- Excellent interpersonal and organizational skills, ability to handle diverse situations, multiple projects and rapidly changing priorities.
- Excellent oral and written communications skills.
- Experienced in problem solving, and able to follow a methodical implementation process.
- Must be customer focused and a team player.
- Desire and ability to work in a dynamic and fast-paced environment.
- Ability to approach problems with a sense of ownership, enthusiasm and innovation.
- Ability to interface with people at all levels of the company
- Strong client service attitude and leadership capabilities
- Provide support after normal work hours when necessary
Submit CV To All Data Science Job Consultants Across India For Free

Leave a Reply