Job Location: Mumbai (All Areas)
Responsibilities:
- As a Big Data Engineer, you will apply modern engineering to design, develop, integrate, evaluate the Data Lake.
- Responsible for Ingesting data from files, streams and databases into the DataLake
- Building the big data solutions using distributed computing frameworks
- Cleanse & Process the data with Hive, Hadoop, Spark, EMR
- Develop programs in Scala, Java and Python as part of data cleaning and processing
- Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems using Core Java technology stack
- Develop efficient software code for multiple use cases leveraging Core Java and Big Data technologies for various use cases built on the platform
- Provide high operational excellence guaranteeing high availability and platform stability
- Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Hadoop, Cloud computing etc.
Requirements
Required Technical and Professional Expertise:
- Minimum 3+ years of demonstrated ability in creating data pipelines covering ETL, data lake creation and exposing data for consumers
- Minimum 3+ years of experience in Distributed Computing
- Minimum 3+ years of experience in Big Data technologies Spark, EMR
- Minimum 3+ years of experience in Scala, Java and multi-threading programming
- Minimum 3+ Years of Hands-on experience with Database such as Postgres, Oracle, MySQL, Elastic Search
- Minimum 2+ years of experience in distributed messaging system Kafka, RabbitMQ
- Minimum 2+ Years of Hands-on experience with Cloud services from Storage, Compute
- Design, develop, Build and Manage Data pipelines to create data lineage process (Real-time & Batch data)
- Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
- Critical thinker & problem solver
- Strong Data Warehousing skills
- Expertise in Data Structures & Algorithm
- Proficient in development using SQL, Hive, Scala
- Strong debugging skills
- Release & Deployment management to automate code promotion from development to production
- Ability to demonstrate micro / macro designing and familiar with Unix Shell Scripting
Preferred Technical and Professional Expertise
- Expertise in EMR using Scala or Python programming
- Expertise in ETL frameworks NiFi, AWS Glue or other
- Exposure in Machine learning, Artifical Intelligence
- Exposure to functional programming
- Use of agile methodologies to encourage creative design thinking and find innovative ways to develop with cutting edge technologies
- Ambitious individual who can work under their own direction towards agreed targets/goals and with creative approach to work
- Intuitive individual with an ability to manage change and proven time management
- Proven interpersonal skills while contributing to team effort by accomplishing related results as needed
Submit CV To All Data Science Job Consultants Across Bharat For Free
๐ Explore All Related ITSM Jobs Below! ๐
โ
Select your preferred “Job Category” in the Job Category Filter ๐ฏ
๐ Hit “Search” to find matching jobs ๐ฅ
โ Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐๐ผ

Leave a Reply