Exponentia DataLabs | Hiring | Big Data Engineer | BigDataKB.com | 2022-09-06

Job Location: Mumbai (All Areas)

Responsibilities:

  • As a Big Data Engineer, you will apply modern engineering to design, develop, integrate, evaluate the Data Lake.
  • Responsible for Ingesting data from files, streams and databases into the DataLake
  • Building the big data solutions using distributed computing frameworks
  • Cleanse & Process the data with Hive, Hadoop, Spark, EMR
  • Develop programs in Scala, Java and Python as part of data cleaning and processing
  • Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems using Core Java technology stack
  • Develop efficient software code for multiple use cases leveraging Core Java and Big Data technologies for various use cases built on the platform
  • Provide high operational excellence guaranteeing high availability and platform stability
  • Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Hadoop, Cloud computing etc.

Requirements

Required Technical and Professional Expertise:

  • Minimum 3+ years of demonstrated ability in creating data pipelines covering ETL, data lake creation and exposing data for consumers
  • Minimum 3+ years of experience in Distributed Computing
  • Minimum 3+ years of experience in Big Data technologies Spark, EMR
  • Minimum 3+ years of experience in Scala, Java and multi-threading programming
  • Minimum 3+ Years of Hands-on experience with Database such as Postgres, Oracle, MySQL, Elastic Search
  • Minimum 2+ years of experience in distributed messaging system Kafka, RabbitMQ
  • Minimum 2+ Years of Hands-on experience with Cloud services from Storage, Compute
  • Design, develop, Build and Manage Data pipelines to create data lineage process (Real-time & Batch data)
  • Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
  • Critical thinker & problem solver
  • Strong Data Warehousing skills
  • Expertise in Data Structures & Algorithm
  • Proficient in development using SQL, Hive, Scala
  • Strong debugging skills
  • Release & Deployment management to automate code promotion from development to production
  • Ability to demonstrate micro / macro designing and familiar with Unix Shell Scripting

Preferred Technical and Professional Expertise

  • Expertise in EMR using Scala or Python programming
  • Expertise in ETL frameworks NiFi, AWS Glue or other
  • Exposure in Machine learning, Artifical Intelligence
  • Exposure to functional programming
  • Use of agile methodologies to encourage creative design thinking and find innovative ways to develop with cutting edge technologies
  • Ambitious individual who can work under their own direction towards agreed targets/goals and with creative approach to work
  • Intuitive individual with an ability to manage change and proven time management
  • Proven interpersonal skills while contributing to team effort by accomplishing related results as needed

Apply Here

Submit CV To All Data Science Job Consultants Across Bharat For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *