CyberQ Consulting | Hiring | Data Engineer (Hadoop and Kafka) | BigDataKB.com | 2022-09-06

0

Job Location: Hyderabad, Telangana, India

People join us because they want to be a part of an organization where cutting edge technology is played around with. They join us because we hire with attitude and potential. We believe in the innate capability of inspired individuals in managing their own work and ambitions, enabling the leadership to focus on the Companys vision.

What You Will Be Doing

  • Designing and implementing data processing pipelines, as part of diverse, high energy teams
  • Working with our data scientists to take our MLAI models to production
  • Hands-on programming in Python, Java, Scala
  • Deploying data pipelines in production based on Continuous Delivery practices
  • Recommending the right distributed storage and computing technologies to our clients from a large number of options available in the ecosystem
  • Ensuring that the data is available to the consumers in a reliable, trustworthy and predictable manner
  • Evolving the data platform to make it more robust, scalable

What We Are Looking For

  • 6-8 years of experience working as a data engineer
  • Proficient understanding of distributed computing principles
  • Proficiency HDFS, Spark, Kafka
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases Redis, MongoDB, ElasticSearch,
  • Knowledge of various ETL techniques and frameworks
  • Knowledge of how to create and maintain optimal data pipeline architecture,
  • Good understanding of Lambda Architecture, along with its advantages and drawbacks

Great To Have

  • Ability to solve any ongoing issues with operating the cluster
  • Experience with building stream-processing systems, using solutions such as Flink or Spark-Streaming
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
  • Experience with Cloudera/MapR/Hortonworks

Apply Here

Submit CV To All Data Science Job Consultants Across Bharat For Free

🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

LEAVE A REPLY

Please enter your comment!
Please enter your name here