Job Location: Chennai, Bengaluru (WFH during Covid)
Job Description for Big Data Engineer
We are looking for Big Data Engineer with minimum of 10 to 14 years of experience, to be part of Database Centre of Excellence Team. Looking for professionals who are interested in Big Data technologies like Hadoop, Spark, Hive, Kafka, Zookeeper, Map Reduce, Flume, Oozie, Yarn, HDFS, Ambari, NoSQL and other emerging technologies. The hire will work closely with application team on a complete software development cycle from design to development.
Technical Skills & Expertise
- Design and implement scalable data architectures leveraging big data tools and technologies such as Hadoop, Spark, Hive, Kafka, Zookeeper, Map Reduce, Flume, Oozie, Yarn, HDFS, Ambari, NoSQL and other emerging technologies including on-premise and hybrid cloud-based deployment patterns.
- Experience in process orchestration tools Apache Airflow, Apache NiFi etc.
- End-to-end design and build process of Near-Real Time and Batch Data Pipelines
- Create information solutions covering Data security, data privacy, metadata management, multi-tenancy and mixed workload management tools, technologies, frameworks, platforms and deployment models.
- Experience in designing, developing, deploying, testing in AWS architecture
- Hands on knowledge of design, development and improvement of Data Lakes and experience in any of the data platforms like HDP, CDP etc.,
- Experience with container management software (Docker/Kubernetes/Open Shift). Good knowledge of Configuring and working on Multi node clusters.
- Strong Data Analytics skills to bring technical expertise to ensure the quality and accuracy of data, model, process and visualize
- Proficient programming language skills in Python, Scala and Shell Scripting etc.,
- Experience in Linux OS
Interpersonal & Digital Fluency
- Passion for technology, challenges and quality with a dynamic, forward leaning and proactive personality.
- Excellent interpersonal skills to drive meaningful value to collaboration with a strong belief in team and delivering together.
- Strong commitment to ownership, responsibilities and cause of business and team by aligning with leadership and management.
Responsibilities
- Deliver strong, scalable architecture, code in line with the product vision, timelines and quality standard.
- Deliver key research (MVP, POC) with an efficient turn-around time to help make strong product decisions.
- Demonstrate key understanding and expertise on modern technologies, architecture and design.
- Benchmark systems, analyze system bottlenecks and propose solutions to eliminate them
- Demonstrate excellent interpersonal skills to drive discussions to decisions.
Submit CV To All Data Science Job Consultants Across India For Free
๐ Explore All Related ITSM Jobs Below! ๐
โ
Select your preferred “Job Category” in the Job Category Filter ๐ฏ
๐ Hit “Search” to find matching jobs ๐ฅ
โ Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐๐ผ

Leave a Reply