Serving Skill | Jobs | Data Engineer – Kafka / Spark | BigDataKB.com | 31-01-22

โ€”

by

Job Location: Bengaluru

The role requires experience in Azure core technologies – IOT Hub Event hub, Stream analytics, IOT Central, Azure Data Lake Storage, Azure Cosmos, Azure Data Factory, Azure SQL Database, Azure HDInsight Databricks, SQL data warehouse.

You Have :

– 3 – 5 years of software development experience

– Minimum 2 year of experience in IOTstreaming data pipelines solution development

– Bachelor’s andor Master’s degree in computer science

– Strong Consulting skills in data management including data governance, data quality, security, data integration, processing and provisioning

– Delivered data management projects with real timenear real time data insights delivery on Azure AWS Cloud

– Translated complex analytical requirements into technical design including data models, ELTs and Dashboards Reports

– Experience deploying dashboards and self-service analytics solutions on both relational and non-relational databases

– Experience with different computing paradigms in databases such as In-Memory Distributed, Massively Parallel Processing

– Successfully delivered large scale IOT data management initiatives covering Plan, Design, Build and Deploy phases leveraging different delivery methodologies including Agile

– Experience on handling telemetry data with Spark streaming, kafka, flink, Scala, pyspark, Spark sql,

– Hands on experience on containers and Dockers

– Exposure to streaming protocols like MQTT and AMQP

– Knowledge of OT network protocols like OPC UA, CAN Bus and similar protocols

– Strong knowledge of continuous integration, static code analysis and test-driven development

– Experience in delivering projects in a highly collaborative delivery model with teams at onsite and offshore

– Must have Excellent analytical and problem-solving skills

– Delivered change management initiatives focused on driving data platforms adoption across the enterprise

– Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external organizations

Roles & Responsibilities :

You Will :

– Translate functional requirements into technical design

– Interact with clients and internal stakeholders to understand the data and platform requirements in detail and determine core AzureAWS services needed to fulfill the technical design

– Design, Develop and Deliver IOT data integration interfaces in ADF and Azure Data Bricks with PySpark based data pipelines

– Design, Develop and Deliver data provisioning interfaces to fulfill consumption needs Data Engineer IOT- JD

– Deliver data models on Azure platform, it could be on Azure Cosmos, Delta lake, SQL DW Synapse or SQL

– Advise clients on ML Engineering and deploying ML Ops at Scale on AKS

– Automate core activities to minimize the delivery lead times and improve the overall quality

– Optimize platform cost by selecting right platform services and architecting the solution in a cost effective manner

– Deploy Azure DevOps and CI CD processes

– Deploy logging and monitoring across the different integration points for critical alerts

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *