Actualize Consulting Engineers & Digital IT Services | Azure Data Engineer – Python/Spark | Bengaluru, Karnataka, The Great Bharat | Bharat | BigDataKB.com | 2023-03-05

Before u proceed below to check the jobs/CVs, please select your favorite job categories, whose top job alerts you want in your email & Subscribe to our Email Job Alert Service For FREE

 

Job Location: Bengaluru, Karnataka, The Great Bharat

Job Detail:

The Role

  • As Azure data engineer, you will build, configure, deploy and support a production-grade, scalable and secure data platform.

BigDataKB.com Jyotish
BigDataKB.com Jyotish - Career & Life Prediction

On top of this platform, you will build and support long-term, production-grade data pipelines that ingest, store, transform, process, and expose data from producer to consumer, based on business requirements. Data pipelines are developed using a code-first approach in line with the platform standards and practices.

  • You translate functional requirements into a technical design.
  • You provide and maintain technical documentation.
  • You train and handover common data engineering related maintenance and monitoring activities to the Data Operations & Quality Team.
  • You provide 2nd and 3rd level support in a DevOps operational mode or when required (occasionally outside of office hours).
  • You share technology and platform expertise with colleague data engineers, product owners and other people in the organization.

Important Areas Of Expertise Are

  • Storage: Best of breed (Cloud) storage solutions, both for unstructured and structured data.
  • Ingestion: Streaming and batch ingestion from source systems both in the cloud and on-premise, private and public.
  • Transformation: Code-first approach using Spark (Databricks).
  • Analytic engines: Deploy, configure and operationalize analytics engines and its clustered infrastructure.
  • Exposure/Integration: Expose data based on consumption use-cases like data science, self-service analytics, business intelligence and operational API’s for process integration.
  • Data Platform: Health, logging, monitoring, debugging, automation. Experience
  • A bachelor’s or master’s degree in computer science, engineering or equal through experience.
  • The ideal candidate has strong and demonstrable hands-on experience with data engineering on cloud-based data platforms using Databricks (Spark), preferably based on MS Azure technology: Azure Storage, Azure SQL database, Azure data factory, Azure Databricks.
  • Good coding skills (Python, SQL or Scala).
  • Experience with following concepts or technologies is considered a plus:
  • Data Lake Storage, SQL, Hive, Presto, .
  • Databricks, Spark, Delta Lake, Hadoop, HDInsights, Cloudera, Hortonworks, MapR, .
  • Azure Functions, Azure Synapse, Azure Analysis Services, Power BI

(ref:hirist.com)

Apply Here

Submit CV To All Data Science Job Consultants Across Bharat For Free

LEAVE A REPLY

Please enter your comment!
Please enter your name here