Orcapod Consulting Services Private Limited | Jobs | Spark Python Developer | BigDataKB.com | 30-03-22

    0

    Job Location: Gurgaon/Gurugram

    Roles and Responsibilities

    Spark Python Developer

    Job Description

    We are looking for a Spark developer who knows how to fully exploit the potential of our Spark cluster.

    You will clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data to our feature developers and business analysts.

    This involves both ad-hoc requests as well as data pipelines that are embedded in our production environment.

    Responsibilities

    • Create Scala/Spark jobs for data transformation and aggregation
    • Produce unit tests for Spark transformations and helper methods
    • Write Scaladoc-style documentation with all code
    • Design data processing pipelines

    Skills

    • Scala (with a focus on the functional programming paradigm)
    • Scalatest, JUnit, Mockito{{ , Embedded Cassandra }}
    • Apache Spark 2.x
    • {{ Apache Spark RDD API }}
    • {{ Apache Spark SQL DataFrame API }}
    • {{ Apache Spark MLlib API }}
    • {{ Apache Spark GraphX API }}

    Apply Here

    Submit CV To All Data Science Job Consultants Across India For Free

    🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

    LEAVE A REPLY

    Please enter your comment!
    Please enter your name here