Before u proceed below to check the jobs/CVs, please select your favorite job categories, whose top job alerts you want in your email & Subscribe to our Email Job Alert Service For FREE
Job Location: San Francisco, CA
Duration: 3+ Months
Job Description:
Responsibilities:
- Design and implement dynamic, metadata-driven data pipelines that ingest a variety of data from multiple data providers
- Create and manage unit and integration test catalog in a test-driven development environment
- Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions
- Excellent analytic skills associated with working on unstructured datasets
- Ability to build processes that support data transformation, workload management, data structures, dependency, and metadata
- Interact with CI/CD pipelines and related tools
Requirement:
- 10+ Years of Data Engineering professional with a Strong proven track record of implementation in a variety of data platforms.
- Extensive experience working on the spark in performing ETL using Spark-SQL, Spark Core, and Real-time data processing using Spark Streaming from Kafka.
- Analysis, Design, and Development with technologies like Spark, Hive, Kafka, and HDFS including programming languages such as Python, Scala, and Java
- Sound RDBMS and NoSQL concepts
- Experience with building automation tools and experience in CI/CD pipelines with tools such as Jenkins, UDeploy and Artifactory
The Capgemini Freelancer Gateway is enabled by a cutting-edge software platform that leads the contingent labor world for technology innovation. The software platform leverages Machine Learning and Artificial Intelligence to make sure the right people end up in the right job.
A global leader in consulting, technology services, and digital transformation, Capgemini is at the forefront of innovation to address the entire breadth of clients’ opportunities in the evolving world of cloud, digital, and platforms. Building on its strong 50-year heritage and deep industry-specific expertise, Capgemini enables organizations to realize their business ambitions through an array of services from strategy to operations. Capgemini is driven by the conviction that the business value of technology comes from and through people. It is a multicultural company with over 200,000 team members in more than 40 countries. The Group reported 2018 global revenues of EUR 13.2 billion.
Submit CV To All Data Science Job Consultants Across United States For Free