Pyramid | Jr. Data Engineer | Alpharetta, GA | United States | BigDataKB.com | 22-01-23

0

Job Location: Alpharetta, GA

Job Detail:

Title: Data Engineer
Location: GA; Alpharetta (Hybrid)
Duration: 12+ Months

Job Description:
Hybrid 3 days a week onsite

Databricks Operations is part of the Hadoop Support team. This team is responsible for managing the Databricks plant across ***. Working within an Agile delivery (Scrum/Kanban/Scrumban)/ DevOps methodology. Support the application development teams and help them in debugging and fixing an issue.

Responsibilities and activities of these team include, but not limited to
– Build, Upgrade and maintain Hadoop clusters with several nodes.
– Monitoring and troubleshooting of services running on Hadoop clusters.
– Performance tuning.
– Setup of backup and recovery.
– Troubleshooting User issues which include User on boarding, job failures.
– Installing and integrating of a new services onto the Hadoop cluster.
– Working with Vendor to discuss/apply issue bugs, patches and issues.
– Deploy and automate the implementations/fixes using Ansible scripts.
– Hands-on experience on the administration side of DataBricks preferably on Azure.
– Prior experience in a support role on admin side of Databricks on one of Azure/AWS/GCP cloud
– Excellent knowledge of git and Jenkins. Understanding of distributed systems and databases, cloud computing environments – Azure/Linux(mandatory skills)
– General familiarity with Docker and Kubernetes concepts
– Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
– Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW
– Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment.
– Working within an Agile delivery (Scrum/Kanban/Scrumban)/ DevOps methodology.
– Deploy Azure Databricks workspaces using IaC (terraform + azure devops)

Qualification:
– Experience in Cloudera Hadoop distribution CDH 6.x and CDP 7 is preferred.
– Experience with Cluster maintenance tasks like adding and removing nodes, enabling High availability, installing services, applying patches.
– Hands-on experience on the administration side of DataBricks preferably on Azure.
– Unix Shell, perl or python scripting.
– Some development experience in Databricks on Azure/AWS/GCP is desired
– Some developer skills in Python is desired
– Some experience with Terraform for IaaC

Job Type: Contract

Pay: $45.00 – $50.00 per hour

Benefits:

  • Dental insurance
  • Health insurance
  • Vision insurance

Experience level:

  • 4 years

Schedule:

  • 8 hour shift

Ability to commute/relocate:

  • Alpharetta, GA 30005: Reliably commute or planning to relocate before starting work (Required)

Experience:

  • HDFS: 1 year (Required)
  • Azure Data Lake: 3 years (Required)
  • Jenkins: 1 year (Preferred)

Work Location: One location




Apply Here

Submit CV To All Data Science Job Consultants Across United States For Free

🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

LEAVE A REPLY

Please enter your comment!
Please enter your name here