CGT Staffing | Hiring | Sr. Data Engineer | United States | BigDataKB.com | 2022-09-29

0
23

Job Location: United States

  • 1. MUST have 3+ years of NoSQL experience MongoDB (at least 1+ years)
  • 2. MUST have 3+ years of Java experience (NOT JavaScript)
  • 3. 3+ years of Couchbase experience
  • 4. 3+ years of development experience in programming languages such as Java, Spring Boot, Vert.x, Python, PySpark, etc
  • 5. Experience with running and scaling applications on the cloud infrastructure and containerized services such as OpenShift or Kubernetes
  • 6. 2+ years of experience with distributed data computing tools such as Kafka, EMR, Spark, PostgreSQL
  • 7. 2+ years of experience with monitoring tools Splunk or Dynatrace

Full List of Expectations:

Key Responsibilities:

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of data architects and developers to implement distributed microservices using CI/CD pipelines
  • Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products
  • Build and own the automation and monitoring frameworks that capture metrics and operational KPIs for data pipeline quality and performance
  • Responsible for implementing best practices around systems integration, security, performance, and data management
  • Work with data architects to build the foundational ETL process and regularly review the architecture and recommend improvements
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, coded, and effectively tuned for performance

Basic Qualifications:

  • Bachelor’s degree in Computer Science (or related technical field) or 8-10 yrs of overall experience in building ETL/ELT, data warehousing, and big data solutions
  • At least 7-8 years of overall experience in building ETL/ELT, data warehousing, and big data solutions

Technical Requirements:

  • 10+ years of overall technology experience that includes at least 3+ years of hands-on software development, data engineering, and systems architecture
  • 5+ years of database experience with Oracle, DB2, and/or PostgreSQL
  • 3+ years of NoSQL experience MongoDB, Couchbase, AWS DynamoDB, GCP Bigtable
  • 3+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools
  • 3+ years of development experience in programming languages such as Java Spring Boot, Vert.x, Python, PySpark, etc
  • 2+ years of experience in cloud data engineering experience in GCP or AWS, certification plus
  • 2+ years of experience with distributed data computing tools such as Kafka, EMR, Spark, PostgreSQL
  • 2+ years of experience with monitoring tools Splunk or Dynatrace
  • Experience with running and scaling applications on the cloud infrastructure and containerized services such as OpenShift or Kubernetes
  • Experience with integration of cloud services with on-premises technologies
  • Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
  • Experience with version control systems like Github and deployment & CI tools
  • Understanding metadata management, data lineage, and data glossaries is a plus
  • Experience with Agile methodology of project delivery and tool such as Confluence or Jira, including DevOps and DataOps concepts
  • Familiarity with business intelligence tools (Tableau or Power BI)

Soft Skills and Abilities:

  • Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior-level management
  • Proven track record of leading, and mentoring data teams
  • Ability to understand and translate business requirements into data and technical requirements
  • A high degree of organization and ability to manage multiple, competing projects and priorities simultaneously
  • Positive and flexible attitude to enable adjusting to different needs in an ever-changing environment
  • Strong leadership, organizational and interpersonal skills; comfortable managing trade-offs
  • Foster a team culture of accountability, communication, and self-management
  • Proactively drive impact and engagement while bringing others along
  • Consistently attain/exceed individual and team goals

Apply Here

Submit CV To All Data Science Job Consultants Across United States For Free

🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

LEAVE A REPLY

Please enter your comment!
Please enter your name here