Job Location: United States
Job Detail:
The Data Engineer is responsible for the development, maintenance, test and evaluation big data solutions. Experience with Hadoop based technologies such as MapReduce, Hive MongoDB or Cassandra is required. A big data engineer builds large-scale data processing systems using different open source tools and is an expert in data warehousing solutions and latest database technologies.
- Designs and builds relational and dimensional databases
- Develops strategies for data acquisitions, archive recovery, and database implementation
- Works in a data warehouse environment, which includes data design, database architecture, metadata and repository creation.
- To be proficient in designing efficient and robust ETL workflows
- Develops data warehousing blueprints, evaluating hardware and software platforms, and integrating systems.
- Evaluates reusability of current data for additional analyses.
- Reviews object and data models and the metadata repository to structure the data for better management and quicker access.
- Preferred:
- Has cloud migration experience
- Has experience with cloud databases, data lakes.
Requirements:
Experience: A minimum of 5 years of experience in data engineering. Experience in the following technologies: Hadoop and Spark, AWS (Aurora, Athena, EMR, Redshift, S3), Python scripting, Bitbucket and Git, Linux, and/or Jenkins and CI/CD, SQL, MySQL, PostgreSQL; data architecture; and data security and governance
Education: Bachelor’s degree in Computer Science or closely related subject.
Clearance: Minimum Active Secret Clearance and Security+ / CompTIA+ Certification. If someone is missing the Certification, as long as the candidate is willing to obtain one prior to on-boarding, may be considered based on how best the candidate is.
Preferred Certifications: Amazon Web Services (AWS) Certified Big Data – Specialty, Cloudera Certified Professional (CCP): Data Engineer or similar certification.
CORE SKILLS AS BELOW
- IBM Cloud Pak – We may not get anybody with this.
- SQL Server – ETL – this is generic
- Data Stage – (ETL) – THIS IS VERY VALUABLE
- Data Migration – On-Prem to Cloud – lift or Shift – VALUABLE
- AWS/Azure
- Dataware house – Star Schema
- Database metadata
- Teradata (BTEQ) experience is plus
High Level view of the requirement:
Oracle/SQL Server/MangoDB, Momentum/Netcracker, SAP HANA, SAP HANA Smart Data
Integration (SDI), SAP HANA Smart Data Access (SDA), Business Intelligence Solution,
Data Base Management, EDW (Enterprise Data Warehouse) , Real time data database replication
solution, ETL, Control-M, Data modelling and dimensional modelling, Data Quality, Data Modelling,
Data Integration, Data Visualization, Microsoft SQL Server, Amazon Web Services (AWS) Cloud services,
SAP HANA Modelling, Database Architecture, Performance Improvement, Data Modelling,
Data Analytics,Big Data,Data Virtulization, SPLUNK, Python, Tableau, Power BI, Sprint/Release Management process, SAP Data Hub, and Project Management.
We look forward to your application!
EOE Statement:
Plateau is an equal opportunity/affirmative action employer; all qualified applicants will receive consideration for employment without regard to age, gender, gender identification, sex, sexual orientation, color, race, creed, national origin, religion, marital status, parental status, citizenship status, ancestry, physical or mental disability, genetic information, veteran status, military status, or any other classification protected by federal, state, or local laws.
Plateau is committed to providing access and reasonable accommodations for individuals with disabilities. If you require reasonable accommodation, please email the Plateau HR Department at hrteam@plateauinc.com
Plateau is a proud Equal Opportunity Employer! (M/F/Disability/Vets)
Submit CV To All Data Science Job Consultants Across United States For Free