Job Location: San Diego, CA
RESPONSIBILITIES:
Kforce has a client that is seeking a Remote Data (ETL/NoSQL) Engineer. The candidate must live in: AZ, CA, CO, CT, DE, DC, FL, ID, IL, LA, MD, MI, MN, NC, NJ, OH, OK, OR, PA, SC, TN, TX, UT, WA, and/or WV.
Summary:
They are looking for a Data (ETL/NoSQL) Engineer with data pipeline, ETL, API and AWS cloud platform experience to contribute toward the success of our technology initiatives. Core areas include the warehousing, transformation, cleansing, and integration of large volumes of data. This position will need to be able to write scripts and commands for data manipulation, data automation and assist with the development of policies and procedures related to the support of new and ongoing data and information systems.
Principal Duties and Responsibilities:
- Designs and implements data pipelines, extract-transform-load (ETL) processes, and data cleansing practices to ensure quality data transfer and sharing between Tips and MISDB database
- Authoritative in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies
- Building data pipelines and applications to stream and process datasets at low latencies
- Implement database and model designs and segmentation techniques
- Demonstrate efficiency in handling data – tracking data lineage, ensuring data quality, and improving discoverability of data
- Participate in end-to-end delivery of technical projects involving design and development of data pipelines involving complex datasets
- Develop distributed data systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures
- Develop API solutions
- Work on ways to automate and improve current business processes
- Coordinate closely with business on current and future data needs
REQUIREMENTS:
- Bachelor’s degree or equivalent in related field
- 4+ years of relevant experience in large distributed/cloud systems, including architecture/design experience
- 4+ years of experience developing and maintaining data pipelines, ETL, and aggregate large volumes of data from disparate sources
- Deep understanding of SQL database design (MS SQL, SSIS, AWS Glue)
- Expert level skills writing and optimizing complex SQL, Stored Procedure
- Knowledge of data warehousing concepts
- Experience in data mining, profiling, and analysis
- Experience with complex data modelling, ETL design, and using large databases in a business environment
- Experience with Big Data technologies such as Hive/Spark
- Familiarity with the AWS ecosystem specifically RDS, Storage (S3), API Gateways
- Experience and understanding of common API formats including service-endpoints
- Strong programming experience with frameworks including XML, ETL and languages including JavaScript and Python
- Proven ability to develop unconventional solutions; Sees opportunities to innovate and leads the way
- Excellent verbal and written communication; Proven interpersonal skills and ability to convey key insights from complex analyses in summarized business terms; Ability to effectively communicate with technical teams
- Ability to work with shifting deadlines in a fast-paced environment
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
Submit CV To All Data Science Job Consultants Across United States For Free