Recruiting From Scratch | Platform Data Engineer | Saratoga, CA | United States | BigDataKB.com | 2023-01-15

Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we work with teams across the United States to help them hire. We work with companies funded by the best investors including Sequoia Capital, Lightspeed Ventures, Tiger Global Management, A16Z, Accel, DFJ, and more.

Data Engineer – Platform

A Career with our Market Intelligence Team:

Our Market Intelligence team is responsible for developing proprietary research products and providing data and research management services for investment teams to support their pursuit of superior, risk-adjusted returns. We leverage innovative alternative data sources, advanced data analytics and technologies, and deep fundamental research to create high-quality compliant and differentiated research. Backed by the full resources of our company, our sector aligned teams of fundamental researchers, data scientists, data strategists, relationship managers, and data engineers collaborate to solve important research problems in partnership with the Firm’s investment and compliance professionals.

What you’ll do

Platform Engineers build solutions for processing big and unstructured data sets. Our team works closely with portfolio managers and data scientists to understand the potential business value of data sets and ultimately build data processing pipelines around those data sources. In this role, you will:

• Develop big data processing pipelines for new data sources containing structured and unstructured data
• Build platform infrastructure using Hadoop technologies
• Build and support visualization and exploration capabilities around our big data sets
• Maintain knowledge of new technology developments and conduct proof of concepts to evaluate new technologies

What’s required

We want you to join us if you have extensive experience or demonstrated interest in big data technologies. Other requirements include:

• 2+ years of experience in Data Engineering or related field
• Commitment to the highest ethical standards
• Strong experience in Python Development
• Experience with Spark or Scala
• Ability to devise novel and innovative solutions to challenges
• Knowledge of/experience with graph databases is a plus

We take care of our people

We invest in our people, their careers, their health, and their well-being. We want you to concentrate on success and leave the rest to us. When you work here, we provide:

• Fully-paid health care benefits
• Generous parental and family leave policies
• Mental and physical wellness programs
• Tuition assistance
• A 401(k) savings program with an employer match and more

Salary Range: $140,000-$250,000 base.