Before u proceed below to check the jobs/CVs, please select your favorite job categories, whose top job alerts you want in your email & Subscribe to our Email Job Alert Service For FREE
Job Location: Remote
Job Detail:
Overview
IDC is looking for a passionate, hard-working, and talented individual who will join our Tech Buyer Digital team. The team collaborates with IDC’s data organization who is building a leading intelligence platform for IT Vendors that provides a holistic 360-degree view of the IT industry.
As a Data Engineer you will build some of the most advanced data products in the cloud. You will define and help launch innovative analytical products through data operations. The ideal candidate will have industry-leading data design skills, a desire to work within a standard product development lifecycle, an established background working across multiple development teams, as well as working with large data sets and data pipelines.
Why IDC?
IDC is the most respected global technology market research firm. We are changing the way the world thinks about the impact of technology on business and society. Our people, data, and analytics create global technology insights that accelerate customer success. IDC was recognized by the Institute of Industry Analyst Relations (IIAR) as the 2022 Analyst Firm of the Year for the third consecutive year, for delivering critical, timely insights in coordinated efforts around the world, during a time when our customers faced unprecedented challenges.
Our collaborative, innovative and entrepreneurial culture is the perfect place for you to discover your future! We are just getting started!
Responsibilities
- Design the architecture for ingesting, cleaning, transforming, and loading data from source to destination
- Design the workflow for entity profile collection process and entity data flow between products
- Prototype end-to-end data operation pipeline; test and QA the pipeline; productionize the pipeline
- Integrate and reconcile independent data sources and APIs into a single source
- Create automated matching tools to identify entity duplication and entity attribute alignment
- Develop data models leveraging statistical and mathematical methods
- Monitor data quality and maintain pipeline in development, QA and production environments
- Draw insights from data and clearly communicate them (verbal/written) to the stakeholders and senior management as required
- Communicate with technical teams and management to collect requirements, describe data modeling decisions and data engineering strategy
- Provide support and oversight for team members
Qualifications
- BA/BS in Computer Science, Engineering, Mathematics or related field
- 3-5 years of relevant work experience in a role requiring application of analytic skills to integrate data into operational planning/business planning or advanced degree
- Proficiency in writing Python scripts; Experience in writing and tuning SQL scripts
- Experience in Snowflake, PostgreSQL, Apache Airflow, REST API, and Java
- Be self-driven, and show ability to ETL/ELT on ambiguous projects in spite of incomplete or inaccurate data
- Experience working in very large data warehouse environments; understand the best practices for querying and analyzing dataset to support business decision making
- This role will be based in our Needham MA headquarters with a hybrid work environment. Strong qualified candidates will be considered for US remote approved work locations; preferably east coast
About IDC: International Data Corporation (IDC) is the premier global provider of market intelligence, advisory services, and events for the information technology, telecommunications and consumer technology markets. IDC helps IT professionals, business executives, and the investment community make fact-based decisions on technology purchases and business strategy. More than 1,300 IDC analysts provide global, regional, and local expertise on technology and industry opportunities and trends in over 110 countries worldwide. For 50 years, IDC has provided strategic insights to help our clients achieve their key business objectives. IDC is a subsidiary of IDG, the world’s leading technology media, research, and events company.
IDC is an Equal Opportunity Employer. Applicants and employees are considered for positions and are evaluated without regard to mental or physical disability, handicap, race, color, religion, gender, gender identity and expression, ancestry, national origin, age, genetic information, military or veteran status, sexual orientation, marital status or other categories protected by law.
Submit CV To All Data Science Job Consultants Across United States For Free
