Insight Global | Hiring | Remote ETL Developer-Web Scraper | Atlanta, GA | BigDataKB.com | 30 Sept 2022

0

Job Location: Atlanta, GA

JOB DESCRIPTION

A client is looking for a Data Engineer focusing on web scarping to sit remotely within the US. Our eCommerce team works with the most cutting-edge technology and builds our own tech-stack from scratch. This is where you’ll see your work come to life, as a member of a small, agile, highly-skilled team that ushers global projects through from conceptualization to implementation. We’ve been laser focused on winning in the marketplace, developing and executing direct-to-consumer experiences like PantryShop.com and Snacks.com in less than 30 days. At PepsiCo, we leverage a combination of technology, insights, resources and inventory to quickly meet consumers’ evolving needs, with $3 billion in retail sales and growing. With a team of more than 250 associates and offices in Manhattan, Chicago, Plano, and Silicon Valley, we’re unleashing the full potential of automation, data science, and machine learning to challenge the way snacks and beverages are sold every day. Our Data Platform team is tasked with the responsibility of developing data extraction processes and maintaining the integrity of our data foundations. We ensure that the company has rapid access to the data they need for decision-making and innovation.
In this role you will have several distinct responsibilities and priorities:

  • Build new technologies and algorithms to optimize business processes
  • Apply expertise and innovation to create and deploy new technologies
  • Act as a consultant to the broader business users, management, vendors, and technicians to determine technology needs and system requirements
  • Develop data set processes and be a resource for requirement discovery and development
  • Use large data sets to resolve major business and functional issues while improving data reliability, efficiency and quality
  • Optimize processes implementing new technology and automation across eCommerce businesses and eCommerce functions


MINIMUM REQUIREMENTS

  • Experience creating ELT/ETL systems
  • Web scraping experience, creating systems that gather data from websites or other unstructured sources and create structured information feeds from them.
  • Demonstratable experience in working around limitations and restrictions that are commonly used by websites to slow down or prevent web scraping
  • Strong SQL or Snowflake experience
  • Heavy automation experience, including but not limited to Selenium, Appium, Puppeteer
  • Experience writing production code for Python based systems, but you’re comfortable working in few other languages and like the right tool for the job


DESIRED SKILLS

  • Experience with platforms and libraries such as Airflow, Numpy, Pandas, Great Expectations, and DBT
  • Experience designing, building and maintaining data processing systems

Apply Here

Submit CV To All Data Science Job Consultants Across United States For Free

🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

LEAVE A REPLY

Please enter your comment!
Please enter your name here