LeadMine | Hiring | Data Engineer (Intern) | BigDataKB.com | 2022-09-26

0

Job Location: Chennai, Tamil Nadu, India

As a Web Scraping focused Data Engineer, you will be responsible for extracting and ingesting data from websites using web crawling tools. In this role you will own the creation process of these tools, services, and workflows to improve crawl/ scrape analysis, reports and data management. We will rely on you to test the data and the scrape to insure accuracy and quality. You will own the process to identify and rectify any issues with breaks as well as scale scrapes as needed.

What’s required

* Experience running large scale web scrapes

* Solid Python knowledge

* Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking

* Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).

* Experience with system monitoring/administration tools

* Experience with version control, open source practices, and code review

* Experience with applications designed to display archived web content

* Great communication skills (written and Spoken in English)

* Bachelor’s Degree in Computer Science or a related field or the equivalent demonstrated experience

Apply Here

Submit CV To All Data Science Job Consultants Across Bharat For Free

🔍 Explore All Related ITSM Jobs Below! 🚀 ✅ Select your preferred "Job Category" in the Job Category Filter 🎯 🔎 Hit "Search" to find matching jobs 🔥 ➕ Click the "+" icon that appears just before the company name to see the Job Detail & Apply Link 📝💼

LEAVE A REPLY

Please enter your comment!
Please enter your name here