Remote Data Engineer at Scrapinghub 📈 Open Startup
RSS
API
Post a Job

get a remote job
you can do anywhere

The largest collection of Remote Jobs for Digital Nomads online. Get a remote job you can do anywhere at Remote Companies like Buffer, Zapier and Automattic who embrace the future. There are 32,500+ jobs that allow you to work anywhere and live everywhere.

The largest collection of Remote Jobs for Digital Nomads online. Get a remote job you can do anywhere at Remote Companies like Buffer, Zapier and Automattic who embrace the future. There are 32,500+ jobs that allow you to work anywhere and live everywhere.

  Jobs

  People

👉 Hiring for a remote Engineer position?

Post a Job - $299
on the 🏆 #1 remote jobs board

Scrapinghub


Data Engineer

Data Engineer


Scrapinghub


engineer

engineer

1yr
About the job:\nScrapinghub is looking for a Data Engineer to work closely with our Data Scientist team and provide assistance with dataset collection, cleaning and post-processing. You’ll also help with writing tools for working with data as required for Data Science projects. You will work with one of the most advanced and comprehensive web crawling and scraping infrastructures in the world, leveraging massive data sets with cutting edge technology.\n\n\n\n\nJob Responsibilities:\n\n\n\n\n* Create data tools for Data Science team members that assist them in building and optimizing our product.\n\n* Assemble large datasets that meet requirements set by the Data Science team, including creating web crawlers.\n\n* Be proactive in bringing forth new ideas and solutions to problems\n\n* Be a strong team player and share knowledge freely and easily with your co-workers\n\n* Write software for post-processing and cleaning of the data, taking part in data analysis if required\n\n* Automate manual processes, optimize data delivery, improve architecture for greater scalability\n\n* Work on integration of Data Science components into our larger systems\n\n* Handle mid-size and large datasets (200GB+)\n\n\n\n\n\n\n\n\n\n\nJob Requirements:\n\n\n\n\n* Due to business requirements, the successful candidate must be based in Ireland. \n\n* Candidates based in the EU but willing to relocate to Ireland will also be considered. \n\n* Python experience (3+ years)\n\n* 5+ years of software development experience\n\n* Good command of Linux\n\n* Front-end development experience required for creating and supporting internal tools\n\n* Back-end development experience required for creating and supporting internal tools: Python web frameworks (like twisted, aiohttp, django, flask), databases.\n\n* Understanding of the web technologies: JavaScript, HTML, CSS, HTTP\n\n* Strong analytics skills related to working with unstructured datasets\n\n* Excellent written English\n\n\n\n\n\n\n\n\n\n\nBonus points for:\n\n\n\n\n* Strong web crawling and web scraping skills: Scrapy knowledge, browser automation experience. Splash experience is a plus.\n\n* Experience handling mid-size and large datasets, organizing their parallel processing\n\n* Good spoken English\n\n* Strong record of open source activity\n\n\n\n\n

See more jobs at Scrapinghub

# How do you apply? This job post is older than 30 days and the position is probably filled. Try applying to jobs posted recently instead.
Apply for this Job

👉 Please reference you found the job on Remote OK, this helps us get more companies to post here!

When applying for jobs, you should NEVER have to pay to apply. That is a scam! Posts that link to pages with "how to work online" are also scams. Don't use them or pay for them. Also always verify you're actually talking to the company in the job post and not an imposter. Scams in remote work are rampant, be careful! When clicking on the button to apply above, you will leave Remote OK and go to the job application page for that company outside this site. Remote OK accepts no liability or responsibility as a consequence of any reliance upon information on there (external sites) or here.