👉 Hiring for a remote Software Developer position?on the 🏆 #1 remote jobs board
Scrapinghub is looking for a Senior Erlang software developer to join and lead our Crawlera team.\n\nCrawlera is a smart downloader designed specifically for web crawling and scraping. It allows crawler developers to crawl quickly and reliably by managing thousands of proxies internally. It is part of the Scrapinghub platform, the world’s most comprehensive web crawling stack which powers crawls of over 4 billion pages a month.\n\nJoin us in making the world a better place for web crawler developers with our team of top talented engineers.\n\n\n\nResponsibilities:\n\n\n\n\n* Develop, maintain and support a high load distributed system.\n\n* Leverage the Scrapinghub platform to provide extended functionality, both to end users and for internal purposes.\n\n* Identify and resolve performance and scalability issues with distributed crawling at scale.\n\n* Liaison with other platform teams to provide Crawlera with the best possible integration to the growing Scrapinghub platform.\n\n* Establish and maintain technical and quality standards, in conjunction with our broader Engineering expectations.\n\n* Understand business intent and lead architectural design/decisions to achieve that intent. You won’t be the sole decision maker, and you won’t have all the answers, but you should know how to get the right people to the table for discussions, have a bias towards action (the imperfect system that’s live is often better than the perfect system that is never implemented), and how to use great technical design to help achieve our business goals.\n\n\n\n\n\n\n\n\nRequired skills:\n\n\n\n\n* 2+ years of production experience with Erlang.\n\n* Good communication in written English.\n\n* Strong knowledge of Linux/UNIX, HTTP and Networking.\n\n* Experience managing a technical team: developing talent, creating and enforcing standards, resource allocation.\n\n* A history of achieving both technical and business goals.\n\n\n\n\n\n\n\n\n\n\nDesired Skills:\n\n\n\n\n* Python Knowledge.\n\n* Familiarity with techniques and tools for crawling, extracting, and processing data.\n\n* Knowledge of ELK, Graylog, Docker and Mesos.\n\n* Good spoken English.\n\n\n\n\n
See more jobs at Scrapinghub
# How do you apply? This job post is older than 30 days and the position is probably filled. Try applying to jobs posted recently instead.Apply for this Job
👉 Please reference you found the job on Remote OK, this helps us get more companies to post here!