This job post is closed and the position is probably filled. Please do not apply. Work for Scrapinghub and want to re-open this job? Use the edit link in the email when you posted the job!
\nScrapinghub is looking for a senior systems engineer to join the team as Head of Sysadmin. This role will be responsible for the successful operations and scaling of the infrastructure and software that powers crawls of over 2 billion pages a month.\n\nOur infrastructure stack includes Ubuntu, Python, Django, MySQL, HBase, Docker, LXC, AWS, along with our own technologies, such as Scrapy, Crawlera and Hubstorage.\n\nFounded by the creators of Scrapy, Scrapinghub helps companies turn web content into useful data with a cloud-based web crawling platform, off-the-shelf datasets, and turn-key web scraping services.\n\nJoin us in making the world a better place for web crawler developers and data scientists with top talented engineers working remotely from more than 30 countries.\n\nYour key responsibilities will be to:\n\n\n* Oversee design, deployment and management of our global infrastructure\n\n* Help identify, debug and fix problems arising on Scrapinghub’s platform, leveraging the work with both sysadmin and platform team members\n\n* Organize the sysadmin team’s work and delegate tasks according to members skillset\n\n* Help new members onboarding (by writing guides and direct mentoring)\n\n* Write tools and scripts to provide automation and self service solutions for ourselves and other teams\n\n* Design new systems to support production services\n\n* Creatively solve scale challenges regarding a rapidly expanding cloud environment\n\n* Help improve monitoring and identify key performance metrics\n\n* Proactive R&D - discovering and implementing new tools, emerging technology, etc.\n\n* Disaster recovery design, implementation, and maintenance\n\n* Troubleshooting and resolution of server/network issues\n\n\n\n\nA few examples of things you’ll do:\n\n\n* Migration of Cloudera Distribution for Hadoop (CDH) from version 4 to version 5 and the 50+ TB of data stored inside it, with minimal downtime\n\n* Building and optimizing a Elasticsearch+Logstash+Kibana stack for our development team to monitor and analyze production system usage\n\n* Design and implement a continuous integration and deployment system based on Docker, Mesos and an automatically configured http load balancer able to reroute traffic in case application containers die\n\n* Automate servers setup to scale to +300 servers on cloud providers and bare metal, be ready to replace hardware at any time without service outage\n\n* Setup and optimize a high available multi master MysqlDB and RabbitMQ cluster\n\n\n \n\n#Salary and compensation\n
No salary data published by company so we estimated salary based on similar jobs related to Admin, Sys Admin, Cloud, Senior and Engineer jobs that are similar:\n\n
$70,000 — $120,000/year\n
\n\n#Benefits\n
๐ฐ 401(k)\n\n๐ Distributed team\n\nโฐ Async\n\n๐ค Vision insurance\n\n๐ฆท Dental insurance\n\n๐ Medical insurance\n\n๐ Unlimited vacation\n\n๐ Paid time off\n\n๐ 4 day workweek\n\n๐ฐ 401k matching\n\n๐ Company retreats\n\n๐ฌ Coworking budget\n\n๐ Learning budget\n\n๐ช Free gym membership\n\n๐ง Mental wellness budget\n\n๐ฅ Home office budget\n\n๐ฅง Pay in crypto\n\n๐ฅธ Pseudonymous\n\n๐ฐ Profit sharing\n\n๐ฐ Equity compensation\n\nโฌ๏ธ No whiteboard interview\n\n๐ No monitoring system\n\n๐ซ No politics at work\n\n๐ We hire old (and young)\n\n
# How do you apply?\n\nThis job post has been closed by the poster, which means they probably have enough applicants now. Please do not apply.