About us:


Scrapinghub is looking for software engineers to join our Professional Services team to work on web crawler development with Scrapy, our flagship open source project.

Are you interested in building web crawlers harnessing the Scrapinghub platform, which powers crawls of over 3 billion pages a month? Do you like working in a company with a strong open source foundation?

Scrapinghub helps companies, ranging from Fortune 500 enterprises to up and coming early stage startups, turn web content into useful data with a cloud-based web crawling platform, off-the-shelf data sets, and turn-key web scraping services.

Join us in making the world a better place for web crawler developers with our team of top talented engineers working remotely from more than 30 countries.

• Design, develop and maintain Scrapy web crawlers


• Leverage the Scrapinghub platform and our open source projects to perform distributed information extraction, retrieval and data processing


• Identify and resolve performance and scalability issues with distributed crawling at scale


• Help identify, debug and fix problems with open source projects, including Scrapy

This position plays an integral part in the Scrapinghub HR Function. He/She will be responsible for proactively coordinating HR operations across the organisation. Additionally, the postholder will participate in Program and Process review and optimize the opportunity to contribute to the roll-out of Programs and Projects supporting the Global Strategy, including Talent Acquisition, Talent Management, Learning and Development, Organisation and People Effectiveness, Engagement, Employee Relations and Communications, HRIS/Workforce Administration, Compensation and Benefits.

Currently the organisation has over 100 people spanning 36 countries, is 100% remote working globally and we are growing fast.

Responsibilities
-First point of contact for operational HR activity across the organisation.
-Develop and manage Workforce Administration Process.
-Take ownership in the development and delivery of HR initiatives in support of the Global HR Strategy, ensuring alignment across the organisation
-Provide project management support and HR expertise to the business as part of the roll-out of Programs and Projects.
-Assist in managing the Hiring Plan, ensuring alignment between managers and leadership team.
-Coordinate the end-to-end recruitment process in line with internal SLA’s and business requirements.
-Develop the Recruitment process and associated metrics to support the Hiring Plan.
-Collaborate with the management team on delivery of their people plans in line with HR strategy.
-Provide coaching to managers and individual contributors to resolve conflicts, enhance team effectiveness, and ensure support of organization changes and functional goals.
-Interpreting and advising on employment policy and legislation.
-Coordinate Performance and compensation reviews ensuring the process is fair, consistent and timely.
-Own and provide proactive reporting and data analysis as required.
-Develop collaborative and effective working relationship cross-functionally and globally.

-The above statements describe the general nature and level of work being performed in this job. They are not intended to be an exhaustive list of all duties. Additional responsibilities may be assigned, as required, by management. When in conflict with the job description, the Staffing Request and Job Posting supersede this job description-

Education / Qualifications
-HR qualified with a 3+ years experience as an HR Generalist, ideally in a technology or high tech fast-paced organisation.
-Passionate about people and delivering HR solutions and services with pace and high quality outputs.
-Execution and results driven with excellent HR capability and working knowledge across multiple disciplines including Talent Acquisition, Talent Management, Learning and Development, Organisation and People Effectiveness, Engagement, Employee Relations and Communications, HRIS/Workforce Administration, Data Analytics/Reporting, Compensation and Benefits.
-Project Management skills and ability to take ownership and delivery of HR initiatives and programs.
-Collaborative style with ability to build relationships at all levels of the organization.
-Team player - we are a small HR team.
-Excellent Communication and Presentation Skills.
-Comfortable conversing with people from all English fluency levels.
-Comfortable working remotely, self-managed, well organised and a can-do attitude are a must for this role.
-Really good technical skills

• Develop, maintain and support a high load distributed system.
• Analyze our current and historical Crawlera usage to augment and enhance its routing and rotation logic.
• Leverage the Scrapinghub platform to provide extended functionality, both to end users and for internal purposes.
• Identify and resolve performance and scalability issues with distributed crawling at scale.
• Liaison with other platform teams to provide Crawlera with the best possible integration to the growing Scrapinghub platform.

• 2+ years of production experience with Erlang.
• Good communication in written English.
• Strong knowledge of Linux/UNIX, HTTP and Networking.

• Python Knowledge.
• Familiarity with techniques and tools for crawling, extracting and processing data.
• Knowledge of ELK, Graylog, Docker and Mesos.
• Good spoken English.

To apply: https://jobs.lever.co/scrapinghub/1595d1f7-37b2-4840-82fb-297d96295972?lever-origin=applied&lever-source%5B%5D=weworkremotely

Scrapinghub is looking for software engineers to join our Professional Services team to work on web crawler development with Scrapy, our flagship open source project.

The Support Team at Scrapinghub are responsible for providing customer support across all our platforms, working closely with development, sales and other technical teams to ensure our customers are receiving the best service possible.

Scrapinghub is looking for a frontend engineer to join our platform team to work on Portia, our open source visual scraper. Portia is part of the Scrapinghub platform, which powers crawls of over 3 billion pages a month. You will collaborate closely with the platform, product and growth teams to design, build and test new features.

Are you interested in building products used by thousands of users, including data scientists, marketers and journalists? Do you like working in a company with a strong open source foundation? Scrapinghub helps companies turn web content into useful data with a cloud-based web crawling platform, off-the-shelf datasets, and turn-key web scraping services.

Join us in making the world a better place for web crawler developers with our team of top talented engineers working remotely from more than 30 countries.

Responsibilities

Scrapinghub is looking for a motivated Senior Solution Architect to further accelerate the rapid growth the company has seen in the last 3+ years. The position will be remote based in a globally distributed team which features an amazing startup culture backed by strong technical expertise from highly qualified professionals from more than 30 countries.

We are looking for full time python developers to join our team and will consider a broad range of experience as we have a few positions available, particularly in crawler development.

Scrapinghub is looking for a senior systems engineer to join the team as Head of Sysadmin. This role will be responsible for the successful operations and scaling of the infrastructure and software that powers crawls of over 2 billion pages a month

Our infrastructure stack includes Ubuntu, Python, Django, MySQL, HBase, Docker, LXC, AWS, along with our own technologies, such as Scrapy, Crawlera and Hubstorage

Founded by the creators of Scrapy, Scrapinghub helps companies turn web content into useful data with a cloud-based web crawling platform, off-the-shelf datasets, and turn-key web scraping services

Join us in making the world a better place for web crawler developers and data scientists with top talented engineers working remotely from more than 30 countries

RESPONSIBILITIES

Your key responsibilities will be to:

• Oversee design, deployment and management of our global infrastructure
  
• Help identify, debug and fix problems arising on Scrapinghub’s platform, leveraging the work with both sysadmin and platform team members
  
• Organize the sysadmin team’s work and delegate tasks according to members skillset
  
• Help new members onboarding (by writing guides and direct mentoring)
  
• Write tools and scripts to provide automation and self service solutions for ourselves and other teams
  
• Design new systems to support production services
  
• Creatively solve scale challenges regarding a rapidly expanding cloud environment
  
• Help improve monitoring and identify key performance metrics
  
• Proactive R&D - discovering and implementing new tools, emerging technology, etc.
  
• Disaster recovery design, implementation, and maintenance
  
• Troubleshooting and resolution of server/network issues
  
  A few examples of things you’ll do:
  
  
• Migration of Cloudera Distribution for Hadoop (CDH) from version 4 to version 5 and the 50+ TB of data stored inside it, with minimal downtime
  
• Building and optimizing a Elasticsearch+Logstash+Kibana stack for our development team to monitor and analyze production system usage
  
• Design and implement a continuous integration and deployment system based on Docker, Mesos and an automatically configured http load balancer able to reroute traffic in case application containers die
  
• Automate servers setup to scale to +300 servers on cloud providers and bare metal, be ready to replace hardware at any time without service outage
  
• Setup and optimize a high available multi master MysqlDB and RabbitMQ cluster
  
  We have a lot of big projects and decisions that need to be made, and in this role you would be a key part of that process. Sound like fun? Here’s what we’re looking for:
  
  ABOUT YOU
  
  Our Ideal Candidate would have:
  
  
• 5+ years recent experience working as a Linux administrator/engineer at reasonable scale (dozens of systems) and designing/deploying ‘highly available’ solutions
  
• 3+ years of recent professional experience designing, developing, and operating Configuration Management solutions such as Chef, Puppet, Salt (preferred), or Ansible (preferred)
  
• Ability to react to emergency situations with little or no notice, following through and solving the issue at hand, providing postmortem documentation with corrective and preventive measures
  
• Proven experience leading a technical team
  
• Solid experience in Linux tuning, profiling, and monitoring
  
• Experience deploying/managing Docker and LXC
  
• Experience with Amazon Web Services (including EC2, S3, SES, Route 53, Cloudfront)
  
• Solid understanding of cloud/networking/distributed computing environment concepts; including TCP/ IP connections, firewalls, VLANs, etc.
  
• Strong skills in at least one language: Python (preferred), Ruby, Bash
  
• Excellent communication skills, both verbal and written across all user levels
  
  Bonus points for:
  
  
• Experience and understanding of contemporary metrics, monitors, and logging solutions especially ELK, cadvisor, Grafana, influxdb, etc.
  
• Highly organized, able to multi-task, able to work individually, as well as within a team, and across teams
  
• Working knowledge of load balancing technologies
  
• Proven experience working remotely and collaborating in a cross functional team environment
  
• Familiarity with software engineering practices, including n-tier architecture, configuration management, development methodologies (e.g. agile, waterfall, spiral, prototyping), etc.
  
  WHAT YOU GET
  
  
• Freedom to work from wherever you want.
  
• A chance to work with smart and self-motivated peers.
  
• A benefits pack that includes 20 days of paid vacations per year, your local country holidays, a hardware allowance, and an online services program intended for professional growth (Coursera courses, books).
  
• The opportunity to go to conferences and meet with the rest of the team.

We are looking for experienced individuals who are passionate about data science and enjoy working in a collaborative environment. You will get the chance to work with one of the most advanced and comprehensive web crawling and scraping infrastructures in the world, leveraging massive data sets with cutting edge technology.

Scrapinghub is looking for a senior systems engineer to join the team. This role will be responsible for the successful operations and scaling of the infrastructure and software that powers crawls of over 2 billion pages a month.

As a Project Manager at Scrapinghub, you would be responsible for the complete delivery of projects to our customers, who are often very technical. This involves understanding the requirements, planning the project, assigning engineers and seeing the project through to successful completion. You should meet regularly with customers to update on progress and ensure our solution meets expectations. Along with this you are expected to help the organization to scale by contributing to business development and implementing best practises. In this role you would work with other project managers and represent the Project Management Organization for Scrapinghub.

Scrapinghub is looking for a motivated Technical Sales Engineer to further accelerate the rapid growth the company has seen in the last 3+ years. The position will be for remote work in a globally distributed team which features an amazing startup culture backed by a strong technical expertise from highly qualified professionals from more than 30 countries.