Apify is a web scraping and automation platform. It provides a number of services to help you turn any website into an API.
Crawl and extract data from websites that employ AJAX, complex pagination or infinite scroll using the same tools you already use for your front-end development.
No need to install browser plugins, download any tools, set up cron jobs, databases or proxy servers. You already have all you need - your current web browser.
Serverless computing platform that enables creation of custom web scraping and automation jobs. A single Actor job is called an act.
Apify provides a first-class support for running headless Chrome jobs using Puppeteer. You only need to select the appropriate base image for your act and then call the
launchPuppeteer()function provided by the
The source code of your acts can be hosted directly on Apify, as well as on GitHub, Docker Hub or in fact anywhere on the internet. Your act can be automatically built and published on every push to Git. It only takes a few clicks to move your existing project to Apify and publish it in the library for anyone to use it!
Unlike traditional serverless computing platforms, the run of an act is not time-limited. Acts can run for as long as necessary, even forever. The act can perform anything from a simple action, such as sending an email or cropping an image, to complex operations such as crawling an entire website and removing duplicates from a large dataset.
Schedule your crawlers or acts to run periodically every day, hour, minute or even every second using a cron-like expression.
Apify provides a simple key-value store to help you quickly store and retrieve data from your acts.
Apify integrates seamlessly with Zapier, Keboola, Integromat or in fact any other service thanks to the REST API.
an Apify expert
Every day we get dozens of requests from people all over the world to set up web automation solutions for them. Would you like to help us with that and make some money? Please let us know at firstname.lastname@example.org