Turn any website
into an API

The easiest way to extract structured data from any website run headless Chrome / Puppeteer jobs in the cloud crawl large lists of URLs automate web browsing with Selenium host your open source projects in the cloud for free

Live example

See the Apify web crawler in action as it loads first five pages of Hacker News and extracts all submissions.

Start URL

https://news.ycombinator.com

Crawl pseudo-URLs

https://news.ycombinator.com/news?p=[\d+]

Clickable elements

a[href^="news?p="]

Page function

// Extract all submissions from the loaded page
function pageFunction(context) {
  var $ = context.jQuery
  var submissions = $('.athing').toArray();

  return submissions.map(function (el) {
    var $el = $(el), $next = $el.next();

    return {
      Rank: $el.find('.rank').text(),
      Title: $el.find('.storylink').text(),
      Link: $el.find('.storylink').attr('href'),
      Score: parseInt($next.find('.score').text()),
      Author: $next.find('.hnuser').text(),
      Time: $next.find('.age').text()
    };
  });
}

  • Logo of Uber
  • Logo of Yale University
  • Logo of Princeton University
  • Logo of Pioneers.io
  • Logo of Apontador Busca Local LTDA
  • Logo of KNOMI.com

Apify for developers

Apify is a web scraping and automation platform. Turn any website into an API in a few minutes!

Web automation meets the cloud

Apify is the easiest way to run headless Chrome jobs in the cloud. It comes with an advanced web crawler that enables the scraping of even the largest websites. Schedule your jobs using a cron-like service and store large amounts of data in specialized storages.

Stop reinventing the wheel

Reuse crawlers and acts built by others and publish your own for other people to use. Your source code can be hosted on GitHub, Docker Hub, an arbitrary URL or directly on Apify. The users of your service pay for the resources consumed, not you!

Open computing platform

Your Apify services can be written in JavaScript or any other language as long as they are bundled as Docker containers. Manage the platform using a web interface or REST API. Trigger external services using webhooks, or directly from your code or with integration platforms like Zapier or Keboola.

Apify for business

Apify helps companies succeed by leveraging unlimited data from the web. We'll find an expert to set you up!

Extract data from any website

Apify takes advantage of the latest technologies, enabling you to extract data or perform automated actions on practically any website. You can run your jobs automatically every minute, hour or day. Download results in Excel, CSV, HTML or JSON.

Get started in no time

There are already dozens of web scraping services on the Apify platform. The solution to your use case might be as simple as configuring one or two existing services. Save time on technical details and focus on growing your business!

Simple integration

Apify can be plugged seamlessly into your existing business workflow. This can range from simple tasks such as sending you an email if your competitor reduces prices to more complicated one such as automatically uploading new leads into your CRM.

  • Runs headless Chrome
    and Puppeteer

    Take advantage of the world's most popular web browser for your web scraping and automation jobs, and extract exactly the same web content that human visitors see.

  • desktop_windows

    Handles arbitrary
    websites

    Crawl and extract data from websites that employ AJAX, complex pagination or infinite scroll. Extract content as seen by visitors from other countries using our pool of proxy servers.

  • cloud

    Entirely
    in the cloud

    No need to install browser plugins, download any tools, set up cron jobs, databases or proxy servers. You already have all you need - your current web browser.

Integrations

Don't let your Apify services live on a remote island - connect them with your favorite tools.

Learn more

Integration with Google Drive, Dropbox, Slack and much more

Trusted by
thousands of users.

Photos of users

"Apify has been invaluable in providing all the crawling for our site auditor product. Reliable, fast and accurate! Even better is their user interface, which makes it easy to test and develop our javascript parser."

Foto of Joe Kindness CEO of Agency Analytics

Joe Kindness

CEO of Agency Analytics

“Apify is a great tool, which made our projects involving crawling from external sources faster, cheaper and more efficient. Their superb support helped us start the first project really quickly and easily."

Foto of Dušan Šenkypl CEO of ePojisteni.cz

Dušan Šenkypl

CEO of ePojisteni.cz

“At Finbox.io, we were working on getting a better understanding of our current customers so we could find new ones with similar characteristics. Apify's well-documented flexible APIs made it really easy to get started. We had a fault tolerant crawler up and running in minutes!"

Foto of Andy Pai Co-founder of Finbox.io

Andy Pai

Co-founder of Finbox.io

“Apify has been a great tool for us. It is easy to use, clear and transparent. With Apify, our data extraction through crawling has been speeded up by an order of magnitude. The customer service is great, too."

Foto of Markus Ehrnrooth Co-founder of Knomi

Markus Ehrnrooth

Co-founder of Knomi

“ShopWings has been relying on Apify for a large range of use cases. After experimenting with other solutions on the market, we were truly enthusiastic to discover Apify's radical approach to the same problem, and we've been using it so far with a lot of success."

Foto of Guillaume Ang Co-founder of Shopwings

Guillaume Ang

Co-founder of Shopwings

  • keyboard_arrow_left
  • keyboard_arrow_right
  • Apify for developers

    Apify is a web scraping and automation platform. Turn any website into an API in a few minutes!

  • Apify for business

    Apify helps companies succeed by leveraging unlimited data from the web. We'll find an expert to set you up!