Act

drobnikj/check-crawler-results

  • Builds
  • latest 0.1.3 / 2017-10-25
  • Created 2017-06-05
  • Last modified 2017-10-25
  • grade 5

Description

Act checks results from crawler execution depends on input. It sends mail if one or more errors was found in crawler results. It is designed to run from crawler finish webhook.


API

To run the act, send a HTTP POST request to:

https://api.apify.com/v2/acts/drobnikj~check-crawler-results/runs?token=<YOUR_API_TOKEN>

The POST payload will be passed as input for the act. For more information, read the docs.


Readme

apify-act-check-crawler-results

This act checks crawler results and send notification if finds some errors. It is designed to run from crawler finish webhook.

Usage

For a specific crawler set the following parameters:

Finish webhook URL (finishWebhookUrl)

https://api.apify.com/v2/acts/drobnikj~check-crawler-results/runs?token=APIFY_API_TOKEN

Finish webhook data

sampleCount
  • Number
  • Number of results that act checks
  • Default is 1000
minOutputtedPages
  • Number
  • Indicates minimum outputted pages of crawler to checks if attribute is set.
jsonSchema
  • Object
  • If jsonSchema is set act check all sample results against schema.
compareWithPreviousExecution
  • Boolean
  • If compareWithPreviousExecution is set to true act compare results with previous execution.
  • If tag for execution is set compare act result from previous results with same tag.