Wrapper above Kickstarter search page. Takes configuration with search filters and outputs list of projects matching the search filters found on Kickstarter. Does not require proxy.
Act which takes URL and array of strings to search for and returns a definition of a crawler.
Loads data from crawler executions and uploads them directly to mysql.
Analyses pages provided in input and outputs XHR Requests with responses for HTML/JSON, window variables with content, metadata from <meta> tags, metadata from schema.org markup and metadata from JSON-LD.
Example of how to measure downloaded data from network requests made by a webpage.
Helper actor which queries Kickstarter places and outputs a list of 10 location with their Kickstarter ID's (needed when querying Kickstarter by location).
Takes ID of key value store as parameter "keyValueStoreId" and archives all keys in the key-value store into a zip file which is then saved into key-value store of the act. If there is more then 1000 keys in the store, multiple z...
Loads data from mysql table and creates a new table without duplicates
Measures data traffic done when CNN top stories are crawled. Optionally can cache responses in memory based on cache-control max-age header. Optionally can also block some tracking and analytics requests.