7 days trial then $40.00/month - No credit card required now

Work Scraper

trudax/work-scraper

7 days trial then $40.00/month - No credit card required now

Extract data from the top freelancing websites. Search by URL or search terms, filter by categories, English level, and hourly rate. Get info about freelancers and agencies without login. Download your data as an HTML table, JSON, CSV, Excel, or XML.

All issues Create new issue

Search page not displaying all jobs?

Closed

engrossing_car opened this issue

I see that when I search upwork for all us jobs it lists close to 20k jobs.

https://www.upwork.com/nx/jobs/search/?sort=recency&user_location_match=1

But when I try to scrape it, Im getting only 5k jobs. whny am I not able to get all the 20k jobs?

Thx.

Gustavo Rudiger (trudax)

If you are not logged in Upwork return less results. You can also try to use a proxy from a country that is not the US.

engrossing_car

ok will try that. thx.

engrossing_car

one other question. If I want to scrape jobs that were created in the last 48 hours. What is the best way to do that?

Gustavo Rudiger (trudax)

Right now there is no filter that enables you to do that. You can only sort by newest and limit the number of results. Later you can check the createdAt fields on the scraped data.

Add comment

Developer

Gustavo Rudiger

Actor metrics

7 monthly users
100.0% runs succeeded
0.25 days response time
Created in Jun 2020
Modified 23 days ago

Categories

Jobs

Indeed Scraper

misceres/indeed-scraper

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

Misceres

2.4k

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

1.8k

Clutch.co Scraper

epctex/clutchco-scraper

Unleash the power of data extraction with our Clutch.co Scraper. Gather comprehensive company information, numeric company focus, real client reviews, portfolios, and more from the extensive Clutch.co commercial database. Explore top company listings and perform targeted searches effortlessly.

epctex

1.2k

Google Jobs Scraper

dan.scraper/google-jobs-scraper

Google Jobs Scraper is to enable you to scrape Google Jobs Results, extract "googleJobs", "categories". Allow customizing country or language or job radius and extraction of custom attributes. Download data as HTML table, JSON, CSV, Excel, XML.

Scrape It

571

Top Universities Scraper

vbartonicek/topuniversities-scraper

Scrapes the QS World University Rankings to get a list of the top universities.

Vratislav Bartonicek

511

🔥 Best Indeed Jobs Scraper

adrian_horning/best-indeed-jobs-scraper

✅ FREE Indeed jobs scraper! Scrape the jobs on Indeed! Scrape 60 pages worth of results.

Adrian | The Web Scraping Guy

493

Advanced Linkedin job scraper

curious_coder/linkedin-jobs-search-scraper

Scrape linkedin job postings and get job details, company details, job poster details as CSV or JSON format with this linkedin job scraping tool

Curious Coder

457

Indeed job scraper

curious_coder/indeed-scraper

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

Curious Coder

401

BBB Data Crawler

epctex/bbb-scraper

Scrape data from the Better Business Bureau as known as BBB. Crawl and extract company information, insights, financial projections, social links, accreditations and much more. Scrape the huge BBB Cloud, retrieve charities and businesses in the United States, Canada, and Mexico by their categories.

epctex

318