Work Scraper avatar
Work Scraper
Try for free

7 days trial then $40.00/month - No credit card required now

View all Actors
Work Scraper

Work Scraper

trudax/work-scraper
Try for free

7 days trial then $40.00/month - No credit card required now

Extract data from the top freelancing websites. Search by URL or search terms, filter by categories, English level, and hourly rate. Get info about freelancers and agencies without login. Download your data as an HTML table, JSON, CSV, Excel, or XML.

User avatar

Duplicate output items

Closed

altarey opened this issue
2 months ago

Running the Actor for the first times today via API. Noticed all results are duplicated jobs. How to fix this?

User avatar

I will take a look

User avatar

I have made some improvements. Can you try it once more?

User avatar

altarey

2 months ago

Thank you for a quick response.

  • Instead of 3 dups I see 2 dups now
  • The run has been marked as successful though I see failed status in the logs.
  • I expect more results than just 2 or 3. The maxItems value is set to 10.

input settings { "category": "531770282580668419", "debugMode": false, "maxItems": 10, "proxy": { "useApifyProxy": true }, "rhrs": false, "search": "AWS Developer United States", "searchFor": "job", "useBuiltInSearch": true, "startUrls": [ "https://www.upwork.com/search/profiles/" ] }

User avatar

I have found the issue, the new version should fix the problem. I have also added a flag to the input where you can enable or disable login.

User avatar

altarey

2 months ago

Nice. Now I get more unique jobs. But it seems the fix regressed applyUrl. It's no longer in output. Right side is the latest JSON.

User avatar

Ok, I see other things to improve also. I will work on it.

User avatar

Done

Developer
Maintained by Community
Actor metrics
  • 7 monthly users
  • 100.0% runs succeeded
  • 0.25 days response time
  • Created in Jun 2020
  • Modified 23 days ago
Categories