The ability to follow a link and nest results | Voters

The ability to follow a link and nest results

in progress

John

It would be helpful to be able to follow a link and nest results. 
For example, if I'm scraping an element on a page I would be able to set the scraper to click a link and also scrape information from that page.
For our use case, we'd only have to be able to click one link per collection item.

January 1, 2023

Cahyo

marked this post as

in progress

John

Now that you've added webhooks we're building an application around MrScraper instead of using the results from the UI so something like https://mrscraper.canny.io/feedback/p/scraper-templates would also solve this need (for us, at least).

Cahyo

marked this post as

planned

Cahyo

Thanks for your feedback, John.
I have been thinking how to tackle this feature for a few weeks now. I think I've found a viable approach.
I'll try to have this live within 2-3 weeks (or before). I'll keep you updated.
Thanks!

Chris Dawes

Cahyo: could run several threads and then combine results into a collection.

Cahyo

Chris Dawes: Oh, I forgot to close this task. This feature is live. Even though it will be much more performant in the new version I'll release in October.