Data validation / pre-built functions
B
Ben Senior
Would be great to be able to validate/re-format data so I can save to a database straight away. For example, if I scrape a date that is "Sat, Mar 25, 2023" and I need it as 2023-03-25. Maybe there is a way to already do this. Also if data isn't as expected, not to run the associated webhook, or to run an alternative one.
J
John
We have started running into some scenarios where a request appears to be successful in MrScraper (and therefore sends a webhook notification) but does not contain any extracted information. Sending a follow-up request to the same page with the same scraper results in another successful request that actually has the extracted information, so it seems like the original request may be getting "sneakily blocked."
While we could handle the webhook notifications with missing data on the application side, it would be nice if MrScraper allowed us to define our own "success" rules (validation) to check before sending data to the webhook. In my opinion, these rules should not impact MrScraper's token usage or success/fail status.