BUG - System will fail on German Umlauts | Voters

BUG - System will fail on German Umlauts

complete

Holger

if the URL includes German umlauts äöüÄÖÜß (wich is fine per RFC) the System seems consitently fail, per API and per GUI Run

(for specific URL you can look into default for scraper_id 198)

February 20, 2023

Cahyo

marked this post as

complete

Cahyo

This issue should be fixed now. Let me know if you still face any issue with your scrapers 👍

Cahyo

marked this post as

in progress

Cahyo

Currently working on this, since I think it's also fails with Japanese, Chinese and Vietnamese chars. Will fix ASAP 🙏

Holger

the specific character in URL was xE4 wich is german "ä" but in ISO-8859-1   not as UTF-8  so i think the problem is an the caller side, but maybe its a hint to improve the error message ;)
- the GUI says somethink like contact support), 
- the API fails with non JSON result

Cahyo

Holger: Quick update:
✅ I have fixed the URL validation where it prevents launching scrapings for URLs containing non ASCII chars.
Currently working in the second part, the failed message. Will update ASAP