Hello,
I’m experiencing an issue with the Scrape block. I’m trying to scrape data from the following Google search URL:
This is a valid link, and everything was working fine just two days ago, but today, it suddenly stopped, and I’m not sure why. I’ve attached screenshots to show what I’m seeing.
Could you please help me understand what might be causing this and how to fix it?
Thank you!
It looks like you copied/pasted your scrape URL from an in browser Google search. As a result, it’s bloated with extra characters.
We updated our scrape block to be able to scrape a list of URLs and there was an unnecessary comma in your Google Search URL. This caused the scrape block to think you were trying to scrape a list.
If you want to generate a clean Google Search URL without all the extra characters, ask AI to do it for you. A clean search URL for car videos would be https://www.google.com/search?q=cars&tbm=vid
Lmk if this makes sense!
Yep I saw this. As a solution if somebody will have the same issue try to replace , with & it works for me
That probably works, but it’s not a reliable solution.
The proper one would be to prompt a Generate Text block to “Create a Google video search query URL for {{formattedkeywords}}. Return only the URL, nothing else.” Save this as a variable {{urltoscrape}}.
Then Scrape URL block {{urltoscrape}}
This is the most complete way and avoids all the additional suffix tags that do nothing in terms of the actual returned search results.
This is how you get https://www.google.com/search?q=cars&tbm=vid instead of https://www.google.com/search?q=cars&tbm=vid&!@#$ABC12334kjhkadshfkdjsahflkjdshfal1231321