Forums

Hi, I've run into an issue with scraping a website from pythonanywhere. It seems like every time selenium connects to the website, it is being detected and captcha is triggered. Same website and same code works without a problem on a desktop in headless mode triggering captcha only once in 10-15 tries. Code is in ifinite loop so with next iteration captcha is not triggered anymore even if selenium times out without solving the captcha. Is it possible that the website can detect if the request is coming from a server instead of a home desktop? Is there a solution to get around the issue? Much appreciated!

If there's captcha on the page, maybe they don't want to be scraped. Check if the site in question exposes any API.