Problems with excessive search requests on google

Asked

Viewed 37 times

-1

During the development of a Python project that needs to perform several automated searches on Google. At some point, as expected, Google blocks requests declaring "suspicious activity".

My question is: Is there any way to avoid this impasse? Or, it is possible to continue performing these searches defining a longer time interval ?

python google python-requests

1 answer

1


Google is notoriously difficult to crawl and employs several anti-bot measures. Here has some tips that help a little, but still the maximum cadence is very small.

What I suggest is to use the API of Bing, which is an official way to get search results and will facilitate your work reasonably.

  • 1

    I’m using the Bing API. Thank you very much Pedro, this is for a research project here at the University. You will be referenced.

Browser other questions tagged python google python-requests

You are not signed in. Login or sign up in order to post.