Web Scrapping Python

Question

It used code below to collect data of atms from the parameters in the terminal. Site was changed and I can not find the equivalent of this for data collection.

Would anyone know if I could find on the page inspection?

import requests

parametro = {'latitude':-23.5097042, 'longitude':-46.6717552, 'status':1, 'lista':1, 'limite':98, 'acessibilidade':''}

r = requests.get('https://www.banco24horas.com.br/index/busca-json-terminal',parametro)

Answer 1

Using the browser developer tool window opened in the "network" tab while using the site for a box, we see that the request has changed to URL "https://www.banco24horas.com.br/ajax.php".

If we try the same parameters, however, we have an undefined error. This is because the parameters have changed, and now, copying from the same original request that we saw, are the following:

params = {'latitude': -23.5097042, 'longitude': -46.6717552, 'acess': 0}

If we request at that point we will have the following message:

<br />
<b>Notice</b>:  Undefined index: HTTP_X_REQUESTED_WITH in <b>/var/www/html/b24h/ajax.php</b> on line <b>17</b><br />
{"type":"console","text":"No Ajax"}

It indicates that something else is needed for the system to work: a specific header that is also sent, the X-Requested-With. If we include it as follows, the request returns the data:

import requests

params = {'latitude': -23.5097042, 'longitude': -46.6717552, 'acess': 0}

headers = {
    "X-Requested-With": "XMLHttpRequest",
}

r = requests.get("https://www.banco24horas.com.br/ajax.php", params=params, headers=headers)

print(r.json())
# {'Results': [{'id_atm': '47530', 'cd_atm': '47530', ...