Problem with webscrapping (requests)

Asked

Viewed 41 times

0

Precise scrape this site to search for doctors in a category.

I send the requisition all right, pass the value (the type of doctor) and send via POST the requisition. However it does not return the values in the source code when I ask to see the source code by Python, but by the browser it shows all right.

My code

import requests

payload = {"especialidade": "GINECOLOGIA E OBSTETRICIA"}

head = {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; 
rv:65.0) Gecko/20100101 Firefox/65.0"}

req = requests.post("http://www.cremesc.org.br/buscamedico.jsp", 
data=payload, headers=head)
print(req.text) #Aqui ja teria que estar as informações dos medicos...

Code per image:

código

No answers

Browser other questions tagged

You are not signed in. Login or sign up in order to post.