Generate pdf file from a pdf Object

Question

I’m interested in making a crawler to work with pdf, but hit me a doubt here.
I need to download files pdf of a python url, when it has a .pdf it’s easy and no problem, but when she’s a objeto pdf I can’t manipulate, I actually can’t find information right how it works....
Ex: http://pesquisa.in.gov.br/imprensa/servlet/INPDFViewer?jornal=529&pagina=1&data=13/11/2017&captchafield=firstAccess

Does anyone know how to download this file as a pdf?

Answer 1

Requests

To get the PDF we can use a library called requests, to install do:

pip install requests

The code will look like this:

import requests

# Url do PDF
url = "http://pesquisa.in.gov.br/imprensa/servlet/INPDFViewer?jornal=529&pagina=1&data=13/11/2017&captchafield=firstAccess"

# Obtém o PDF do link, e guarda na memória
resp = requests.get(url)

# Salva o PDF
with open("diario.pdf", "wb") as code:
    code.write(resp.content)