Instagram Scrapping

Question

This is my first python program and basically my first one with programming (since html does not fit kkk).

I had the idea to map the information of an entire city as profiles of people, of establishments, locations and people who liked the photos of those places but I found myself stuck in the illusion of thinking that only using the requests and the beautiful F12 browser tool to find everything with Beautifulsoup would reach the data that interest me but I saw that you need to authenticate in the API urges and make advanced firulas that I don’t know where to begin, Someone give me a light?

until now it only downloads a user’s source code, from there I saw that the Divs and etc that needed to do Parsing were not in source code

Answer 1

User authentication and one of the biggest problems when making a scraping, I suggest doing what you want with the Selenium. If Selenium does not meet its purpose, you still have the possibility of Mechanize solve its problem - I say from own experience, in a personal project of scraping to the university system where study, the only one able to do scraping in the system with authentication was it - however the Mechanize has only version for python2, the version for python3 is called Mechanicalsoup

If you want to take a look at this scraping system I mentioned with Mechanize in python2, follow the link.