0
Hello, I need to get data from a site that even a FINITE scroll! however, it is divided into parts, I have to give scroll ai load the rest, have I get the full page ? or has another function or library that indicates me ?
thank you!
0No answers
Browser other questions tagged php rolling curl
You are not signed in. Login or sign up in order to post.
The Curl makes a request, you should see what request it makes when it reaches the end of the page in the scroll and make that same request... Now, you could program a browser to do infinite scroll with Selenium.
– Paulo Henrique
how do I see this request ? and what is this Selenium that I did not understand right ? could you pass me your contact Paul ?
– Pablo Schuab
I use a technique to see the request: In Firebug, open the Network tab and you will see all the requests made. Right-click on the request and you have the option to copy the Curl command ready. This subject is very complex. Search on Web Crawlers, Selenium. If you understand English, a good book is Webbots, Spiders and Screen Scrapers, you should find for download
– Paulo Henrique