How to recover all URL from any site?

Asked

Viewed 2,105 times

0

I’m doing a specific densification, and I’d like to collect all the URL from any website.

On my website for example I can do this using the google Analytics, to other sites I can’t because I don’t have access.

There are tools that could help me in this case ?

php url google-analytics

  • Try it like this: Web Spider - Capture Website Links.

  • 1

    With PHP you can make a page url and then with some class analyze the DOM of the page you search the <a> tags and checking the src will save the links. https://www.tutorialspoint.com/php/php_parser_example.htm

2 answers

1

Not quite what you want, but this site, for example, returns the entire sitemap of any web address.

Generate Sitemap

The site will generate the sitemap in an xml, you can then take advantage of the links of that file.

-1


After some research I found an alternative. I installed Xenu a free solution that allows you to recover all URL website and more.

Another method would be the use of PHP using the Curl of the page !

Browser other questions tagged php url google-analytics

You are not signed in. Login or sign up in order to post.