How to capture website content and store in a database

Asked

Viewed 360 times

0

Here the site that has the vacancies

If you could just get in there and see how it works.

I need to get the vacancy titles and the descriptions that contain in them as the: Company, Practice Area and Requirements.

My question is how do I take this information and store it within a database?

Notice that you have to click on in the vacancy to have access to its description, and when opening the window that shows information, the content cannot be copied, even there is no way to select the text!

  • Webcrawler and webscraper are terms related to the type of program you want to do. I am mentioning because in many cases knowing the name of things makes a lot of difference in research.

  • 1

    Hello, Felipe. Welcome to [pt.so]! This question is a little broad, involves a lot and has infinite possibilities of answer. I would say that you need to divide the problem into parts: first you need to identify how to access the information, then how to turn it into a data structure in your program, then how it will be stored and with what technology. Each of these points has numerous possibilities of solution that depend on the context. In fact, the first question should be: do you have the right to access and use the information that will harvest from the site as you intend?

No answers

Browser other questions tagged

You are not signed in. Login or sign up in order to post.