And we can keep that database up to date by re-running our program as new PDFs are posted. Here, we offer some basics about web scraping and how you can start using it in your research projects.

What to know about web scraping Web scraping is usually an automated process, but it doesn't have to be; data can be scraped from websites manually, by humans, though that's slow and inefficient.