Getting Started To get us started, you will need to start a new Python3 project with and install Scrapy (a web scraping and web crawling library for Python).

My go-to language for web scraping is Python, as it has well-integrated libraries that can generally handle all of the functionality required. And sure enough, a Selenium library exists for Python.

Reflex has built an open source framework to make it easy to turn Python code into a we app. Today it announced a $5M seed investment.

How we learnt to stop worrying and love web scraping For Nicholas DeVito, Georgia Richards and Peter Inglesby, custom webscrapers have driven their research — and their collaborations.