Extracting data with web scraping

Latest Posts

A friendlier alternative to XPath selectors

Working out the correct XPath selectors can be a right pain; read this to learn about a friendlier alternative with CSS selectors.

Having trouble extracting the tbody element while web scraping?

You're not the only one. It's an easy fix, and if you read this you'll also learn the difference between served HTML and the rendered DOM.

How to filter out duplicate URLs from Scrapy’s start_urls

How to filter out duplicate URLs from Scrapy's start_urls as Scrapy turns off de-duplication for them

Scrape your cinema’s listings to get a daily email of films with a high IMDb rating

Learn how to write your own web scraping program which notifies you via email when films with a high enough IMDb rating are showing at your local cinema.