The web has provided us all with access to a near infinite amount of data about anything you could possibly imagine, and along with that an infinite realm of possibility as to what you can do with that data.
But… when it actually comes to extracting the data you need, you’ve probably discovered that it’s not so simple. Sure, you could copy and paste the data manually yourself, but aside from making you feel like a monkey - you know it’s not the best use of your time.
You know automating the process is possible, but understanding how to deal with the intricies of the web seems like it requires an insurmountable mountain of knowledge. I’m happy to say it doesn’t! It’s all perfectly teachable, and I’m here to do exactly that. Stick around & pick an article to find out more.
New to the topic and lost as to where to start? Here you'll learn about the background, common terms & jargon, most popular tools and other guides designed to get you off the ground with the least amount of hassle.
Take your web scraping knowledge up to the next level and know the web inside out; this section contains web scraping challenges designed to test your skill while giving you the ability to handle any situation the web may throw at you.
Here you'll find a list of all articles in theWeb Scraping section. A number of these articles were my response to questions from people just like you so if you have your own, get in touch.