The Centre for Investigative Journalism
The Centre for Investigative Journalism

Web Scraping for Journalists

This three-part workshop in web scraping is designed for reporters with no knowledge of scraping or programming and provides foundational skills for getting original stories by compiling data across a range of online sources. By the end of the workshop, you will be able to begin to write your own basic scrapers and identify potential targets for scraping. You will also be able to communicate with programmers on relevant projects.

Scraping is the process of automatically collating information from the web. It might be grabbing entries across hundreds of webpages, fetching and combining dozens of spreadsheets, or thousands of PDFs.

The results have led to exclusive stories for organisations ranging from the Bureau of Investigative Journalism and Trinity Mirror, to DC Thomson, Channel 4 and the BBC.

Technical Requirements

This course will need you to have the following software/apps/tools on your computer:

  • Delegates will be using their own laptop and should have a Google Drive account.
  • Zoom app
  • Camera and audio

This course will be hosted on Zoom. To find out more about how we use Zoom, please check out our Zoom InfoSec page.

Course Structure

The course will take place over three online sessions of 2hrs, taking place on consecutive Thursday evenings. Exercises and additional tasks will be provided to supplement the training during the intervening time and participants will be expected to commit to around 3hrs of self-directed learning between each session.


Our training is not recorded: if you miss a session, it is lost – you cannot watch a recording of it, nor will you be allowed to attend that session at a later date.

2 September 2021 – Session 1


9 September 2021 – Session 2


16 September 2021 – Session 3


Paul Bradshaw

Professor Paul Bradshaw is an online journalist and blogger, who leads the MA in Data Journalism at Birmingham City University. He manages his own blog, the Online Journalism Blog (OJB), and was the co-founder of Help Me Investigate, an investigative journalism website funded by Channel 4 and Screen WM.
  • 2 September 2021 17.00–19.00 Timezone: BST (UK Time)
  • 9 September 2021 17.00–19.00 Timezone: BST (UK Time)
  • 16 September 2021 17.00–19.00 Timezone: BST (UK Time)
Timezone: BST (UK Time)
Location: Zoom meeting