Web Scraping for Journalists
This three-part workshop in web scraping is designed for reporters with no knowledge of scraping or programming and provides foundational skills for getting original stories by compiling data across a range of online sources. By the end of the workshop, you will be able to begin to write your own basic scrapers and identify potential targets for scraping. You will also be able to communicate with programmers on relevant projects.
Scraping is the process of automatically collating information from the web. It might be grabbing entries across hundreds of webpages, fetching and combining dozens of spreadsheets, or thousands of PDFs.
The results have led to exclusive stories for organisations ranging from the Bureau of Investigative Journalism and Trinity Mirror, to DC Thomson, Channel 4 and the BBC.
This course will need you to have the following software/apps/tools on your computer:
- Delegates will be using their own laptop and should have a Google Drive account.
- A GitHub account would also be useful. The software is all free.
- Zoom app
- Camera and audio
This course will be hosted on Zoom. To find out more about how we use Zoom, please check out our Zoom InfoSec page.
The course will take place over three online sessions of 2hrs, taking place on consecutive Thursday evenings. Exercises and additional tasks will be provided to supplement the training during the intervening time and participants will be expected to commit to around 3hrs of self-directed learning between each session.
Our training is not recorded: if you miss a session, it is lost – you cannot watch a recording of it, nor will you be allowed to attend that session at a later date.
- 2 September 2021 17.00–19.00 British Summer Time (GMT +1)
- 9 September 2021 17.00–19.00 British Summer Time (GMT +1)
- 16 September 2021 17.00–19.00 British Summer Time (GMT +1)
In line with our non-profit mission, our pricing operates on a sliding scale, ensuring large organisations pay more to subsidise places for smaller newsrooms, freelancers and students.
*Student places for this course are capped, due to limited capacity. Anyone registering as a student will be asked for a photo/scan of their student ID ahead of the course.
**Employed individuals who cannot have their employers pay for the course are entitled to the freelancer rate. Note that we are a small charity and rely on your honesty so please do not register as a freelancer if your employer is reimbursing you for the course.
We have a strict policy of No Refund and No Transfer of bookings.