Skip to content
Personal Project

UOM Project Scraper

Automated University Project Data Harvester and Notion Exporter

PythonBeautifulSoupSeleniumNotion APICSV
View Repository ↗

Personal project built to solve a real need: the UoM project listing site is not machine-readable, making it difficult to track and compare final-year project options. The scraper automated the entire collection and distribution pipeline.

The Problem

The university project portal had no export functionality, forcing students to manually copy project descriptions one by one — a slow, error-prone process when comparing dozens of options.

The Approach

Used Selenium for JavaScript-rendered page navigation and BeautifulSoup for HTML parsing. Exported structured data to CSV, then built a secondary script using the Notion API to bulk-insert rows into personal and shared Notion databases.

The Outcome

Fully automated pipeline — from scraping the live site to populating a structured Notion database — shared with and adopted by other students for their own project tracking.

UOM Project Scraper