Home

About

Work

Contact

Résumé

Disk Price Scraper

I made this little scraper because I wanted more flexibility to filter out certain drives from diskprices.com. Things like filtering out by brandnames and so on. This scraper does have the ability to attach a brandname value to each drive, but not all brands are covered so some will output with 'Unknown Brand' in the end.
python.pngbeautifulsoup1.pngselenium.pnginsomnia.png
Disk Price Scraper
WorkNovember, 2022

What I Made ⚙

I made a scraper that grabs prices from diskprices.com and outputs them to a spreadsheet and JSON file.

What I Used 🛠

1. Python

Python is the programming/scripting language used for building this project.

2. Beautiful Soup 4

I used the Beautiful Soup library to parse the HTML downloaded by python requests.

3. Selenium

I used Selenium to load data that required JavaScript and user interaction.

About this site 🔍

I just wanted the ability to pass in arguments through the command line to immediately get what I wanted from diskprices.com.

What I learned 🧠

I've built numerous scrapers using similar methods so very little was learned through this process. What I did learn was how to speed up the process using ChatGPT :)

Finally 🔥

This was a fun project that allowed me to use ChatGPT to speed up the process.
Disk Price Scraper

November, 2022

View code