Python Web Scraper + Excel Dashboard
OOP-based scraper that extracts product data from live e-commerce sites and generates professional Excel reports with charts.
What It Does
- Extracts title, price, rating, stock from live sites
- Dual-level error handling + file logging
- Auto-timestamped output files
- Excel reports with pie and bar charts
- KPI metrics dashboard sheet
- Ethical rate limiting + randomized delays
Challenges & Solutions
Challenge 1
Stable scraping without getting blocked by anti-bot measures.
Solution
Implemented randomized delays, rate limiting, and robust error handling to mimic human behavior.
Challenge 2
Parsing dynamic HTML structures that change based on product availability.
Solution
Built a modular selector system using BeautifulSoup that gracefully handles missing elements via conditional fallbacks.
Challenge 3
Exporting unstructured data into a structured Excel format with charts.
Solution
Used `xlsxwriter` to create a post-processing layer that calculates metrics and injects charts into formatted Excel sheets.
Project Gallery
What I Learned
OOP design patterns, Excel automation, ethical web scraping practices