Eyal Rosenthal · Web scraping at scale

Steam Catalog Bulk Extractor

Steam Catalog Bulk Extractor — Game Metadata + Pricing + Genres → CSV

Steam Store Catalog Bulk Extractor

Bulk extract Steam game metadata via the public Store API. Maps to recurring Upwork brief class: "build me a CSV of [N] Steam games with price + genre + reviews + release date." Common buyers: gaming media, indie analytics, market research, recommender-system data.

Built 2026-05-03 as Demo #31 — third hybrid-mode (real-recurring-brief) demo.

Run

. ~/freelance/.venv/bin/activate
cd ~/freelance/portfolio_demos/steam_catalog_extractor
python extract.py --ids 730,570,440,1086940,367520,1245620
python extract.py --file appids.txt   # one id per line

Result

  • 7 games extracted (CS2, Dota 2, TF2, THE FINALS, Baldur's Gate 3, Hollow Knight, Elden Ring) ✅
  • Per-row: name, type, is_free, release_date, developers, publishers, genres, categories, languages, metacritic_score, recommendations_total, price_initial / price_final cents, currency, discount_percent ✅
  • Resume + dedupe via in-CSV appid set so a paused 5K-game run picks back up cleanly ✅
  • 1.5s sleep between fetches (well under Steam's ~200/5min rate limit) ✅
  • Tenacity retries with exponential backoff ✅

Adapting

  • For full catalog: enumerate the public app list (currently ~120K apps), filter to games, batch-fetch.
  • For specific genres: pre-filter the appid list using SteamSpy or IsThereAnyDeal.
  • For multi-region pricing: loop the cc= param across us, gb, de, jp, etc., write one row per region.

Hire me to build this for your stack

Same patterns, your target site. Send the brief and I'll quote fixed-price within 24 hours.

info@luba.media