Ben_Kosytorz
5fd5dacaf0
- warhammer.com shop HTML/listing endpoints are behind AWS WAF (405/202 goku challenge) for non-browser clients; findings recorded in AGENTS.md - the shop search runs on Algolia; public search-only key lets us dump the whole product index with plain requests (no browser, no captcha) - gwshop.py: credential loading (env or gitignored algolia.json), index listing, facet-partitioned full retrieval (search-only key cannot /browse and pagination caps at 1000, so the index is partitioned on the GameSystemsRoot hierarchy facet), normalization into the sorter's source-agnostic catalog schema (system/group/faction/subfaction/class) - data/gwshop_catalog.json: snapshot of prod-lazarus-product-en-ww, 3491 unique products, every product with full hierarchy path - tools/: one-shot browse + catalog builder + shape inspector
25 lines
333 B
Plaintext
25 lines
333 B
Plaintext
# Python
|
|
__pycache__/
|
|
*.pyc
|
|
.venv/
|
|
*.egg-info/
|
|
|
|
# Run outputs (if OUT_DIR points into the repo)
|
|
thread/
|
|
downloads/
|
|
export.json
|
|
export.html
|
|
state.json
|
|
state.json.tmp
|
|
failed_urls.txt
|
|
manifest.jsonl
|
|
*.log
|
|
|
|
# Never commit credentials
|
|
*.token
|
|
.env
|
|
|
|
# Algolia credentials (search-only key, still never commit)
|
|
algolia.json
|
|
gwshop_raw.json
|