Files

T

Ben_Kosytorz 964400cb1e feat(rust): port sorter.py — fuzzy matching, plan, hardlink apply

- src/sorter.rs: inspect (zip/7z listing via crates, HTML-page detection),
  keyword classification with inner-name votes, catalog load with dropped
  systems, fuzzy matching on the CPython-difflib port (containment boost,
  generic-token stoplist, tokenless bonus, weak tier, cross-system gates),
  deepest-dir re-homing incl. provenance unit mode, build_target,
  hardlink-apply with audit + low-confidence doc, format_plan
- all 9 python test_sorter_units.py cases ported and passing
- parity fixes found while porting: inner-name votes REPLACE (not max-keep)
  the outer score below threshold; python max() keeps first maximal vote;
  ratio cache keyed with allow_single; 512-byte head read for HTML sniff

2026-10-09 14:44:09 +02:00

data

feat(rust): difflib port + taxonomy data dump

2026-10-09 13:44:28 +02:00

src

feat(rust): port sorter.py — fuzzy matching, plan, hardlink apply

2026-10-09 14:44:09 +02:00

tools

feat(rust): difflib port + taxonomy data dump

2026-10-09 13:44:28 +02:00

.gitignore

chore: start transition layout — python into version-python/, scaffold version-rust/

2026-10-09 13:18:31 +02:00

Cargo.lock

feat(rust): port discord, gofile, zero807, extract_all and catalogue

2026-10-09 14:17:02 +02:00

Cargo.toml

feat(rust): port discord, gofile, zero807, extract_all and catalogue

2026-10-09 14:17:02 +02:00

README.md

feat(rust): port state.py, globalstore.py and manifest appending

2026-10-09 13:27:59 +02:00

README.md

version-rust

Rust rewrite of version-python (same repo, main branch still carries the flat python layout). Goal: one concise binary + webapp, eventually replacing the python tooling.

Why this structure

main stays untouched (flat python layout) until the rewrite reaches parity.
This branch re-homes the python code into version-python/ (via git mv, history preserved) and starts version-rust/ beside it.
version-python/AGENTS.md still documents the python stage — its rules (secrets, failure policy, idempotency, rate limiting) apply to the rewrite too and are the contract the Rust version must keep.

Planned crate choices (initial, adjust as modules get ported)

Concern	Python today	Rust plan
7z extraction	7z CLI, cp437 name repair, /var/tmp fallback	`sevenz-rust2` (pure Rust; LZMA/LZMA2/PPMD/AES-256 decrypt, v0.23, active)
zip extraction	7z CLI	`zip` crate
RAR extraction (critical)	7z CLI	`unrar.rs` (muja/unrar.rs — bindings to the official UnRAR library, RAR5 support, extraction only). Note: UnRAR license is freeware-not-OSI and forbids building a RAR compressor — acceptable, we only extract, and compression later is 7z-only (`sevenz-rust2` `ArchiveWriter`) anyway
HTTP client	`requests`	`reqwest` (blocking first, async where the webapp needs it)
sha256 (gofile website token, --hash manifest)	hashlib	`sha2`
Fuzzy matching (sorter)	difflib-style ratios	`strsim` — port thresholds exactly, add unit tests
CLI	argparse	`clap`
Webapp	—	`axum` (CLI parity first, webapp second)
Discord export	DCE docker container (external)	unchanged: shell out to docker

Port order (suggested)

state / globalstore / manifest — done, see src/state.rs, src/globalstore.rs, src/manifest.rs (schemas backward compatible).
hosters: gofile (one guest account per run!), zero807 (UA + Referer).
extraction + manifest appender.
catalogue / sorter (hardest logic; port the matching rules documented in version-python/AGENTS.md §7 with tests).
webapp on top.