Eval report — step-006000
- entries evaluated: 74
- full-parseaddress parsingThe process of decomposing a free-text postal address string into structured components — house number, street name, locality, region, postcode, and country — so a geocoder can resolve them to coordinates. exact matchexact matchThe share of eval items whose every component is correct (compared per-span or per-token). Stricter than per-tag F1, which credits partial correctness.: 0.0000
- mean tokentokenOne word or subword in the tokenized input. For the neural classifier, tokens come from SentencePiece (subword units); for the rule classifiers, tokens are whitespace- and punctuation-separated words. confidence: 0.8653
Per-component F1
| tag | precisionprecisionOf the spans the model labeled as a given tag, the fraction it got right. High precision means few false positives. Paired with recall to compute F1. | recallrecallOf the spans whose gold label is a given tag, the fraction the model found. High recall means few misses. Paired with precision to compute F1. | f1 | support |
|---|---|---|---|---|
| countrycountryThe top-level address component (an ISO country). Closed-vocabulary, so it is best handled by a deterministic matcher feeding a proposal rather than a retrained model head. | 0.0000 | 0.0000 | 0.0000 | 6 |
| regionregionThe first-level administrative subdivision of a country — a US state, a French region, a province. The component between country and locality. | 0.0986 | 0.1111 | 0.1045 | 63 |
| localitylocalityThe city / town / settlement component of an address: a populated place sitting between region and neighbourhood in the hierarchy. | 0.0423 | 0.0417 | 0.0420 | 72 |
| dependent_locality | 0.0000 | 0.0000 | 0.0000 | 1 |
| postcodepostcodeThe country-specific postal code (US ZIP, French code postal, etc.). Mailwoman handles postcode parsing entirely by rule classifier — a regex problem, not an ML one. | 0.0000 | 0.0000 | 0.0000 | 65 |
| subregion | 0.0000 | 0.0000 | 0.0000 | 0 |
| cedexCEDEX (Courrier d'Entreprise à Distribution Exceptionnelle). A French postal routing for high-volume business mail: a CEDEX code delivers directly from a sorting centre, bypassing the local post office. A common negative-space format Mailwoman must parse. | 0.0000 | 0.0000 | 0.0000 | 1 |
Calibration (confidence bucket → accuracy)
| bucket | n | accuracy |
|---|---|---|
| 0.0–0.1 | 0 | 0.0000 |
| 0.1–0.2 | 0 | 0.0000 |
| 0.2–0.3 | 5 | 0.0000 |
| 0.3–0.4 | 36 | 0.2222 |
| 0.4–0.5 | 56 | 0.2143 |
| 0.5–0.6 | 73 | 0.2055 |
| 0.6–0.7 | 64 | 0.0938 |
| 0.7–0.8 | 94 | 0.2128 |
| 0.8–0.9 | 95 | 0.2316 |
| 0.9–1.0 | 777 | 0.3591 |