Eval report — step-050000
- entries evaluated: 74
- full-parseaddress parsingThe process of decomposing a free-text postal address string into structured components — house number, street name, locality, region, postcode, and country — so a geocoder can resolve them to coordinates. exact matchexact matchThe share of eval items whose every component is correct (compared per-span or per-token). Stricter than per-tag F1, which credits partial correctness.: 0.5270
- mean tokentokenOne word or subword in the tokenized input. For the neural classifier, tokens come from SentencePiece (subword units); for the rule classifiers, tokens are whitespace- and punctuation-separated words. confidence: 0.9745
Per-component F1
| tag | precisionprecisionOf the spans the model labeled as a given tag, the fraction it got right. High precision means few false positives. Paired with recall to compute F1. | recallrecallOf the spans whose gold label is a given tag, the fraction the model found. High recall means few misses. Paired with precision to compute F1. | f1 | support |
|---|---|---|---|---|
| countrycountryThe top-level address component (an ISO country). Closed-vocabulary, so it is best handled by a deterministic matcher feeding a proposal rather than a retrained model head. | 0.0000 | 0.0000 | 0.0000 | 6 |
| regionregionThe first-level administrative subdivision of a country — a US state, a French region, a province. The component between country and locality. | 0.8500 | 0.8095 | 0.8293 | 63 |
| localitylocalityThe city / town / settlement component of an address: a populated place sitting between region and neighbourhood in the hierarchy. | 0.6875 | 0.6111 | 0.6471 | 72 |
| dependent_locality | 0.0000 | 0.0000 | 0.0000 | 1 |
| postcodepostcodeThe country-specific postal code (US ZIP, French code postal, etc.). Mailwoman handles postcode parsing entirely by rule classifier — a regex problem, not an ML one. | 0.8730 | 0.8462 | 0.8594 | 65 |
| subregion | 0.0000 | 0.0000 | 0.0000 | 0 |
| cedexCEDEX (Courrier d'Entreprise à Distribution Exceptionnelle). A French postal routing for high-volume business mail: a CEDEX code delivers directly from a sorting centre, bypassing the local post office. A common negative-space format Mailwoman must parse. | 0.0000 | 0.0000 | 0.0000 | 1 |
Calibration (confidence bucket → accuracy)
| bucket | n | accuracy |
|---|---|---|
| 0.0–0.1 | 0 | 0.0000 |
| 0.1–0.2 | 0 | 0.0000 |
| 0.2–0.3 | 0 | 0.0000 |
| 0.3–0.4 | 5 | 0.2000 |
| 0.4–0.5 | 9 | 0.4444 |
| 0.5–0.6 | 20 | 0.4000 |
| 0.6–0.7 | 8 | 0.5000 |
| 0.7–0.8 | 19 | 0.3684 |
| 0.8–0.9 | 25 | 0.4000 |
| 0.9–1.0 | 1114 | 0.8824 |