Eval report — step-002200
- entries evaluated: 4535
- full-parseaddress parsingThe process of decomposing a free-text postal address string into structured components — house number, street name, locality, region, postcode, and country — so a geocoder can resolve them to coordinates. exact matchexact matchThe share of eval items whose every component is correct (compared per-span or per-token). Stricter than per-tag F1, which credits partial correctness.: 0.0818
- mean tokentokenOne word or subword in the tokenized input. For the neural classifier, tokens come from SentencePiece (subword units); for the rule classifiers, tokens are whitespace- and punctuation-separated words. confidence: 0.8063
Per-component F1
| tag | precisionprecisionOf the spans the model labeled as a given tag, the fraction it got right. High precision means few false positives. Paired with recall to compute F1. | recallrecallOf the spans whose gold label is a given tag, the fraction the model found. High recall means few misses. Paired with precision to compute F1. | f1 | support |
|---|---|---|---|---|
| countrycountryThe top-level address component (an ISO country). Closed-vocabulary, so it is best handled by a deterministic matcher feeding a proposal rather than a retrained model head. | 0.2143 | 0.2082 | 0.2112 | 245 |
| regionregionThe first-level administrative subdivision of a country — a US state, a French region, a province. The component between country and locality. | 0.3430 | 0.1298 | 0.1883 | 3205 |
| localitylocalityThe city / town / settlement component of an address: a populated place sitting between region and neighbourhood in the hierarchy. | 0.2478 | 0.3053 | 0.2736 | 3357 |
| dependent_locality | 0.0050 | 0.1000 | 0.0096 | 40 |
| postcodepostcodeThe country-specific postal code (US ZIP, French code postal, etc.). Mailwoman handles postcode parsing entirely by rule classifier — a regex problem, not an ML one. | 0.8324 | 0.5916 | 0.6916 | 2980 |
| subregion | 0.0000 | 0.0000 | 0.0000 | 0 |
| cedexCEDEX (Courrier d'Entreprise à Distribution Exceptionnelle). A French postal routing for high-volume business mail: a CEDEX code delivers directly from a sorting centre, bypassing the local post office. A common negative-space format Mailwoman must parse. | 0.0000 | 0.0000 | 0.0000 | 1 |
| venuevenueA named, non-address place — a business, building, park, or stadium. Mailwoman's free-text point-of-interest component, added as a Tier 2 fine label. | 0.3765 | 0.4015 | 0.3886 | 1101 |
| streetstreetThe named linear feature along which house numbers are ordered. Decomposes into a name plus street affixes; one of the Tier 2 fine labels. | 0.3559 | 0.2616 | 0.3016 | 2928 |
| house_number | 0.7446 | 0.8335 | 0.7866 | 1742 |
Calibration (confidence bucket → accuracy)
| bucket | n | accuracy |
|---|---|---|
| 0.0–0.1 | 0 | 0.0000 |
| 0.1–0.2 | 21 | 0.2381 |
| 0.2–0.3 | 666 | 0.2913 |
| 0.3–0.4 | 2416 | 0.3266 |
| 0.4–0.5 | 4308 | 0.3152 |
| 0.5–0.6 | 4777 | 0.3383 |
| 0.6–0.7 | 4943 | 0.3569 |
| 0.7–0.8 | 5534 | 0.3825 |
| 0.8–0.9 | 8066 | 0.4363 |
| 0.9–1.0 | 30517 | 0.6440 |