Loaded 4561 golden entries Loading model... Running eval... 500/4561 (2.8s) 1000/4561 (5.1s) 1500/4561 (7.5s) 2000/4561 (9.9s) 2500/4561 (12.3s) 3000/4561 (14.9s) 3500/4561 (17.3s) 4000/4561 (19.6s) 4500/4561 (22.0s)
Error Analysis Report
Golden set: 4561 entries Model: NeuralAddressClassifier Time: 22.3s
Summaryโ
| Metric | Count | Rate |
|---|---|---|
| Exact match | 856 | 18.8% |
| Missed entities | 2470 | โ |
| Boundary errors | 3804 | โ |
| Confused tags | 1235 | โ |
| Hallucinated tags | 2299 | โ |
Per-tag breakdownโ
| Tag | Expected | Correct | Missed | Boundary | Confused | Hallucinated | Recall |
|---|---|---|---|---|---|---|---|
| locality | 3383 | 1053 | 970 | 1144 | 216 | 289 | 31.1% |
| region | 3227 | 2135 | 664 | 179 | 249 | 125 | 66.2% |
| postcode | 3006 | 2478 | 191 | 69 | 268 | 217 | 82.4% |
| street | 2931 | 806 | 263 | 1557 | 305 | 54 | 27.5% |
| house_number | 1745 | 1325 | 209 | 46 | 165 | 207 | 75.9% |
| venue | 1101 | 331 | 53 | 706 | 11 | 56 | 30.1% |
| country | 245 | 69 | 84 | 89 | 3 | 55 | 28.2% |
| dependent_locality | 40 | 12 | 0 | 10 | 18 | 1066 | 30.0% |
| po_box | 27 | 14 | 9 | 4 | 0 | 1 | 51.9% |
| street_prefix | 10 | 0 | 10 | 0 | 0 | 31 | 0.0% |
| street_prefix_particle | 6 | 0 | 6 | 0 | 0 | 0 | 0.0% |
| unit | 5 | 0 | 5 | 0 | 0 | 0 | 0.0% |
| street_suffix | 2 | 0 | 2 | 0 | 0 | 198 | 0.0% |
| intersection_a | 1 | 0 | 1 | 0 | 0 | 0 | 0.0% |
| intersection_b | 1 | 0 | 1 | 0 | 0 | 0 | 0.0% |
| cedex | 1 | 0 | 1 | 0 | 0 | 0 | 0.0% |
| attention | 1 | 0 | 1 | 0 | 0 | 0 | 0.0% |
Missed entities (2470)โ
6220 SE Salmon St, Portland, OR 97215, USAโ missing street_prefix="SE"6220 SE Salmon St, Portland, OR 97215, USAโ missing street_suffix="St"123 Main St Apt 4B, Springfield, IL 62701โ missing unit="Apt 4B"Main St & 5th Ave, Portland, ORโ missing intersection_a="Main St"Main St & 5th Ave, Portland, ORโ missing intersection_b="5th Ave"
Boundary errors (3804)โ
6220 SE Salmon St, Portland, OR 97215, USAโ street: expected "Salmon" got "SE Salmon St"500 W 7th St Ste 1100, Cincinnati, OH 45203-1234โ street: expected "7th" got "W 7th St Ste 1100"123 main st portland or 97214โ street: expected "main st" got "main"CULLEN INSULATION INC, POBOX 3211 FARGO ND 58108, FARGO, ND 58108โ venue: expected "CULLEN INSULATION INC" got "CULLEN"CULLEN INSULATION INC, POBOX 3211 FARGO ND 58108, FARGO, ND 58108โ street: expected "POBOX 3211 FARGO ND 58108" got "POBOX 3211"
Confused tags (1235)โ
05770 VT DELONG LNโ street: expected "DELONG LN" got "VT"ND 58368 6th St SWโ street: expected "6th St SW" got "ND 58368 6th St"WY 82601 Mountain Wayโ street: expected "Mountain Way" got "WY"Woodland Ave NE, NDโ region: expected "ND" got "NE"ND 58203, Woodland Ave NEโ street: expected "Woodland Ave NE" got "ND 58203"
Hallucinated tags (2299)โ
Main St & 5th Ave, Portland, ORโ hallucinated dependent_locality="Main St"12345 Mt Tabor Park, Portland, OR 97215โ hallucinated street="Mt Tabor Park"Vermont, USAโ hallucinated dependent_locality="Vermont"05764 Finel Hollow Road, VTโ hallucinated house_number="05764"Finel Hollow Road, VTโ hallucinated dependent_locality="Finel Hollow Road"