Loaded 4561 golden entries Loading model... Running eval... 500/4561 (2.5s) 1000/4561 (4.9s) 1500/4561 (7.5s) 2000/4561 (9.8s) 2500/4561 (12.2s) 3000/4561 (14.6s) 3500/4561 (17.0s) 4000/4561 (19.6s) 4500/4561 (21.9s)
Error Analysis Report
Golden set: 4561 entries Model: NeuralAddressClassifier Time: 22.2s
Summaryโ
| Metric | Count | Rate |
|---|---|---|
| Exact match | 964 | 21.1% |
| Missed entities | 1889 | โ |
| Boundary errors | 3921 | โ |
| Confused tags | 1607 | โ |
| Hallucinated tags | 1383 | โ |
Per-tag breakdownโ
| Tag | Expected | Correct | Missed | Boundary | Confused | Hallucinated | Recall |
|---|---|---|---|---|---|---|---|
| locality | 3383 | 1343 | 48 | 1400 | 592 | 503 | 39.7% |
| region | 3227 | 2096 | 705 | 156 | 270 | 117 | 65.0% |
| postcode | 3006 | 2284 | 355 | 100 | 267 | 145 | 76.0% |
| street | 2931 | 818 | 351 | 1462 | 300 | 46 | 27.9% |
| house_number | 1745 | 1379 | 160 | 46 | 160 | 381 | 79.0% |
| venue | 1101 | 321 | 90 | 680 | 10 | 86 | 29.2% |
| country | 245 | 60 | 104 | 73 | 8 | 101 | 24.5% |
| dependent_locality | 40 | 0 | 40 | 0 | 0 | 0 | 0.0% |
| po_box | 27 | 14 | 9 | 4 | 0 | 4 | 51.9% |
| street_prefix | 10 | 0 | 10 | 0 | 0 | 0 | 0.0% |
| street_prefix_particle | 6 | 0 | 6 | 0 | 0 | 0 | 0.0% |
| unit | 5 | 0 | 5 | 0 | 0 | 0 | 0.0% |
| street_suffix | 2 | 0 | 2 | 0 | 0 | 0 | 0.0% |
| intersection_a | 1 | 0 | 1 | 0 | 0 | 0 | 0.0% |
| intersection_b | 1 | 0 | 1 | 0 | 0 | 0 | 0.0% |
| cedex | 1 | 0 | 1 | 0 | 0 | 0 | 0.0% |
| attention | 1 | 0 | 1 | 0 | 0 | 0 | 0.0% |
Missed entities (1889)โ
6220 SE Salmon St, Portland, OR 97215, USAโ missing street_prefix="SE"6220 SE Salmon St, Portland, OR 97215, USAโ missing street_suffix="St"123 Main St Apt 4B, Springfield, IL 62701โ missing unit="Apt 4B"Main St & 5th Ave, Portland, ORโ missing intersection_a="Main St"Main St & 5th Ave, Portland, ORโ missing intersection_b="5th Ave"
Boundary errors (3921)โ
6220 SE Salmon St, Portland, OR 97215, USAโ street: expected "Salmon" got "SE Salmon St"500 W 7th St Ste 1100, Cincinnati, OH 45203-1234โ street: expected "7th" got "W 7th St Ste 1100"123 main st portland or 97214โ street: expected "main st" got "main"CULLEN INSULATION INC, POBOX 3211 FARGO ND 58108, FARGO, ND 58108โ venue: expected "CULLEN INSULATION INC" got "CULLEN"CULLEN INSULATION INC, POBOX 3211 FARGO ND 58108, FARGO, ND 58108โ street: expected "POBOX 3211 FARGO ND 58108" got "POBOX 3211"
Confused tags (1607)โ
Main St & 5th Ave, Portland, ORโ locality: expected "Portland" got "Main St"05770 VT DELONG LNโ street: expected "DELONG LN" got "VT"ND 58368 6th St SWโ street: expected "6th St SW" got "ND 58368 6th St"WY 82601 Mountain Wayโ street: expected "Mountain Way" got "WY"Woodland Ave NE, NDโ region: expected "ND" got "NE"
Hallucinated tags (1383)โ
Main St & 5th Ave, Portland, ORโ hallucinated street="Ave"12345 Mt Tabor Park, Portland, OR 97215โ hallucinated street="Mt Tabor Park"Vermont, USAโ hallucinated locality="Vermont"05764 Finel Hollow Road, VTโ hallucinated house_number="05764"05764 Finel Hollow Road, VTโ hallucinated locality="Finel Hollow Road"