Loaded 4535 golden entries Loading model... Running eval... 500/4535 (2.5s) 1000/4535 (4.8s) 1500/4535 (7.1s) 2000/4535 (9.4s) 2500/4535 (11.7s) 3000/4535 (14.1s) 3500/4535 (16.4s) 4000/4535 (18.7s) 4500/4535 (21.1s)
Error Analysis Report
Golden set: 4535 entries Model: NeuralAddressClassifier Time: 21.2s
Summaryโ
| Metric | Count | Rate |
|---|---|---|
| Exact match | 771 | 17.0% |
| Missed entities | 2684 | โ |
| Boundary errors | 3698 | โ |
| Confused tags | 1474 | โ |
| Hallucinated tags | 2381 | โ |
Missed entities (2684)โ
6220 SE Salmon St, Portland, OR 97215, USAโ missing street_prefix="SE"6220 SE Salmon St, Portland, OR 97215, USAโ missing street_suffix="St"PO Box 123, Burlington, VT 05401โ missing po_box="PO Box 123"123 Main St Apt 4B, Springfield, IL 62701โ missing unit="Apt 4B"Main St & 5th Ave, Portland, ORโ missing intersection_a="Main St"
Boundary errors (3698)โ
6220 SE Salmon St, Portland, OR 97215, USAโ street: expected "Salmon" got "SE Salmon St"Main St & 5th Ave, Portland, ORโ region: expected "OR" got "Portland"500 W 7th St Ste 1100, Cincinnati, OH 45203-1234โ street: expected "7th" got "W 7th St Ste 1100"123 main st portland or 97214โ street: expected "main st" got "main"CULLEN INSULATION INC, POBOX 3211 FARGO ND 58108, FARGO, ND 58108โ venue: expected "CULLEN INSULATION INC" got "CULLEN"
Confused tags (1474)โ
Vermont, USAโ region: expected "Vermont" got "USA"05770 VT DELONG LNโ street: expected "DELONG LN" got "VT"ND 58368 6th St SWโ street: expected "6th St SW" got "ND"ND 58701 Airview Drโ street: expected "Airview Dr" got "ND"WY 82601 Mountain Wayโ street: expected "Mountain Way" got "WY"
Hallucinated tags (2381)โ
PO Box 123, Burlington, VT 05401โ hallucinated street="PO Box 123"Main St & 5th Ave, Portland, ORโ hallucinated dependent_locality="Main St"12345 Mt Tabor Park, Portland, OR 97215โ hallucinated street="Mt Tabor Park"Vermont, USAโ hallucinated dependent_locality="Vermont"05764 Finel Hollow Road, VTโ hallucinated house_number="0576"