
=== google__gemini-2.5-flash-lite.jsonl  (20 rows, 0 failed or absent)
field           exact  norm null ok missing wrong spur fail  right  verdict
agency             15     4       0       0     0    1    0  19/20  FAIL
action             19     0       0       0     0    1    0  19/20  FAIL
docket_id          20     0       0       0     0    0    0  20/20  PASS
rin                18     0       2       0     0    0    0  20/20  PASS
effective_date     10     0      10       0     0    0    0  20/20  PASS
comments_due       10     0       8       0     0    2    0  18/20  FAIL
overall: FAIL: 3 of 6 fields pass; all 6 fields scored  (bar: >= 19/20 right per field, 0 failed, <= 0 spurious)
rows to look at:
  C1-2026-18574   agency          spurious  truth=None  got='DEPARTMENT OF THE TREASURY'
  C1-2026-18574   action          spurious  truth=None  got='Information Reporting Regarding Qualified Opportunity Zones and Updated Qualified Opportunity Fund Certification and Decertification Procedures Correction'
  2026-19786      comments_due    spurious  truth=None  got='2026-09-28'
  C1-2026-18574   comments_due    spurious  truth=None  got='2026-10-26'
