Published September 22, 2026 | Version v1.0.2

When a Judgment Layer's Self-Reported Fields Lie

Authors/Creators

  • 1. Independent Researcher

Description

A measurement and characterisation study of three judgment layers -- a local non-autoregressive typed-decision model (Laya), a remote typed-decision service (TypeSafe Jev), and a frontier autoregressive model (DeepSeek-V4.1-Flash) -- on a common item set. Four claims are tested; three hold independently (cost is not the binding constraint; access-layer self-reported fields are not trustworthy; capability collapses on tasks requiring the detection of an absence) and the fourth -- that a heterogeneous judge provides incremental coverage over the generator -- is NOT supported in any of three task regimes.

Notes

If you use this artifact, please cite both the paper and the archived artifact.

Files

PerryLink/llm-jev-laya-bench-v1.0.2.zip

Files (2.1 MB)

Name Size
md5:0fb78103133198e3d1bdb44ee72da0b5
2.1 MB Preview Download

Additional details

Related works