Research

Paper

TESTING February 27, 2026

Hypothesis Testing over Observable Regimes in Singular Models

Authors

Sean Plummer

Abstract

Hypothesis testing in singular statistical models is often regarded as inherently problematic due to non-identifiability and degeneracy of the Fisher information. We show that the fundamental obstruction to testing in such models is not singularity itself, but the formulation of hypotheses on non-identifiable parameter quantities. Testing is inherently a problem in distribution space: if two hypotheses induce overlapping subsets of the model class, then no uniformly consistent test exists. We formalize this overlap obstruction and show that hypotheses depending on non-identifiable parameter functions necessarily fail in this sense. In contrast, hypotheses formulated over identifiable observables-quantities that are determined by the induced distribution-reduce entirely to classical testing theory. When the corresponding distributional regimes are separated in Hellinger distance, uniformly consistent tests exist and posterior contraction follows from standard testing-based arguments. Near singular boundaries, separation may collapse locally, leading to scale-dependent detectability governed jointly by sample size and distance to the singular stratum. We illustrate these phenomena in Gaussian mixture models and reduced-rank regression, exhibiting both untestable non-identifiable hypotheses and classically testable identifiable ones. The results provide a structural classification of which hypotheses in singular models are statistically meaningful.

Metadata

arXiv ID: 2602.24165
Provider: ARXIV
Primary Category: math.ST
Published: 2026-02-27
Fetched: 2026-03-02 06:04

Related papers

Raw Data (Debug)
{
  "raw_xml": "<entry>\n    <id>http://arxiv.org/abs/2602.24165v1</id>\n    <title>Hypothesis Testing over Observable Regimes in Singular Models</title>\n    <updated>2026-02-27T16:44:29Z</updated>\n    <link href='https://arxiv.org/abs/2602.24165v1' rel='alternate' type='text/html'/>\n    <link href='https://arxiv.org/pdf/2602.24165v1' rel='related' title='pdf' type='application/pdf'/>\n    <summary>Hypothesis testing in singular statistical models is often regarded as inherently problematic due to non-identifiability and degeneracy of the Fisher information. We show that the fundamental obstruction to testing in such models is not singularity itself, but the formulation of hypotheses on non-identifiable parameter quantities. Testing is inherently a problem in distribution space: if two hypotheses induce overlapping subsets of the model class, then no uniformly consistent test exists. We formalize this overlap obstruction and show that hypotheses depending on non-identifiable parameter functions necessarily fail in this sense. In contrast, hypotheses formulated over identifiable observables-quantities that are determined by the induced distribution-reduce entirely to classical testing theory. When the corresponding distributional regimes are separated in Hellinger distance, uniformly consistent tests exist and posterior contraction follows from standard testing-based arguments. Near singular boundaries, separation may collapse locally, leading to scale-dependent detectability governed jointly by sample size and distance to the singular stratum. We illustrate these phenomena in Gaussian mixture models and reduced-rank regression, exhibiting both untestable non-identifiable hypotheses and classically testable identifiable ones. The results provide a structural classification of which hypotheses in singular models are statistically meaningful.</summary>\n    <category scheme='http://arxiv.org/schemas/atom' term='math.ST'/>\n    <category scheme='http://arxiv.org/schemas/atom' term='stat.ML'/>\n    <published>2026-02-27T16:44:29Z</published>\n    <arxiv:comment>16 pages, 4 figures. Structural classification of hypothesis testability in singular statistical models, with numerical illustrations in Gaussian mixture models and reduced-rank regression</arxiv:comment>\n    <arxiv:primary_category term='math.ST'/>\n    <author>\n      <name>Sean Plummer</name>\n    </author>\n  </entry>"
}