Paper
On the last time and the number of times an estimator is more than epsilon from its target value
Authors
Nils Lid Hjort, Grete Fenstad
Abstract
Suppose $\widehatθ_n$ is a strongly consistent estimator for $θ_0$ in some i.i.d. situation. Let $N_\varepsilon$ and $Q_\varepsilon$ be respectively the last $n$ and the total number of $n$ for which $\widehatθ_n$ is at least $\varepsilon$ away from $θ_0$. The limit distributions for ${\varepsilon}^2 N_\varepsilon$ and ${\varepsilon}^2 Q_\varepsilon$ as $\varepsilon$ goes to zero are obtained under natural and weak conditions. The theory covers both parametric and nonparametric cases, multi-dimensional parameters, and general distance functions. Our results are of probabilistic interest, and, on the statistical side, suggest ways in which competing estimators can be compared. In particular several new optimality properties for the maximum likelihood estimator sequence in parametric families are established. Another use of our results is ways of constructing sequential fixed-volume or shrinking-volume confidence sets, as well as sequential tests with power 1. The paper also includes limit distribution results for the last $n$ and the number of $n$ for which the supremum distance $\|F_n-F\|\ge\varepsilon$, where $F_n$ is the empirical distribution function. Yet other results are reached for $\varepsilon^{5/2} N_\varepsilon$ and $\varepsilon^{5/2} Q_\varepsilon$ in the context of nonparametric density estimation, referring to the last time and the number of times where $|f_n(x) f(x)|\ge\varepsilon$. Finally it is shown that our results extend to several non-i.i.d. situations.
Metadata
Related papers
Cosmic Shear in Effective Field Theory at Two-Loop Order: Revisiting $S_8$ in Dark Energy Survey Data
Shi-Fan Chen, Joseph DeRose, Mikhail M. Ivanov, Oliver H. E. Philcox • 2026-03-30
Stop Probing, Start Coding: Why Linear Probes and Sparse Autoencoders Fail at Compositional Generalisation
Vitória Barin Pacela, Shruti Joshi, Isabela Camacho, Simon Lacoste-Julien, Da... • 2026-03-30
SNID-SAGE: A Modern Framework for Interactive Supernova Classification and Spectral Analysis
Fiorenzo Stoppa, Stephen J. Smartt • 2026-03-30
Acoustic-to-articulatory Inversion of the Complete Vocal Tract from RT-MRI with Various Audio Embeddings and Dataset Sizes
Sofiane Azzouz, Pierre-André Vuissoz, Yves Laprie • 2026-03-30
Rotating black hole shadows in metric-affine bumblebee gravity
Jose R. Nascimento, Ana R. M. Oliveira, Albert Yu. Petrov, Paulo J. Porfírio,... • 2026-03-30
Raw Data (Debug)
{
"raw_xml": "<entry>\n <id>http://arxiv.org/abs/2603.09629v1</id>\n <title>On the last time and the number of times an estimator is more than epsilon from its target value</title>\n <updated>2026-03-10T13:07:56Z</updated>\n <link href='https://arxiv.org/abs/2603.09629v1' rel='alternate' type='text/html'/>\n <link href='https://arxiv.org/pdf/2603.09629v1' rel='related' title='pdf' type='application/pdf'/>\n <summary>Suppose $\\widehatθ_n$ is a strongly consistent estimator for $θ_0$ in some i.i.d. situation. Let $N_\\varepsilon$ and $Q_\\varepsilon$ be respectively the last $n$ and the total number of $n$ for which $\\widehatθ_n$ is at least $\\varepsilon$ away from $θ_0$. The limit distributions for ${\\varepsilon}^2 N_\\varepsilon$ and ${\\varepsilon}^2 Q_\\varepsilon$ as $\\varepsilon$ goes to zero are obtained under natural and weak conditions. The theory covers both parametric and nonparametric cases, multi-dimensional parameters, and general distance functions. Our results are of probabilistic interest, and, on the statistical side, suggest ways in which competing estimators can be compared. In particular several new optimality properties for the maximum likelihood estimator sequence in parametric families are established. Another use of our results is ways of constructing sequential fixed-volume or shrinking-volume confidence sets, as well as sequential tests with power 1. The paper also includes limit distribution results for the last $n$ and the number of $n$ for which the supremum distance $\\|F_n-F\\|\\ge\\varepsilon$, where $F_n$ is the empirical distribution function. Yet other results are reached for $\\varepsilon^{5/2} N_\\varepsilon$ and $\\varepsilon^{5/2} Q_\\varepsilon$ in the context of nonparametric density estimation, referring to the last time and the number of times where $|f_n(x) f(x)|\\ge\\varepsilon$. Finally it is shown that our results extend to several non-i.i.d. situations.</summary>\n <category scheme='http://arxiv.org/schemas/atom' term='math.ST'/>\n <published>2026-03-10T13:07:56Z</published>\n <arxiv:comment>18 pages, no figures; Statistical Research Report, Department of Mathematics, University of Oslo, from April 1991, now arXiv'd March 2026. The paper has appeared in Annals of Statistics, 1992, vol. 20, pages 469-489, at this url: projecteuclid.org/journals/annals-of-statistics/volume-20/issue-1/On-the-Last-Time-and-the-Number-of-Times-an/10.1214/aos/1176348533.full</arxiv:comment>\n <arxiv:primary_category term='math.ST'/>\n <author>\n <name>Nils Lid Hjort</name>\n </author>\n <author>\n <name>Grete Fenstad</name>\n </author>\n </entry>"
}