When can a learner reliably generate unseen items from only positive examples?
This paper studies a theoretical version of learning called "language generation in the limit." Imagine you see more and more positive examples of an unknown infinite set (a language). A generator succeeds if, from any such exhaustive stream of positive examples, it can eventually produce valid new members that were not in the observed sample. The authors give a precise condition that exactly characterizes when this is possible for families of sets over a countable universe.
At a high level, the key idea is a finite positive witness for each target element. A finite positive witness is a finite set of examples that, once seen, keeps that target element as a live possibility. The main theorem says generation in the limit is possible exactly when every target can be assigned such a finite witness, and whenever you look at the targets that remain possible after any finite sample, those targets share an infinite common intersection. In plain terms: each candidate has a short certificate that it is still plausible, and the set of candidates left after any finite observation still overlap a lot.
Part of the work is a normalization result. The authors show any successful generator can be converted into one that depends only on the set of observed examples, not the order in which they arrived. They call this a universal normalization and obtain it by searching through "unconfirmed histories." This step is used to prove the necessity of the finite-witness condition.
The paper also studies how large witnesses must be. They define a measure called positive separation width. This records the smallest uniform bound on witness size when such a bound exists. There are three levels: a fixed finite bound, unbounded finite witnesses (every target has some finite witness but no single finite bound works), and no finite-witness assignment at all. The authors show every level actually occurs: countable families can be handled with singleton witnesses; they give explicit families that realize every finite width; and they show some unions of families require unbounded finite witnesses.