If you're interested in understanding the logic behind how to detect novelty from determinism to PAC-Bayes Learning, we have a preprint at arxiv.org/abs/2501.09331. The reasoning is grounded in computation and information theory.
arxiv.org
Identifying Information from Observations with Uncertainty and Novelty
A machine learning tasks from observations must encounter and process uncertainty and novelty, especially when it is to maintain performance when observing new information and to choose the hypothesis...
