Reposted by Osbert Bastani
Conformal prediction sets are a useful way to capture uncertainty for LLMs & deep learning models. But they're data-hungry! We propose a semi-bandit algo to learn these sets online. Check out our @icmlconf.bsky.social paper: arxiv.org/abs/2405.13268
Work led by Haosen Ge, w/ @obastani.bsky.social
arxiv.org
Stochastic Online Conformal Prediction with Semi-Bandit Feedback
Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the gu...
