Ollama now supports Jev API for decision models (yes/no, choice, probability) on /v1/systemone endpoint. Local on your machine. Three models are available, Nimble9B answers in 91ms on a M5 Max.
ollama.com/blog/ollama-...
Crossposted with @openvibe.social
ollama.com
Ollama now supports Jev-style decision models · Ollama Blog
Ollama now supports decision models, based on TypeSafe's Jev API for fast, typed decisions. Decision models can now be run at no cost with low latency. Based on text, decision models answer yes-or-no questions, choices and scores about it, with a probability for every option.