Reposted by Christos Kotselidis
jitLLM is part of the @langchain4j.dev 1.21.0 release! 🚀
Read more here: docs.langchain4j.dev/integrations...
#opensource #LLM #GPU #Java #LangChain4j #Inference
docs.langchain4j.dev
jitLLM | LangChain4j
jitLLM runs LLMs in GGUF format inside the JVM.