iiinova — where your digital self keeps evolving

jitLLM

@jitllm.io

9 followers 6 following 1 posts

Java Inference Tornado toolkit | Powered by @tornadovm.org | jitllm.io

Posts Replies Media

Reposted by jitLLM

Christos Kotselidis @kotselidis.net · 7h

Our latest addition to the TornadoVM family. Blazing fast AI inference at native speed!

053

jitLLM @jitllm.io · 8h

Can Java compete with llama.cpp/ollama? YES! With @jitllm.io! jitLLM uses NVIDIA CUDA features and libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput! jitLLM is empowered by @tornadovm.org and will be soon in @langchain4j.dev and @quarkus.io. github.com/beehive-lab/...

094

Reposted by jitLLM

TornadoVM @tornadovm.org · 9h

Next week we will be in @devoxx.com and speak about @tornadovm.org, @jitllm.io and how we accelerate Java on GPUs, using #NVIDIA native libraries! Come and talk to us, to learn more! #opensource #Java #AI #TornadoVM #jitLLM #GPU

075