iiinova — where your digital self keeps evolving

Open on Bluesky →

Alfonso² Peterssen @mukel.bsky.social · 16/11/2024

buff.ly/40KmT0t Graal compiler: +10% faster inference with the latest early access build. New features: batched prompt processing & AVX512 support.

GitHub - mukel/llama3.java: Practical Llama 3 inference in Java

Practical Llama 3 inference in Java. Contribute to mukel/llama3.java development by creating an account on GitHub.