A 4 bit 8B model needs about 5 to 6 GB of memory. That fits most laptops sold in the last three years.
Install Ollama, run one command, and you are chatting with it offline. No account, no API key.
www.autolearningagents.com/run-ai-local...
#LocalAI