local AI

A local AI server can feel almost instantaneous when one person is using it. Add a second conversation and it may still feel fine. Add several people with

A local LLM being slow does not automatically mean that your GPU is too weak. The model may be spilling into system RAM, the CPU may be doing more work