Putting aside all the arguments about LLMs, intelligence, and mental health of those seeking such companions…if you’re going to go down this route, you absolutely do it locally.