Self-hosting LLMs, is it worth the setup?
With the advent of DeepSeek, I was thinking if I should consider self-hosting open source LLMs vs using OpenAI APIs. Who here has done this already? And what are your main reasons, privacy or cost?
people have been doing this for a while now? cost is one factor obviously, but privacy, security, and offline use comes to mind.