Why do people host LLMs at home when processing the same amount of data from the internet to train their LLM will never be even a little bit as efficient as sending a paid prompt to some high quality official model?
inb4 privacy concerns or a proof of concept
this is out of discussion, I want someone to prove his LLM can be as insightful and accurate as paid one. I don’t care about anything else than quality of generated answers
Why do people host LLMs at home when processing the same amount of data from the internet to train their LLM will never be even a little bit as efficient as sending a paid prompt to some high quality official model?
inb4 privacy concerns or a proof of concept this is out of discussion, I want someone to prove his LLM can be as insightful and accurate as paid one. I don’t care about anything else than quality of generated answersIf you ask other people for their reasoning and opinions, it doesn’t really make any sense to put something “out of the discussion”, does it? :P
But no, if you have no qualms about sharing your innermost feelings, sexual preference or illegal plans with those that have an explicit desire to exploit that information then there is little reason to attempt something as complicated and wasteful as self-hosting your own LLMs.
“Why do people do X, when in my opinion if you disregard the two top reasons for doing X, it’s pointless? Prove to me that it would be better!?”
I’m not saying in advance that it’s pointless, it’s just your far-fetched preconception. I want to know if there are any further arguments for hosting LLMs besides the two I ruled out in advance for being too obvious. Furthermore, I think that since you moved so quickly to mockery, there are no other reasons than privacy and tinkering
Why would you need a reason other than privacy? Or for that matter any reason you want or nobe at all.
To be fair, he is just asking for more reasons than privacy. No reason not to give him them, and also okay to say we don’t think there is any.
No, they said they “ruled out” privacy for “obvious reasons”.
Obviously mockable statement.
