Why do people host LLMs at home when processing the same amount of data from the internet to train their LLM will never be even a little bit as efficient as sending a paid prompt to some high quality official model?
inb4 privacy concerns or a proof of concept this is out of discussion, I want someone to prove his LLM can be as insightful and accurate as paid one. I don’t care about anything else than quality of generated answers
If you ask other people for their reasoning and opinions, it doesn’t really make any sense to put something “out of the discussion”, does it? :P
But no, if you have no qualms about sharing your innermost feelings, sexual preference or illegal plans with those that have an explicit desire to exploit that information then there is little reason to attempt something as complicated and wasteful as self-hosting your own LLMs.
Well, VC is greedy by design. A VC-funded business will never be optimized for longevity, a good product or happy customers. They may achieve those things en passant, but they’re never the objective.
For example: Any case of “there is not enough people paying” can also be rendered as “the scale and moving speed of the business is way off”.