I don't think cloud AI will fully go away but I think it'll make less and less sense for consumer facing use cases as the small models become more viable via better training and better hardware acceleration.
@mauve Agree*. The advances in UX / tooling have come a long way already. Tried out Ollama a few days ago after having tinkered with some LLMs maybe a year ago and was shocked at how easily it stood up. Once the tools enable RAG and some other obviously useful capabilities, I don't think I'd ever want to use a cloud AI
* That said, I don't know that I would personally expect cloud AI to stop dominating consumer market. Word processing and file storage and a dozen other computational categories that are relatively easy to do locally have been progressively swallowed by cloud services because
A) the UX is so good, and
B) they're cheap, and
C) the minimum level of technical understanding is very low
I feel like the vast majority of users in 5-10 years will still value those things
@hermeticvm @agregore Oh snap. Is their api stable? Have you tried it out?
@hermeticvm @agregore Ohhh I see. This is for the built in LLM UI they have. I am working on JavaScript APIs for web apps to have access to.
For example, Chrome is working on shipping web APIs for LLM access. I'm planning to release something similar in @agregore in the next week or two.
https://github.com/explainers-by-googlers/prompt-api/blob/main/chrome-implementation-differences.md