Readit NewsThe only gripe I remember with it is that all its APIs are weird.
Like instead of normal names, you have Apple-legacy-names for methods/classes.
The direction of major operating systems neutering themselves in favour of deep service integration does not fill one with hope
I also highly doubt that they will somehow later down the line magically change their minds given the millions (maybe over a billion at this point) of dollars invested in things like private cloud compute (1) and challenging the U.K. government (2) in court over E2E cloud backups.
(1) https://security.apple.com/blog/private-cloud-compute/
(2) https://www.reuters.com/technology/court-hearing-reported-be...
And people are surprised software keeps being slow despite increase in compute resources. This is insane.
This stood out to me in the article, as most countries incentivize foreign visitors to use local currencies to boost its strength. However, NK seems to have long ago come to terms it's currency will never hold value, so perhaps they instill this rule to boost their counterfeit money operations, or reserves of foreign currency.
Local, in my experience, can’t even pull data from an image without hallucinating (Qwen 2.5 VI in that example). Hopefully local/small models keep getting better and devices get better at running bigger ones
It feels like we do it because we can more than because it makes sense- which I am all for! I just wonder if i’m missing some kind of major use case all around me that justifies chaining together a bunch of mac studios or buying a really great graphics card. Tools like exo are cool and the idea of distributed compute is neat but what edge cases truly need it so badly that it’s worth all the effort?
Besides that, we are moving towards an era where we won't need to pay providers a subscription every month to use these models. I can't say for certain whether or not the GPUs that run them will get cheaper, but the option to run your own model is game changing for more than you can possibly imagine.