Readit NewsSingle thread performance of 16-core AMD Ryzen 9 9950X is only 1.8x of my poor and old laptop's 4-core i5 performance. https://www.cpubenchmark.net/compare/6211vs3830vs3947/AMD-Ry...
I'm waiting for >1024 core ARM desktops, with >1TB of unified gpu memory to be able to run some large LLMs with
Ping me when some builds this :)
I've built a SWE agent too (for fun), check it out => https://github.com/myriade-ai/autocode
Lack of tools in mini-swe-agent is a feature. You can run it with any LLM no matter how big or small.
We need a new browser fork! Linux way of governance could be awesome; a star leader/programmer- with community and enterprise contributors.
/just switched to librewolf for the short term; after years on firefox since early 0.x days
It has much better performance than all of the code models of similar size, and almost reaches the same HumanEval as Starcoder being 10x smaller in size.
With the small size, it can work with most modern GPUs requiring just 3GB Ram.
You can try self-hosting it in Refact https://github.com/smallcloudai/refact/ and get a local fast copilot alternative with decent suggestions.
Weights and model card https://huggingface.co/smallcloudai/Refact-1_6B-fim.
We would love to hear your feedback!
I see that model type "gpt_refact" in https://huggingface.co/smallcloudai/Refact-1_6B-fim/blob/mai...
Agriculture shaped humans to create buildings, create social classes with different levels of power, create armies, governments and rulers to protect themselves from other tribes. Gradually these grew up became empires and created monotheist religions to substitute animist religions.
The Industrial Revolution shaped humans and culture to move to cities, work in factories/offices instead of home/fields and to think in more abstract terms (math, written words, etc).
Cars shaped human society, governments and urban plans to be heavily dependent on roads and all the car assistance economy. Think Houston/Los Angeles vs. Copenhagen/Amsterdam.
Radio, television and publicity shaped our daily lives to consume a lot of crap we don't really need, from cigarettes to diamond rings.
Social media shaped our political discourse into tribal stupidity and paranoia.
So just use basic Marshall McLuhan: the media is the message. Technology shapes humans and culture. AI will shape humans and culture. We just don't know how.
So I doubt humans with AI will replace humans without.
> right tools allow small models to perform better than undirected tool like bash to do everything.
Interesting enough the newer mini swe agent was refutation of this hypothesis for very large LLMs from the original swe agent paper (https://arxiv.org/pdf/2405.15793) assuming that specialized tools work better.