By looking at the paper, memory needed per layer seems to be higher than transformer architecture. Pretty sure that would be blowing up the vram of gpu at scale.
Readit NewsDeleted Comment
darkbatman commented on The Dragon Hatchling: The missing link between the transformer and brain models arxiv.org/abs/2509.26507... · Posted by u/thatxliner
darkbatman commented on Cerebras systems raises $1.1B Series G cerebras.ai/press-release... · Posted by u/fcpguru
Its so useful to use Cerebras api for other tasks too not just coding with qwen coder but even simpler things like lets say analysing with gpt-120 oss or llama.
Just plug it in with normal chat interface like Jan or Cherry studio and its incredibly fast.
darkbatman commented on Launch HN: Strata (YC X25) – One MCP server for AI to handle thousands of tools · Posted by u/wirehack
We kinda use https://github.com/googleapis/genai-toolbox but for databases looking forward if klavis provide more or general solution.
Ideally when we are writing agents we need mcp to support auth, custom headers because by design when deploying for saas we need to pass around client params to be able to isolate client connections.
We do token optimisation and other smart stuff to save token money. Looking forward to try this as well if this solves similar problems as well
Claude has really gone downhill in the last month or so. They made a change to move the CLAUDE.md from the system prompt to being occasionally read in, and it really deprioritizes the instructions to the same attention level as the code it's working on.
I've been trying out Codex the last couple days and it's much more adherent and much less prone to lying and laziness. Anthropic says they're working on a significant release in Claude Code, but I'd much rather have them just revert back to the system as it was ~a month ago.
true, I was using Cline/Roocode from almost an year and it always made sure to read things from memory-bank which i really liked. Claude has gone downhill from August mid for me and often it doesn't follow instructions from claude.md or forget things mid-way.
Mostly agree with article, though what happens in few years when juniors will eventually become senior.
Personally seeing trend juniors are relying so much on AI that they can't even explain what they wrote even in interview or coding assignments or even PR. Its like blackbox to them.
I believe then we would see the higher impact or may be by then its solved problem already.
darkbatman commented on Agent Client Protocol (ACP) agentclientprotocol.com/o... · Posted by u/vinhnx
With already https://agentcommunicationprotocol.dev (ACP) same name seems confusing now. even though differences are there in both.
darkbatman commented on Train a 70b language model at home (2024) answer.ai/posts/2024-03-0... · Posted by u/amrrs
Would be nice to see some benchmarks.
Also from my experience you need more power to get some significant result. Mostly fine tuning would work if base model is very close to what you are trying to achieve and you won't be much happy with the results though.
Also context length becomes an issue trying to fit in with gpu with lesser ram.
Are there any load test results available, we would like to use this at zenskar but at high scale really need it to work.
System merges and final are definitely unpredictable so nice project.
Is it similar to rethinkdb, I remember using RethinkDB for similar use case for live queries running directly on database layer back in 2016.