Yes the cost of building software dropped by 90%.
However, the cost of software maintenance went up by 1000% . Lets hope you don't need to ever add a new business rule or user interface to your vibe coded software.
Readit Newsmanishsharan commented on Has the cost of building software dropped 90%? martinalderson.com/posts/... · Posted by u/martinald
manishsharan commented on How AI is transforming work at Anthropic anthropic.com/research/ho... · Posted by u/mfiguiere
I am curious : could GenAI have written the paper "Attention is all you need"? We were trapped in CNN RNN architectures for a while : could genAi have arrived at a better architecture ?
This is propaganda from the fascist ruling party BJP/RSS. After the Bihar SIR exercise, not even a single illegal immigrant was found. All this talk of illegal immigrants is classic anti muslim dog whistle.
BS. I grew up in Delhi. We used to have a large open space where I and neighborhood kids used to play cricket . Eventually the whole area converted to slums with people from Bangladesh. They took over the whole area. I was too young to care about ethnicity but the loss of my cricket field still bothers me. My neighbor was a bank manager and he once said that the government politicians forced him to give "loans" to Bangladeshi people , with no documents and only their thumbprint,before elections to those people to ensure victory of the ruling party.
manishsharan commented on You should write an agent fly.io/blog/everyone-writ... · Posted by u/tabletcorry
The whole post is about not using frameworks; all you need is the LLM API. You could do it with plain HTTP without much trouble.
When I ask for Patterns, I am seeking help for recurring problems that I have encountered. Context management .. small llms ( ones with small context size) break and get confused and forget work they have done or the original goal.
manishsharan commented on You should write an agent fly.io/blog/everyone-writ... · Posted by u/tabletcorry
How.. please don't say use langxxx library
I am looking for a language or library agnostic pattern like we have MVC etc. for web applications. Or Gang of Four patterns but for building agents.
Food production is a huge one. We don't want highly optimized farming where only the most efficient growers feed everyone else because that has the risk of global famine if something fails there. The more a system is optimized, the closer to failure it is. Same goes for all other kinds of production but food is really important compared to, say, CPUs or cars.
Fine .. say your country has a several years of drought and bad harvest. What happens then ? Do you trade then ?
Or .. lets say due to weather, your farmers can not grow enough oranges or some fruit which drives up local prices. Should only the richest people in your country get to eat fruits ?
Or you discover lithium deposits that your national industry can not use . Should you let that just sit there knowing it could make your province prosperous if traded.
manishsharan commented on Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop · Posted by u/threeturn
I am here to hear from folks running LLM on Framework desktop (128GB). Is it usable for agentic coding ?
manishsharan commented on Production RAG: what I learned from processing 5M+ documents blog.abdellatif.io/produc... · Posted by u/tifa2up
Have you measured your latency, and how sensitive are you to it?
>> Have you measured your latency, and how sensitive are you to it?
Not sensitive to latency at all. My users would rather have well researched answers than poor answers.
Also, I use batch mode APIs for chunking .. it is so much cheaper.
manishsharan commented on Production RAG: what I learned from processing 5M+ documents blog.abdellatif.io/produc... · Posted by u/tifa2up
Thanks for sharing. TIL about rerankers.
Chunking strategy is a big issue. I found acceptable results by shoving large texts to to gemini flash and have it summarize and extract chunks instead of whatever text splitter I tried. I use the method published by Anthropic https://www.anthropic.com/engineering/contextual-retrieval i.e. include full summary along with chunks for each embedding.
I also created a tool to enable the LLM to do vector search on its own .
I do not use Langchain or python.. I use Clojure+ LLMs' REST APIs.
In my experience claude/codex to wrangle CDK constructs be complicated, it frequently hallucinates constructs that simply do not exist, options that are not supported etc.
While they can generate IaaC component mostly okay and these problems can be managed, Iterations can take a lot of time, each checkpoint, goes the deploy/ rollback cycles in CF. CloudFormation is also not particularly fast, other IaaC frameworks are not that different.
Running an agent to iterate until it gets it right is just more difficult with IaaC refactor projects. Hallucinations, stuck loops and other issues, can quickly run the infra bill up not to mention security.
I got a nice and comprehensive infrastructure requirement document out of this.
Now I am using it to create Terraform repo , deploying it via OpenTofu and comparing it to my existing AWS cloud formation . This part is still a WIP .