Uncharted territory, ymmv
Readit Newsverdverm commented on State of Economy · Posted by u/adsd19
When it comes to dealing with shitty platforms AI is really the best thing ever. I have had the misfortune of writing automations for Atlassian with their weird handling of refresh keys and had AI not pointed out that Atlassian had the genius idea of invalidating refresh keys after single use, I would have wasted a lot more of my time. For this sort of manual labout, AI is the best tool there is.
One time use refresh keys is not all that uncommon, probably more so than not, but lots of clients handle that for you
Don't you have to keep dismissing incorrect auto-complete? For me I have a particular idea in mind, and I find auto-complete to be incredibly annoying.
It breaks flow. It has no idea my intention, but very eagerly provides suggestions I have to stop and swat away.
fwiw, VS Code has a snooze auto complete button. Each press is 5m, a decently designed feature imo
verdverm commented on No clicks, no content: The unsustainable future of AI search bradt.ca/blog/no-clicks-n... · Posted by u/bradt
verdverm commented on No clicks, no content: The unsustainable future of AI search bradt.ca/blog/no-clicks-n... · Posted by u/bradt
Yeah that has been on my backlog. I admit that I haven't given them too much priority, but at some point I want to try an AI agent that works offline and is sandboxed.
The frontier models like Gemini are so much better than the open weight models you can run at home, night and day difference. I have yet to try the larger open models on H100s
I'm keen to build an agent from scratch with copilot extension being open source and tools like BentoML that can help me build out the agentic workflows that can scale on a beefy H100 machine
verdverm commented on No clicks, no content: The unsustainable future of AI search bradt.ca/blog/no-clicks-n... · Posted by u/bradt
Don't agents still depend on LLMs to produce a human-readable response, rather than as a source of information/knowledge? And aren't they still vulnerable to prompt injection attacks, due to being unable to separate the information/knowledge part vs the prompt, because their prompt "parsing" is coupled to an LLM?
If you give them a fair and reasonable go, you'll discover more than asking leading questions on HN. In example, there are many things you are unaware of as possibilities, like how easy it is to undo code changes to the last checkpoint (copilots chat checkpoint, not git or vcs). They can also make use of all the external tools, knowledge repositories, and search engines we use.
My personal experience has led me to increase my monthly spend, because the ROI is there, the UX is much improved
Hallucinations will never go away, but I put them in the same category as clicking search results to outdated or completely wrong blog posts. There's a back button
verdverm commented on Show HN: An extension to hide garbage comments on Twitter tidy-tweet.netlify.app/... · Posted by u/pomdevv
I could try to implement it. Is there a particular reason ?
I don't trust OpenAI or Anthropic, both tried to charge my card when I hadn't used the service in months, after they expired the money I had already given them (stealing imo)
Google lets me pay as I go
verdverm commented on No clicks, no content: The unsustainable future of AI search bradt.ca/blog/no-clicks-n... · Posted by u/bradt
I call them a "soup" because AFAIK there's no intent behind them:
I'll stop calling them a soup when the part that generates a human-readable response is completely separate from the knowledge/information part; when an untrained program can respond with "I don't know" due to deliberate (/debuggable) mapping of lack of data to a minimal subset of language rules and words that are encoded in the program, rather than having "I don't know" be a series of tokens generated from the training data.
Those are called Agents and already exists today. I've been prompted for more information when the agent realized it didn't have all the context it needs
verdverm commented on No clicks, no content: The unsustainable future of AI search bradt.ca/blog/no-clicks-n... · Posted by u/bradt
Inevitably too you'll get someone scolding you to "check the pins" which you then do and get introduced to that hellish nightmare.
Discord is great for chatting with your friends, gaming, etc. but man it's a horrible knowledge repository.
> horrible knowledge repository
I don't disagree, but that does not change the fact that people have moved from sites like SO to Discord for this purpose.
There are Q&A channels, so not everything is chat, but Discord search is abysmal
Slack is another place where former SO content / answers are happening. Discourse too. The tl;dr is that it has become more fragmented, for better or worse
SO has a related problem to Reddit. Some mods high on their status and power
verdverm commented on No clicks, no content: The unsustainable future of AI search bradt.ca/blog/no-clicks-n... · Posted by u/bradt
Discord is just absolutely worthless for this. Any question that gets asked gets buried in days if not hours. It pretty much guarantees the same basic garbage gets repeated over and over and over forever. Basically the exact opposite of stack overflow.
There are question/answer channels, not everything is chat on Discord