Exactly why expert steering should be valued.
Readit Newsguardiang commented on LLMs get lost in multi-turn conversation arxiv.org/abs/2505.06120... · Posted by u/simonpure
I wonder about OpenAI's moat. Thanks to advances in hardware and rapidly improving open-source ML frameworks, it's getting significantly easier and cheaper to replicate what they've built over time. That's not the case for most startups: it's not really any easier to build an Uber clone today than it was ten years ago.
OpenAI depends on spending vast amounts of money to stay a year or two ahead of the competition. I'm doubting whether that's a justified tradeoff.
Open source just caught up to GPT-4, which was released over a year ago. You don't think all of the advances in hardware don't also play into their hands? They have GPT-5 in the pipeline and are likely hard at work planning and prepping for GPT-6.
A year or two beyond the competition, at this point, is their moat.
> abandoning all notion of structure and organization ... optimizing fully for capture over retrieval, then relying on search tools and proximity
I did this too - obsidian's daily note feature is fantastic, and you can extract out pages from it if you want/need to dedicate a document for a specific thing. Since it's just markdown, search is quick - and being able to use regex if I need to is awesome. The graph view, showing connections between notes is great if you create notes on specific subjects, and link them together, or pull sections out to explain more in depth - but it's not really that necessary unless you're building your own knowledgebase, which like all documentation suffers from rot over time.
As long as your note-ing tool supports a good enough search that you can find things again, then I think it doesn't really matter what you use - as you said, writing it down is the important part.
I decided to use ChatGPT as my journal when they made it so they wouldn't be training on my data. Was talking to it all the time anyway, now I can pull the export whenever and just vectorize the whole thing... timestamps and all.
guardiang commented on You never control the arc of your career samestuffdifferentday.net... · Posted by u/speckx
You have to end your reliance on others to have control.
guardiang commented on How Meta trains large language models at scale engineering.fb.com/2024/0... · Posted by u/mfiguiere
Posts like this underscore why the smart money is betting on Google as the long term AI winner. Meta, Microsoft, OpenAI, etc. are trying to address problems with consumer video cards and spending billions to try and out bid each other to win Nvidia's favor - while Google is on their 6th generation of custom silicon.
Literally the only thing that can stop Google now is the fact they keep bringing Microsoft and Oracle flunkies into leadership positions.
Google is old like MetLife, relative to each's respective industry. Both are carrying too much baggage and are top heavy. As a result, I personally don't think Google will be able to keep pace with OpenAI in the long run.
guardiang commented on Microsoft AI spying scandal: time to rethink privacy standards spectrum.ieee.org/online-... · Posted by u/walterbell
Trying to understand consumer privacy behaviors outside the prevalent social contract that the vast majority of people operate under is bound to missinterpret what is happening and why.
We live in a regulated "supermarket" economy. What surfaces on a screen is entirely analogous to what surfaces on a shelf: People check the price and make their choices based on taste, budget etc. They are not idiots, they operate under a simplifying assumption that makes life in a complex world possible.
The implicit assumption central to this way of organising the economy is that anything legally on sale is "safe". That it has been checked and approved by experts that know what they are doing and have the consumer interest as top priority.
People will not rush back home to their chemistry labs to check what is in their purchased food, whether it corresponds to the label (assuming that such a label even exists) and what might be the short or long term health effects. They dont have the knowledge, resources and time to do that for all the stuff they get exposed to.
What has drifted in the digital economy is not consumer standards, it is regulatory standards. Surfacing digital products with questionable short and long term implications for individuals and society has become a lucrative business, has captured its regulatory environment and will keep exploiting opportunities and blind spots until there is pushback.
Ultimately regulators only derive legitimacy from serving their constituencies, but that feedback loop can be very slow and it gets tangled with myriad other unrelated political issues.
It's way past time that consumer-first became modus operandi for Tech. LLMs (GPT-4 quality or better) have the potential to enable that future.
It'll take an avalanche of high quality products coming out of small-footprint companies. Each company utilizing LLMs to shore up any limitations due to their size, and every one of them having a consumer-first mindset from the get-go. It can be done.
guardiang commented on Sam and Greg's response to OpenAI Safety researcher claims twitter.com/gdb/status/17... · Posted by u/amrrs
This isn't like climate change. "AI" is a successful marketing term for a loosely related collection of technologies that push the boundaries of what computation has hitherto been capable of. There are very real disagreements between very real experts on just how dangerous these new technologies are and just how far they'll actually be able to push the boundaries of computation. Comparing skepticism about AI alarmism to climate change denial is just lazy internet rhetoric.
(One major difference between the two is that billion-dollar corporations stand to gain quite a bit if they can persuade governments that AI is so dangerous that it needs to be tightly regulated, so they're incentivized to play up the dangers. With climate change it's the opposite: the billion-dollar corporations are incentivized to downplay the risks so they can continue business as usual.)
Large Language Models are no joke and if you think they are the I suggest you learn how to use them properly.
Even if AI doesn't ever go "evil" itself, that doesn't mean people that don't like other people won't use it to more effectively kill those people. All that's really needed is a capable programmer willing to give the LLM the tools it needs, along with funds and access. The LLM could hire humans to do the work it's lacking at. These things are already capable of all that, plus our world went mostly digital during the pandemic... they have easy egress because humans have made it so, even though that was meant for other humans to use. If you don't think they are scary, in the wrong hands, then you are lacking in imagination.
> OpenAI have several times being argue that they are the only ones to be responsible enough to develop powerful AI, and that others should not be allowed to play
Can you give examples of where they’ve said that?
He likely can't without heavy paraphrasing and/or not providing full context for the quote.
They've said stuff along the lines of "good luck trying, but we're gonna win so...". That's just the kind of confidence you want to see in the frontrunner (imo). They've also encouraged regulation, but it's a smart idea to be the one to frame the conversation.
We're getting more and more information thrown at us each day, and the AIs are adding to that, not reducing it. The ability to summarise dense and specialist information (I'm thinking error logs, but could be anything really) just means more ways for people to access and view that information who previously wouldn't.
How do we, as individuals, best deal with all this information efficiently? Currently we have a variety of interfaces, websites, dashboards, emails, chat. Are all these necessary anymore? They might be now, but what about the next 10 years. Do I even need to visit a companies website if can get the same information from some single chat interface?
The fact we have AIs building us websites, apps, web UI's just seems so...redundant.