Readit News logoReadit News
nomadpenguin commented on 'World Models,' an old idea in AI, mount a comeback   quantamagazine.org/world-... · Posted by u/warrenm
daxfohl · 2 days ago
Yeah, I can't even get them to retain a simple state. I've tried having them run a maze, but instead of giving them the whole maze up front, I have them move one step at a time, tell them which directions are open from that square and ask for the next move, etc.

After a few moves they get hopelessly lost and just start wandering back and forth in a loop. Even when I prompt them explicitly to serialize a state representation of the maze after each step, and even if I prune the old context so they don't get tripped up on old state representations, they still get flustered and corrupt the state or lose track of things eventually.

They get the concept: if I explain the challenge and ask to write a program to solve such a maze step-by-step like that, they can do that successfully first-try! But maintaining it internally, they still seem to struggle.

nomadpenguin · 2 days ago
There are specialized architectures (the Tolman-Eichenbaum Machine)* that are able to complete this kind of task. Interestingly, once trained, their activations look strikingly similar to place and grid cells in real brains. The team were also able to show (in a separate paper) that the TEM is mathematically equivalent to a transformer.

* https://www.sciencedirect.com/science/article/pii/S009286742...

nomadpenguin commented on Claude says “You're absolutely right!” about everything   github.com/anthropics/cla... · Posted by u/pr337h4m
elif · 23 days ago
I've spent a lot of time trying to get LLM to generate things in a specific way, the biggest take away I have is, if you tell it "don't do xyz" it will always have in the back of its mind "do xyz" and any chance it gets it will take to "do xyz"

When working on art projects, my trick is to specifically give all feedback constructively, carefully avoiding framing things in terms of the inverse or parts to remove.

nomadpenguin · 23 days ago
As Freud said, there is no negation in the unconscious.
nomadpenguin commented on Recovering from AI addiction   internetaddictsanonymous.... · Posted by u/pera
Aurornis · 2 months ago
Gabor Maté is popular, but he’s an example of an influencer who has one tool (trauma treatment) and applies it to everything. His approach is extremely reductive. Many people get addicted to drugs simply because they like taking the drugs and have poor self control, not because they’re avoiding trauma.

It’s another example of something that isn’t really correct for everyone but can be useful to get people to go to a therapist and get treatment.

nomadpenguin · 2 months ago
He also believes that he can remember full memories from when he was 3 months old. There is no evidence that this is possible.
nomadpenguin commented on Spaced repetition systems have gotten better   domenic.me/fsrs/... · Posted by u/domenicd
barrell · 4 months ago
I implemented free recall into FSRS pretty easily. Granted, it’s only for language learning, and I have it set up to work in a free recall friendly way (you don’t learn cards, you learn actual words and morphemes) but it’s been working for a few weeks now. I’m working on a product video atm, but once that’s done my next task (sometime this week) is to clean up the UI and merge it to master.

I almost never see someone talk about free recall so I was too excited to see it mentioned not to comment

nomadpenguin · 4 months ago
How are you handling scheduling with FSRS? The challenge that I quickly saw was that it was difficult to figure out when you should advance a segment of information. If you get 80% of the info right, should it be advanced? What happens to the 20% you missed? How do you prevent yourself from missing the same 20% every time it comes around?
nomadpenguin commented on Spaced repetition systems have gotten better   domenic.me/fsrs/... · Posted by u/domenicd
InkCanon · 4 months ago
There's some UX problems of SRS (that I'm working on) that makes it high friction 1) Time taken to create cards 2) Need for self marking 3) Creates a one to one mapping of prompt-answer 4) If you're an autodidact, you have to teach yourself first (alternatively called understanding, scaffolding, etc)

More fundamentally, SRS isn't a superpower because it's just very specific to creating a direct prompt retrieval. Generalization is poor. Even creating a graph of knowledge, is a chain of edges between bits of knowledge, isn't done very well here.

And I suspect there's a very deep, fundamental difference between recollection knowledge and logical-modeling knowledge. Recollection seems very similar to a dictionary access, and if you recorded the time to recall in humans I suspect they'd all be constant. But learning the knowledge of a logical model, like of a mathematical concept, appears to be vastly different and have very different time to compute.

Proponents of SRS will point out logical models need facts as well, like formulas, lemmas, etc. Which is true. But if you already grasped it before you'd grasp it faster the second time. So the practical use of SRS is a significant step above having a very well sorted and labeled notebook, but still way below becoming a genius.

nomadpenguin · 4 months ago
Poor generalization (overtraining on prompts) and loss of context over time are the biggest issues I've found with them. Slow card creation workflows and needing to rate your own reviews are merely UX issues -- losing context and losing generalization make SRS actively harmful when used for some topics.

There's 2 solutions I've thought of but haven't tried implementing:

1. A free-recall based approach. Free recall allows you to operate at a higher level of organization and connect concepts at lower levels. However, how you would schedule SRS with free recall is not clear.

2. Have an LLM generate questions on-the-fly so that you don't overtrain on prompts. You might also instruct the LLM to create questions that connect multiple concepts together. The problem with this approach is that LLMs are still not so good at creating good test questions.

nomadpenguin commented on Baby is healed with first personalized gene-editing treatment   nytimes.com/2025/05/15/he... · Posted by u/jbredeche
philsnow · 4 months ago
I thought the evolutionary impetus for fetal hemoglobin was because it greatly increases the efficiency of fetal oxygen uptake across the placental interface?

From shadowgovt:

> I have seen no literature on whether having fetal RBCs in adulthood has any benefits or drawbacks (besides changing the affinity ratio for their fetus if the patient gets pregnant

This was exactly the question that popped into my mind when I read about switching from normal adult RBCs to fetal RBCs: does this therapy reduce the likelihood of carrying a baby to term?

nomadpenguin · 4 months ago
Yes, that is true. I phrased that badly -- it's more that we didn't take the evolutionary branch where we retain the fetal hemoglobin because it is maladaptive in adults.
nomadpenguin commented on Baby is healed with first personalized gene-editing treatment   nytimes.com/2025/05/15/he... · Posted by u/jbredeche
shadowgovt · 4 months ago
Gene therapies are pretty incredible. Some of them are still making a button-hole with a machete, but that's relative to the previous medical intervention of a button-hole with a tank's main gun.

One of the treatments for sickle-cell involves switching off the gene that makes the malfunctioning red blood cells, but of course that's not sufficient; you'd stop making red blood cells completely and you'd die. So it's combined with a modification that switches on a gene that all humans express pre-birth that causes your body to make "super-blood": red blood cells with significantly more binding points for oxygen. This is necessary because a fetus gets oxygen from its mother's blood, so the increased binding affinity is useful for pulling the oxygen towards the fetus at the placental interface. After birth, expression of that gene is disabled and regular RBC genes switch on.

So the therapy doesn't "fix" sickle RBCs; it disables the body's ability to make them and re-enables fetal RBCs! I have seen no literature on whether having fetal RBCs in adulthood has any benefits or drawbacks (besides changing the affinity ratio for their fetus if the patient gets pregnant, I imagine increased-affinity RBC could help for athletics... But I also imagine it requires more iron to generate them so has dietary impact).

nomadpenguin · 4 months ago
High affinity RBCs would actually be a disadvantage for athletics. You actually don't need very high affinity to pick up oxygen from the lungs -- your lungs are comparatively extremely high in oxygen. What matters more is being able to drop the oxygen off in peripheral tissues. Higher affinity means that it's harder to actually deliver the oxygen, which is why we evolutionarily developed the switch away from fetal hemoglobin.
nomadpenguin commented on New antibiotic that kills drug-resistant bacteria found in technician's garden   nature.com/articles/d4158... · Posted by u/ascorbic
DeathArrow · 5 months ago
>you need to catalog all the phages you find in a database and search for one that can target the specific bacteria the patient has been infected with.

Most of the time the doctor doesn't know the exact pathogen you are infected with. He'll suspect a bacterian infection of some kind and prescribe a wide range antibiotic.

Doing what you suggest will require changing the way we do medicine. Which might not be a bad thing but requires some determination.

nomadpenguin · 5 months ago
This is correct, it's called empiric treatment. If a patient comes in with altered mental status and neck rigidity, you don't have time to take a lumbar puncture and culture bacteria. I don't know anything about phage treatment, but from what the other commenter said, it seems like then you'd have to do some sort of PCR test as well. You simply don't have time for any of that -- your only choice is to blast them with vancomycin + ceftriaxone.
nomadpenguin commented on Grok3 Launch [video]   x.com/xai/status/18916997... · Posted by u/travelhead
Davidzheng · 7 months ago
I use em-dashes pretty often--it's a nice way to transition phrases...
nomadpenguin · 7 months ago
You're using two en dashes to approximate it -- few people have the en dash character on hand.
nomadpenguin commented on Rethinking addiction as a chronic brain disease   nytimes.com/2024/09/03/he... · Posted by u/prismatic
mystified5016 · a year ago
People get so upset when confronted with the fact that humans, like all animals, are largely clockwork machines driven by chemistry.

Like it or not, you (yes, you) are a slave to your internal chemistry. No amount of willpower or happy thoughts will cause your hormones or neurotransmitter levels into the homeostasis you want. If your chemistry is off, your physical and emotional behavior will be off.

You are a sentient pile of molecular machines ticking along because the chemistry happens to work out. There is nothing special about you, you're exactly like every other plant, animal, and fungus on this planet.

So yes, plenty of mental, behavioral, and physical disorders arise from chemical imbalances. If you take this fact, consider what happens when you indtroduce foreign and extremely powerful chemicals into such a complex organic system.

If you come back with the assertion that addiction is a question of willpower, you didn't understand the assignment.

nomadpenguin · a year ago
> No amount of willpower or happy thoughts will cause your hormones or neurotransmitter levels into the homeostasis you want.

Behavioral-only therapies are effective, even if they're not as effective as we'd like. We have the ability to modulate our own chemistry.

u/nomadpenguin

KarmaCake day77January 14, 2022
About
https://scatteredunoriginal.com/
View Original