Readit News logoReadit News
dontwearitout commented on The Case That A.I. Is Thinking   newyorker.com/magazine/20... · Posted by u/ascertain
mentos · 2 months ago
What’s crazy to me is the mechanism of pleasure or pain. I can understand that with enough complexity we can give rise to sentience but what does it take to achieve sensation?
dontwearitout · 2 months ago
This is the "hard problem of consciousness". It's more important than ever as machines begin to act more like humans, but my takeaway is we have no idea. https://en.wikipedia.org/wiki/Hard_problem_of_consciousness
dontwearitout commented on The Illustrated DeepSeek-R1   newsletter.languagemodels... · Posted by u/amrrs
itissid · a year ago
I am using the 32Gb distilled model on my local 3090 with Continue in VSCode. It beats everything out of the water.
dontwearitout · a year ago
How many tokens/s do you get on a 3090? With the extra tokens for the internal monologue, is it still performant enough for smooth VSCode integration?
dontwearitout commented on Psilocybin bests SSRI for major depression in first long-term comparison   medscape.com/viewarticle/... · Posted by u/Thomvis
idunnoman1222 · a year ago
Really? name one.
dontwearitout · a year ago
Dissociatives would work, like dextromethorphan or ketamine. Psychedelics are a subset of hallucinogens.
dontwearitout commented on Psilocybin bests SSRI for major depression in first long-term comparison   medscape.com/viewarticle/... · Posted by u/Thomvis
cubefox · a year ago
Unfortunately it's hardly possible to do proper case control studies with psilocybin, since the psychedelic effects cause unblinding. The participants know whether they are in the treatment or control group.

> Normally the journey is quite inward, so patients do not require active support during the psychedelic experience [around 6 hours]. Sometimes they do require some hand-holding, or helping them to 'let go', or breathing exercises. The important part is the integration work that comes afterwards," Barba added. [...]

> However, [Rucker] noted, it is also possible that the results reflect biased reporting between groups. This is more likely here because studies involving psilocybin tend to attract those with positive preconceptions about psilocybin and negative preconceptions about conventional antidepressants

dontwearitout · a year ago
I've never found it compelling that blinding isn't possible for drug-naive patients. There are other drugs that could induce a "trip" and an unfamiliar individual could mistake for a minor psychedelic experience.
dontwearitout commented on The Third Atomic Bomb   lflank.wordpress.com/2024... · Posted by u/dxs
pfannkuchen · a year ago
I think this is neutrons emitted from each collision. I’m interested in the energy of each neutron while it is in flight.
dontwearitout · a year ago
The energy of neutrons isn't really analogous to the energy of atoms in chemical reactions, but absolutely affects the reaction dynamics. The "cross section", or interaction probability, is a strong function of neutron speed. In bombs the neutrons don't get a chance to slow down, but in reactors you try to reduce them to "room temperature" speeds using collisions with light, inert nuclei (the moderator). Here's a diagram showing the interaction probability vs. neutron speed for a few isotopes of uranium: https://tinyurl.com/u235-cross-section
dontwearitout commented on The Third Atomic Bomb   lflank.wordpress.com/2024... · Posted by u/dxs
pfannkuchen · a year ago
> So in principle if you just form a large enough ball of Pu-239, it would go critical

Don't neutrons lose some energy as they transit through the material? That would make this bounded in some respect anyway.

dontwearitout · a year ago
They certainly can, see https://en.wikipedia.org/wiki/Resonance_escape_probability. The all-important number in nuclear reactions is "k", the average number of child neutrons a single neutron will produce. The neutron population follows an equation something like N = exp((k - 1) * t). For k<1, you get exponential decay, and for k>1, you get exponential growth (until everything becomes a plasma and k changes). Check out https://en.wikipedia.org/wiki/Six_factor_formula.
dontwearitout commented on RLHF is just barely RL   twitter.com/karpathy/stat... · Posted by u/tosh
nickpsecurity · a year ago
It sounds really negative about RLHF. Yet, if I read on them correctly, that’s a big part of how ChatGPT and Claude got so effective. There’s companies collecting quality, human responses to many prompts. Companies making models buy them. Even the synthetic examples come from models that largely extrapolate what humans wrote in their pre-training data.

So, I’m defaulting on RLHF is great in at least those ways until an alternative is empirically proven to be better. I also hope for larger, better, open-source collections of RLHF training data.

dontwearitout · a year ago
Claude notably does not use RLHF, but uses RLAIF, using a LLM to generate the preferences based a "constitution" instead of human preferences. It's remarkable that it can bootstrap itself up to such high quality. See https://arxiv.org/pdf/2212.08073 for more.
dontwearitout commented on Self-Compressing Neural Networks   arxiv.org/abs/2301.13142... · Posted by u/bilsbie
nyrikki · a year ago
Unfortunately dendritic compartmentalization, spike timing etc are still not present. All efforts at models of SNNs that I know of have hit problems like riddled basins so far, that is what to look for to move past the limits of perceptron based networks IMHO.

As PAC learning with autograd and perceptrons is just compression, or set shattering, this paper is more of an optimization method that reduces ANN expressiveness through additional compression. Being able to control loss of precision is exciting though.

It may help in some cases, especially for practical use cases, but their unaddressed mention of potential problems with noisy loss functions needs to be addressed.

Human biological neurons can do XOR in the dendrites without hitting the soma at all is another example.

If you haven't heard about dendritic compartmentalization and plasticity, here is a paper.

https://www.cell.com/neuron/fulltext/S0896-6273(11)00993-7

> In conclusion our results support the view that experience can drive clustered synaptic enhancement onto neuronal dendritic subcompartments, providing fundamental architecture to circuit development and function

dontwearitout · a year ago
Are dendritic sub-compartments necessary to explicitly model, or does this work just imply that biological neurons are complicated and are better modeled as a multi-layered artificial network, rather than a single simple computational unit?

Similarly, do you think that spiking networks are important, or just a specific mechanism used in the brain to transmit information, which dense (or sparse) vectors of floats do in artificial neural networks?

dontwearitout commented on What causes migraines? Study of 'brain blackout' offers clues   nature.com/articles/d4158... · Posted by u/kungfudoi
strictnein · a year ago
I get migraines from two situations:

1. Stress. Significant stress can lead to migraines and I can feel them slowly start to build in the upper front of my brain above my left eye (or at least that's what it feels like). This can be stress from work or from kids or whatever.

2. Blips. I don't know how to describe these really. It's like my brain doesn't quite know how to process what's going on. An example: I gave my kids some ice cream for a snack one day after asking my wife if I should and her saying yes. 5 minutes later, she comes into the kitchen and says "Do we have any ice cream for the kids?". I respond with "Yes, I just gave them some, like we discussed." Her response: "We should give the kids some ice cream."

Now, that's a little bit of a weird conversation, and I think she was distracted by someone messaging her on her phone, but my brain just kind of "blipped" and didn't quite know how to handle it and it was instant blurred vision.

dontwearitout · a year ago
Your "blip" anecdote is super interesting. I know that exact sensation of disorientation (but without the migraines thankfully), and I'm curious if this has been studied in depth anywhere.
dontwearitout commented on An interview with AMD CEO Lisa Su about solving hard problems   stratechery.com/2024/an-i... · Posted by u/wallflower
Nullabillity · 2 years ago
https://en.wikipedia.org/wiki/AI_winter

It keeps being hyped up again every once in a while years, but it has never, will never, panned out in practice.

dontwearitout · 2 years ago
I don't know if you're out of the loop but the AI scene has dramatically changed in the past few years. We are solidly out of the AI winter.

u/dontwearitout

KarmaCake day211December 4, 2022View Original