Readit News logoReadit News
nicolaslem commented on GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2   magazine.sebastianraschka... · Posted by u/ModelForge
mhitza · 13 days ago
I've been using lightly gpt-oss-20b but what I've found is that for smaller (single sentence) prompts it was easy enough to have it loop infinitely. Since I'm running it with llama.cpp I've set a small repetition penalty and haven't encountered those issues since (I'm using it a couple of times a day to analyze diffs, so I might have just gotten lucky since)
nicolaslem · 13 days ago
I had the same issue with other models where they would loop repeating the same character, sentence or paragraph indefinitely. Turns out the context size some tools set by default is 2k and this is way too small.
nicolaslem commented on Benchmark Framework Desktop Mainboard and 4-node cluster   github.com/geerlingguy/ol... · Posted by u/geerlingguy
jcastro · 16 days ago
Hi Jeff, I'm a linux ambassador for Framework and I have one of these units. It'd be interesting if you would install ramalama in fedora and test that. I've been using that out of the box as a drop in replacement for ollama and everything was GPU accelerated out of the box. It pulls rocm from a container and just figures it out, etc. Would love to see actual numbers though.

Great work on this!

nicolaslem · 16 days ago
I gave it a try on my Strix Halo laptop on Arch. ROCm and everything else worked out of the box with two commands:

    uv tool install ramalama
    ramalama serve <model>

nicolaslem commented on Python performance myths and fairy tales   lwn.net/SubscriberLink/10... · Posted by u/todsacerdoti
ic_fly2 · 18 days ago
It’s a good article on speed.

But honestly the thing that makes any of my programs slow is network calls. And there a nice async setup goes a long way. And then k8 for the scaling.

nicolaslem · 18 days ago
This. I maintain an ecommerce platform written in Python. Even with Python being slow, less than 30% of our request time is spent executing code, the rest is talking to stuff over the network.
nicolaslem commented on Try the Mosquito Bucket of Death   energyvanguard.com/blog/t... · Posted by u/almuhalil
nicolaslem · 24 days ago
I ended up building this entirely by accident. Last summer I wanted to have aquatic plants in my garden, so I made a small container pond.

As you can imagine it quickly got invaded by mosquito larvae. By the time I realized I was getting raided by mosquitos each night, much more than previous years.

After getting hold of the bacteria (not sure if it's completely allowed here, only Amazon would sell it to me) mosquitos are completely gone, in the pond and around.

nicolaslem commented on We benchmarked Cyberpunk 2077 on Mac M1 to M4 – the numbers don't lie   tomsguide.com/gaming/we-b... · Posted by u/high_na_euv
nottorp · a month ago
:)

I have a playstation 5 and i snagged a ps4 disc of cyberpunk 2077 from the bargain bin for next to nothing when it was the scandal of the day that it didn't really work on consoles.

CDProjekt Red being CDProjekt red, that gets me a full free upgrade to whatever the current version of the game is on ps5.

Damned if i'm playing that game without a mouse though. Unless they dumbed down the inventory to the point it's usable with the sticks since the last time i played.

Some games have "console dna". I wouldn't go near the PC version of Elden Ring or Death Stranding. But some have "pc dna". I don't think I want to try to play cyberpunk on a console. Not any of the acceptable to brilliant indies I bought, most of which aren't available on consoles.

Let's put it this way:

I'm going to play the games i please on the hardware i please to play them on. I will not build or buy a bling box that hovers above the ground from all the fans to be able to get 1400 fps at 12k resolution just so I can brag on Twitch.

nicolaslem · a month ago
> I wouldn't go near the PC version of Elden Ring

What's wrong with the PC version of Elden Ring? Of course it needs to be played with a controller but that's hardly a problem.

nicolaslem commented on Sony DTC-700 audio DAT player/recorder   kevinboone.me/dtc-700.htm... · Posted by u/naves
alnwlsn · 2 months ago
Early 2000s. My family used VHS until after the switch to digital TV. Not that we would buy one new, but if we found one at a garage sale for a couple bucks we would take it. Used to have a stock of 2 or 3 on hand at a time. They were all late 90's / early 2000s models that everyone was dropping in favor of DVDs, made as cheap as possible, and would quit working in about 8-10 months. Which meant I got to take apart the broken one - I recall taking apart around a dozen, but some of those were already broken and found in the trash.

Meanwhile, the "basement" VCR my dad bought new in '85 still works to this day, but that one was less programmable, so we always used the cheap ones to record off the air.

nicolaslem · 2 months ago
I vividly remember the day when at age 10 my grandfather let me disassemble a broken VCR. It is the day I learned to treat electronics with large capacitors with respect.
nicolaslem commented on Start your own Internet Resiliency Club   bowshock.nl/irc/... · Posted by u/todsacerdoti
nunobrito · 2 months ago
It isn't about the price.

Try to avoid understanding this difficulty from your own shoes, but rather from the shoes of communities very limited on what is reachable to them from a technical, financial and logistical point of view.

I know you can solve it easily. I can solve it even more easily myself.

Now see any disaster area, see any remote area. Setting up Wi-Fi is invariably never a priority for those in such situations. Even as things settle, it is still more practical to share files directly with each other.

When you see from that perspective then you are on the domain of realistic solutions rather than keyboard level on virtual forum.

nicolaslem · 2 months ago
I don't disagree with that, but this point has nothing to do with the comment I replied to.
nicolaslem commented on Start your own Internet Resiliency Club   bowshock.nl/irc/... · Posted by u/todsacerdoti
nunobrito · 2 months ago
Maybe for professional communications. For cases where the grid is gone, you will quickly see how quickly you stop using electricity for luxuries such as that one.

At most you will be able to charge smartphones and small devices with solar panels. Keeping a larger Wi-Fi router running only on solar? Very seldom.

nicolaslem · 2 months ago
The price of solar panels and batteries keeps falling. You can go an Amazon today and get a setup that can power a switch/router/AP 24/7 in winter for a few hundred dollars.
nicolaslem commented on BYD's Five-Minute Charging Puts China in the Lead for EVs   spectrum.ieee.org/byd-meg... · Posted by u/pseudolus
ordx · 3 months ago
Can someone with knowledge comment if charging a battery this way will significantly decrease its longevity? I remember reading that charging with a low current is advisable to preserve battery health.
nicolaslem · 3 months ago
A good rule of thumbs with most battery chemistries is that they tend to not like both extremes. This is true for temperature, charge capacity, slightly less true for charging current as very low current tend not to degrade the battery.
nicolaslem commented on Intel versus AMD is currently an emotional decision for me   utcc.utoronto.ca/~cks/spa... · Posted by u/goranmoomin
slipofpaper · 3 months ago
AMD has had very good Linux graphics drivers for a while now. The last time I had to fiddle with graphics drivers, I was still using an Nvidia card. AMD just worked out of the box.
nicolaslem · 3 months ago
Ryzen 6000 series user here. I run Arch and the past three years have been a roller-coaster. Suspend/resume works well but the amdgpu crashes are a constant pain. Sometimes it works well for a few weeks, until a kernel update introduces a regression. Regression that gets fixed after a few weeks. Rince and repeat for the past three years. I am seriously considering Intel for my next laptop.

u/nicolaslem

KarmaCake day3237October 20, 2015
About
Personal site: https://lemanchet.fr
View Original