Readit News logoReadit News
pepijndevos commented on Llama.cpp supports Vulkan. why doesn't Ollama?   github.com/ollama/ollama/... · Posted by u/buyucu
lolinder · 7 months ago
So many here are trashing on Ollama, saying it's "just" nice porcelain around llama.cpp and it's not doing anything complicated. Okay. Let's stipulate that.

So where's the non-sketchy, non-for-profit equivalent? Where's the nice frontend for llama.cpp that makes it trivial for anyone who wants to play around with local LLMs without having to know much about their internals? If Ollama isn't doing anything difficult, why isn't llama.cpp as easy to use?

Making local LLMs accessible to the masses is an essential job right now—it's important to normalize owning your data as much as it can be normalized. For all of its faults, Ollama does that, and it does it far better than any alternative. Maybe wait to trash it for being "just" a wrapper until someone actually creates a viable alternative.

pepijndevos · 7 months ago
ramalama seems to be trying, it's a docker based approach.
pepijndevos commented on Proximal Policy Optimization for Playing Super Mario Bros   github.com/uvipen/Super-m... · Posted by u/seesawtron
pepijndevos · 5 years ago
How far away is this from the top speedruns? The readme mentions OpenAI beating Dota 2 pros with the same models, so who knows??

It seems like an AI would not "play by the rules" and can easily detect weird edge cases and shortcuts. But as far as I can tell from the small GIFs, it's not doing any particular glitches.

pepijndevos commented on Pinephone – “Community Edition: PostmarketOS” Linux smartphone   store.pine64.org/product-... · Posted by u/fsflover
pepijndevos · 5 years ago
I'm really looking forward to get one of these things when they come with decent warranty and without dead pixels. I'm as eager as anyone to get away from the walled garden duopoly, but since it's not suitable as a daily driver yet, maybe I'll be able to restrain myself and not buy it.
pepijndevos commented on Linux kernel in-tree Rust support   lore.kernel.org/lkml/CAKw... · Posted by u/littlestymaar
pepijndevos · 5 years ago
Pleasantly surprised by Linus response. IIRC his attitude to C++ was that it should be refused if only to keep C++ programmers out.
pepijndevos commented on Climate models are running red hot, and scientists don’t know why   bloomberg.com/news/featur... · Posted by u/montalbano
leifdenby · 6 years ago
There is a big observational campaign happening right now that is trying to get to the heart of this called EUREC4A (main website: http://eurec4a.eu and information sheet: http://eurec4a.eu/fileadmin/user_upload/eurec4a/2019/Press/E...). The key uncertainty between different climate models is whether shallow clouds in the tropics (which in general cool the Earth through radiation) will disappear or not and make our planet even warmer - some models predict this (!)

We are 100s of individuals from more than 30 national and international partner institutions with planes, drones, ships, ground stations and autonomous buoys trying to understand how and why these clouds form, how that links to their environment, dust from Africa, the ocean current, the jetstream aloft, etc. The positions of the different platforms can be seen live on the main website and the data we are producing is appearing on there too.

If you have any questions about what we're doing I'd be very happy to help or point you towards the right people :)

pepijndevos · 6 years ago
How do these models address overfitting? I'm sure this is taken good care of, but from just reading the article it almost sounds like some details were added to make it fit recent changes better.
pepijndevos commented on Tech’s Next Revolution Might Be Open Source Semiconductors   bloomberg.com/news/articl... · Posted by u/jseliger
jleahy · 6 years ago
> And that's just talking about DIGITAL semiconductors where you compile HDL to pretty much generate the transistors from foundry cell libraries. So you have to sign an NDA to get the cell library, but you can at least release your code.

Yes you can release your code, but you can't release your netlist or GDS-II. There's no guarantee that somebody else will be able to take the same HDL and close timing, even with the same foundry libraries (say if they are using a different tool, or different options). You'll also need things like clock-gating cells, memories, IOs (at a minimum) and those are foundry specific, so those would need to be abstracted out in some way.

> For analog chips, you can't do anything. An analog design highly depends on the parameters of the transistors you use, so before you even BEGIN designing, you have to sign an NDA to get the transistor models and you can NEVER open source an analog design.

Now this is where I disagree. Sure you can't open source your analog GDS-II, but maybe that's not the way to go. In my opinion what you want to do is build a foundry independent PDK for a generic 28nm, 40nm or whatever node using PTM models. A well designed analog circuit needs to be relatively independent of specifics, otherwise it's not going to work across all corners (this is more true for modern nodes than the kind of nodes the old textbooks talk about) and it'll be difficult to port to another process. So there's a good chance that analog circuits built for 'generic 28nm' or 'generic 40nm' could be ported to any foundries process (of course the PDK needs to be well designed). Yes you won't be able to push things to the limit as the DRC will be wider, but analog rarely needs to go to the limit. You could probably take the same approach for digital, but that's a lot more open source stuff to build.

Check out OpenRAM and FreePDK45 for academic projects taking this approach. Unfortunately FreePDK45 is only available to those with an academic email (despite being called 'open source'), which makes me very sad.

pepijndevos · 6 years ago
Yea, I think this is an interesting approach. But FreePDK45 slides mention that it's not designed for manufacture, and there does not appear to be an easy upgrade path. So you could design a chip with FreePDK, release the design, and then redo the whole thing in a vendor PDK.

I talked to someone who worked on AsicOne, and he said that even if you make your own PDK and draw your own transistors and everything, you'll still have to sign an NDK to do the sign-off and what not. I'm not intimately familiar with the whole process myself, but from what I understand it is basically impossible to have an open source analog design that you can actually manufacture. (sure, you can make a theoretical toy thing, but if you can't manufacture it, who cares?)

pepijndevos commented on Tech’s Next Revolution Might Be Open Source Semiconductors   bloomberg.com/news/articl... · Posted by u/jseliger
pepijndevos · 6 years ago
Open source semiconductors is such a broad area, and sadly only a tiny spec of it is open source: The HDL code that describes the digital circuit.

Everything else is very experimental at best. These days the FOSS FPGA tools are finally getting some traction, with Yosys and Nextpnr. But AsicOne tried to make an ASIC with open source, and faced endless troubles.

For ASIC there is basically QFlow, which is quite old, but used successfully to tape out a chip in the past, and there is OpenRoads, which is very new, experimental and ambitious. There are still major gaps in these tools, so in the end you inevitably have to sign an NDA and use proprietary tools and libraries.

And that's just talking about DIGITAL semiconductors where you compile HDL to pretty much generate the transistors from foundry cell libraries. So you have to sign an NDA to get the cell library, but you can at least release your code.

For analog chips, you can't do anything. An analog design highly depends on the parameters of the transistors you use, so before you even BEGIN designing, you have to sign an NDA to get the transistor models and you can NEVER open source an analog design.

The small dot of light at the end of the tunnel are projects like Minimal Fab, who make more accessible fabrication lines with open transistor models.

The crazy thing is that back in the days there were lambda rules, which were open rules anyone could use to design and model with. But with sub-micron devices, these scalable rules no longer scale, so fabs started producing secret models for their specific process.

I'm hopeful that after FPGA, and digital ASIC, analog will be next to be revolutionized.

pepijndevos commented on Every Google result now looks like an ad   twitter.com/craigmod/stat... · Posted by u/cmod
pepijndevos · 6 years ago
This pushed me over the edge to switch to DuckDuckGo. So far so good.
pepijndevos commented on Using an /e/ phone as a desktop or laptop   nexedi.com/NXD-Document.B... · Posted by u/fermigier
pepijndevos · 6 years ago
I find it difficult to evaluate an Android for my phone. Currently running AOSP (actually phh-treble) rather than any fork that adds any significant features.

In particular it's hard to tell if any particular fork is just a one man hobby project, a fork of a fork, or has any significant work behind it.

Of course the big one is LineageOS, but they seem to make specific phone images, mostly for high-end phones, rather than generic system images for my low-end phone.

The list of generic system images is extremely long and not all that helpful: https://github.com/phhusson/treble_experimentations/wiki/Gen...

I ended up chosing phh-treble because it doesn't add any BS, promises quick updates, and serves as a base for many other roms, lending it some reliability. It's pretty much AOSP with hardware fixes.

That said, it doesn't do some pretty basic things like automatic brightness and night mode, or a PIN timeout. So maybe that's eventually drive me to try another ROM...

pepijndevos commented on Nitter: Alternative Twitter Front-End   github.com/zedeus/nitter... · Posted by u/pcr910303
pepijndevos · 6 years ago
Can I actually see tweets from the people I follow, or only really look at specific profiles?

u/pepijndevos

KarmaCake day1511May 20, 2010View Original