redacted (u/redacted)

redacted commented on Ollama's new app ollama.com/blog/new-app... · Posted by u/BUFU

ashirviskas · a month ago

And why should anyone use it or ollama itself?

redacted · a month ago

No one should use ollama. A cursory search of r/localllama gives plenty of occassions where they've proven themselves bad actors. Here's a 'fun' overview

https://www.reddit.com/r/LocalLLaMA/comments/1kg20mu/so_why_...

There are multiple (far better) options - eg LM studio if you want GUI, llama.cpp if you want the CLI that ollama ripped off. IMO the only reason ollama is even in the conversation is it was easy to get running on macOS, allowing the SV MBP set to feel included

redacted commented on Zed now predicts your next edit with Zeta, our new open model zed.dev/blog/edit-predict... · Posted by u/ahamez

card_zero · 7 months ago

I don't need insurance, I don't need no parkin' space

And if you try to clamp my horse, he'll kick you in the face

redacted · 7 months ago

Can't believe you're getting downvoted for one of Ireland's greatest cultural contributions. Behold The Rubberbandits, Horse Outside (helpfully timestamped to the lyric in question)

https://www.youtube.com/watch?v=ljPFZrRD3J8&t=85s

redacted commented on How I run LLMs locally abishekmuthian.com/how-i-... · Posted by u/Abishek_Muthian

dividefuel · 8 months ago

What GPU offers a good balance between cost and performance for running LLMs locally? I'd like to do more experimenting, and am due for a GPU upgrade from my 1080 anyway, but would like to spend less than $1600...

redacted · 8 months ago

Nvidia for compatibility, and as much VRAM as you can afford. Shouldn't be hard to find a 3090 / Ti in your price range. I have had decent success with a base 3080 but the 10GB really limits the models you can run

redacted commented on macOS command-line tools you might not know about saurabhs.org/advanced-mac... · Posted by u/Gadiguibou

LanceH · 2 years ago

Hoping for something in WSL land.

redacted · 2 years ago

`vmIdleTimeout` in .wslconfig might be an option? Win 11 only though

redacted commented on macOS command-line tools you might not know about saurabhs.org/advanced-mac... · Posted by u/Gadiguibou

LanceH · 2 years ago

Anyone know of a Ubuntu on WSL equivalent?

redacted · 2 years ago

https://learn.microsoft.com/en-us/windows/powertoys/awake to keep Windows itself awake?

redacted commented on macOS command-line tools you might not know about saurabhs.org/advanced-mac... · Posted by u/Gadiguibou

bpye · 2 years ago

Caffeinate is definitely the one I miss most on Windows. Super handy to keep your machine awake whilst some task is ongoing.

redacted · 2 years ago

If you're able to install PowerToys it includes a utility for this

https://learn.microsoft.com/en-us/windows/powertoys/awake

redacted commented on Foliate – A simple and modern eBook viewer for Linux desktops johnfactotum.github.io/fo... · Posted by u/floweronthehill

jdlyga · 3 years ago

Foliate is excellent! I even got it working through WSL on Windows. I use it for O’Reilly books and other epub books. It’s much easier to reach books as an epub than a pdf since the text, etc adapt to your screen. The problem was historically that epub viewers were generally bad on desktop.

redacted · 3 years ago

If anyone is interested in using Foliate through WSL, https://opticos.github.io/openinwsl/ is great - it lets you double-click a file in Windows, then Foliate in WSL2 launches to view it

redacted commented on iPhone 14 Pro faced 'unprecedented' setback leading to removal of new GPU macrumors.com/2022/12/23/... · Posted by u/tosh

7speter · 3 years ago

Does Apple need to catch up with Qualcomm and MediaTek in terms of raw gpu performance when Apple can optimize software and apis given to developers to work on its hardware? Or am I really out of date and is their public evidence of Qualcomm and Mediattek outperforming apple's hardware in real world workloads?

Nvidia primarily makes add on GPU's, if I understand their business correctly. Apple integrated a GPU onto its m2 (or whichever chip is used in their studio) that performs comparably to the 3060, and even beat the the 3090 in some benchmarks/workloads. I think that's pretty impressive.

redacted · 3 years ago

Its more the fact that we're talking about Apple catching up at all. Android SOCs have been generationally behind Apple for a long time (and MediaTek in particular as a "budget" option), but now in the GPU space that is reversed.

The situation on the desktop/laptop is muddied by CUDA and other Nvidia-exclusive tech - while the M1/M2s indeed trade blows with laptop parts like the 3060 in some specific tasks, once CUDA comes into play Nvidia walks it (unfortunately IMO, even AMD can't compete there and its holding the industry back)

redacted commented on iPhone 14 Pro faced 'unprecedented' setback leading to removal of new GPU macrumors.com/2022/12/23/... · Posted by u/tosh

redacted · 3 years ago

I'm really curious as to why Apple has been unable to reproduce their leap in CPUs in the GPU space.

It's not exactly surprising when Nvidia parts handily beat the M1/M2, but when both Qualcomm and Mediatek have better GPU performance _and_ efficiency [0] something is up, especially given just how far ahead Apple has been in mobile CPU

[0] https://twitter.com/Golden_Reviewer/status/16056046174164295...

redacted commented on Show HN: Komorebi – A tiling window manager for Windows 10/11 written in Rust github.com/LGUG2Z/komoreb... · Posted by u/bsnnkv

yellow_postit · 3 years ago

Haven't found any hotkeys, but for mouse-based it's nice and simple. My favorite is still Spectacle for MacOS, haven't found a perfect equivalent for Windows yet.

redacted · 3 years ago

In 22H2 it's fully keyboard drivable

  - Win+Z brings up the layout menu
  - number keys select the layout, then where in the chosen layout the current window should go
  - arrow keys then let you select the other windows to complete the tiling

So if I want Firefox (current window) and Slack side by side

  - Win-Z inside FF
  - 1 selects side-by-side
  - 1 again snaps FF to the left (2 would snap to right, and so on for more complex layouts)
  - Slack is the first suggested window (MRU), so Space to snap right

It's not as quick as the mouse interface yet - especially with the mouse improvements MS made - but seems like it could be easily automated with eg Autohotkey

u/redacted

KarmaCake day923May 26, 2009

About

Physicist, tinkerer, procrastinator

View Original