SilverRubicon (u/SilverRubicon)

SilverRubicon commented on Jan – Ollama alternative with local UI github.com/menloresearch/... · Posted by u/maxloh

roscas · 6 months ago

Tried to run Jan but it does not start llama server. It also tries to allocate 30gb that is the size of the model but my vram is only 10gb and machine is 32gb, so it does not make sense. Ollama works perfect with 30b models. Another thing that is not good is that it make constant connections to github and other sites.

SilverRubicon · 6 months ago

Did you see the feature list? It does not deny that makes connections to other sites.

- Cloud Integration: Connect to OpenAI, Anthropic, Mistral, Groq, and others

- Privacy First: Everything runs locally when you want it to

SilverRubicon commented on Interview Coder is an invisible AI for technical interviews interviewcoder.co/... · Posted by u/swisspol

koliber · 10 months ago

This is a great approach and I like it as well. I did have a few situations where the person could talk shop like an expert but when it came to actually writing some code they failed. I literally had a person fail fizzbuzz that was supposedly senior and talked shop really well.

SilverRubicon · 10 months ago

As a senior developer I had to search for "wtf is fizzbuzz". How many senior developers spend their time solving these kinds of problems?

SilverRubicon commented on The Modern CLI Renaissance gabevenberg.com/posts/cli... · Posted by u/theshrike79

camgunz · a year ago

The strength of these tools is that they are the lowest common denominator. I don't need to worry about `ls` not fitting in an 80 character terminal because its devs "haven't owned a device in the last decade with a screen resolution less than 1920x1080". I don't need to worry about `find` not working because it can't resolve DNS. I know when I SSH into my router, my raspberry pi running pi hole or emulation, my laptop, and my server that my `#!/bin/sh` script works exactly the same.

It was so, so hard to get here. Imagine chaos so maddening that autotools was somehow an improvement.

> The problem is that we cater for the absolute lowest common denominator and completely eschew the vast vast majority of people who don’t require that feature.

Not for nothing, but for most people in the world computers and internet access are an unaffordable luxury. I'm typing this on a machine that cost me $3,700, and in some ways I'm sympathetic to what you're saying. But average world GDP per capita is something like $12,500. Electricity isn't free. Internet access isn't free. Before we start making arguments about catering to the 1% of people fortunate enough to use the fastest machines and networks, we should consider who our actions may close the door on.

SilverRubicon · a year ago

> But average world GDP per capita is something like $12,500. Electricity isn't free. Internet access isn't free.

These people are big users of the command line?