anko (u/anko) - Readit News

anko commented on Indexing 100M vectors in 20 minutes on PostgreSQL with 12GB RAM blog.vectorchord.ai/how-w... · Posted by u/gaocegege

q3k · 7 days ago

> $272 monthly + GPU cost

Imagine paying $250+/mo for 32GB of RAM and 4 VCPUs. No wonder Amazon is swimming in cash, the markup on this is bonkers.

anko · 6 days ago

100% this, i've been finding metal is getting very compelling against aws. For example latitude has 4 real cores and 32 GB of ram for $92/month.

https://www.latitude.sh/pricing/c2-small-x86?gen=gen-2

hetzner doesn't even have specs this low from what i can tell!

https://www.hetzner.com/dedicated-rootserver/#cores_threads_...

anko commented on Infinite Tool Use snimu.github.io/2025/05/2... · Posted by u/tosh

anko · 7 months ago

I have been thinking along these lines myself. Most of the time, if we need to calculate things, we'd use a calculator or some code. We wouldn't do it in our head, unless it's rough or small enough. But that's what we ask LLMs to do!

I believe we juggle 7 (plus or minus 2) things in our short term memory. Maybe short term memory could be a tool!

We also don't have the knowledge of the entire internet in our heads, but meanwhile we can still be more effective at strategy/reasoning/planning. Maybe a much smaller model could be used if the only thing it had to do is use tools and have a basic grasp on a language.

anko commented on Tantivy – full-text search engine library inspired by Apache Lucene github.com/quickwit-oss/t... · Posted by u/kaathewise

anko · 2 years ago

I would love if tantivy had a single file format, eg. .tantivy extension so you could drag it into a notebook like you can with .sqllite files.

anko commented on Show HN: LangCSS – An AI Assistant for Tailwind langcss.com/... · Posted by u/langcss

anko · 2 years ago

my demo ran out of time before it did anything :(

anko commented on Amazon Bets $150B on Data Centers Required for AI Boom bloomberg.com/news/articl... · Posted by u/thelastgallon

xcv123 · 2 years ago

The cost of computing decreases over time. No one will pay $100 Billion to train GPT-6. That is absurd. The current top supercomputer in the world (Frontier) cost $600M.

It is rumoured that GPT-4 was trained on 10,000 A100 processors released in 2020. Total cost is $100M at $10k each.

Today they can buy more powerful hardware and train much larger models for the same cost.

https://nvidianews.nvidia.com/news/nvidia-blackwell-platform...

https://www.cerebras.net/product-chip

anko · 2 years ago

> The cost of computing decreases over time. No one will pay $100 Billion to train GPT-6. That is absurd. The current top supercomputer in the world (Frontier) cost $600M.

Just wanted to ask the question - do you think frontier has provided more or less value to the world than gpt-4?

anko commented on Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking arxiv.org/abs/2403.09629... · Posted by u/hackerlight

astrange · 2 years ago

That can be expressed as text prediction. You output version 1 then output editing instructions or rewritten versions until you're done.

The real issue is running out of the input window.

anko · 2 years ago

> The real issue is running out of the input window.

isn't this what abstractions are for? you summarise the key concepts into a new input window?

anko commented on Intel Continues Prepping the Linux Kernel for X86S phoronix.com/news/Linux-6... · Posted by u/sertsa

anko · 2 years ago

I wonder if AMD would adopt this too?

anko commented on Unveiling the big leap in Ruby 3.3's IRB railsatscale.com/2023-12-... · Posted by u/todsacerdoti

Falmarri · 2 years ago

Gross. Python is a million times better than ruby to read and write

anko · 2 years ago

> Gross. Python is a million times better than ruby to read and write

why do you think that?

anko commented on Web Rendering Patterns mburakerman.github.io/blo... · Posted by u/rasmero

anko · 3 years ago

which one is elixir liveview?

anko commented on Phoenix 1.7 is View-less germanvelasco.com/blog/ph... · Posted by u/todsacerdoti

emerongi · 3 years ago

A type system saves a lot of time when reading code that has been written by other people and has evolved over time. In Elixir, I often end up adding debugging statements to code and running it, just to check the data structures.

A type system also gives additional assurances when changing code that is used from many places. It's so nice to make a change and have additional confidence in it because the type system is happy with it.

I can't think of many bugs that I've seen that would have been prevented by a type system. I'd still like to have a type system though, it's sort of extra documentation within the code.

anko · 3 years ago

I agree 100% and I'd add, static typing helps when you inherit a poorly written codebase. This unfortunately is probably 99% of codebases in the wild. It has happened so many times when i've seen a lack of test coverage, a lack of understanding of the codebase but the business requirement to make changes.

Having a type system in place makes minor refactoring possible in this nightmare scenario.

I have been in the situation of poorly written ruby codebases and I can tell you 100% that I would prefer to have a poorly written java codebase with its static types. I prefer ruby as a language but man when it's bad, it's terrible. Just trying to work out the intent of a function when multiple types are passed in as the same argument over the codebase is pure hell.