Readit News logoReadit News
eis commented on Cloudflare Sandbox SDK   sandbox.cloudflare.com/... · Posted by u/bentaber
chandureddyvari · 2 months ago
You can’t compare these with regular VM of aws or gcp. VM are expected to boot up in milliseconds and can be stopped/killed in milliseconds. You are charged per second of usage. The sandboxes are ephemeral and meant for AI coding agents. Typical sandboxes run less than 30 mins session. The premium is for the flexibility it comes with.
eis · 2 months ago
I think you can absolutely compare them and there is no added flexibility, in fact there is less flexibility. There is added convenience though.

For the huge factor in price difference you can keep spare spot VMs on GCP idle and warm all the time and still be an order of magnitude cheaper. You have more features and flexibility with these. You can also discard them at will, they are not charged per month. Pricing granularity in GCP is per second (with 1min minimum) and you can fire up firecracker VMs within milliseconds as another commenter pointed out.

Cloudflare Sandbox have less functionality at a significantly increased price. The tradeoff is simplicity because they are more focused for a specific use case for which they don't need additional configuration or tooling. The downside is that they can't do everything a proper VM can do.

It's a fair tradeoff but I argue the price difference is very much out of balance. But then again it seems to be a feature primarily going after AI companies and there is infinite VC money to burn at the moment.

eis commented on Cloudflare Sandbox SDK   sandbox.cloudflare.com/... · Posted by u/bentaber
eis · 2 months ago
Cloudflare Containers (and therefore Sandbox) pricing is way too expensive. The pricing is a bit cumbersome to understand by being inconsistent with pricing of other Cloudflare products in terms of units and split between memory, cpu and disk instead of combined per instance. The worst is that it is given in these tiny fractions per second.

Memory: $0.0000025 per additional GiB-second vCPU: $0.000020 per additional vCPU-second Disk: $0.00000007 per additional GB-second

The smaller instance types have super low processing power by getting a fraction of a vCPU. But if you calculate the monthly cost then it comes to:

Memory: $6.48 per GB vCPU: $51.84 per vCPU (!!!) Disk: $0.18 per GB

These prices are more expensive than the already expensive prices of the big cloud providers. For example a t2d-standard-2 on GCP with 2 vCPUs and 8GB with 16GB storage would cost $63.28 per month while the standard-3 instance on CF would cost a whopping $51.84 + $103.68 + $2.90 = $158.42, about 2.5x the price.

Cloudflare Containers also don't have peristent storage and are by design intended to shut down if not used but I could then also go for a spot vm on GCP which would bring the price down to $9.27 which is less than 6% of the CF container cost and I get persistent storage plus a ton of other features on top.

What am I missing?

eis commented on GPU-Accelerated LLM on an Orange Pi   blog.mlc.ai/2023/08/09/GP... · Posted by u/tosh
jacquesm · 2 years ago
Yes, especially having fact checked output of LLMs would be a nice step in the right direction. Throwing out the hallucinated bits and keeping the good stuff would make LLMs a lot more applicable.
eis · 2 years ago
Isn't that a bit of a holy grail though? If your software can fact check the output of LLMs and prevent hallucinations then why not use that as the AI to get the answers in the first place?
eis commented on The Nanohertz Gravitational-Wave Detection Explained   physics.aps.org/articles/... · Posted by u/raattgift
beders · 2 years ago
I still don't understand what the carrier of gravitational waves is.

How are the waves propagated? Space is not an elastic fabric or water where water molecules transfer potential energy.

Aren't gravitational waves a hint that spacetime is not fundamental, but an emergent property of something else?

eis · 2 years ago
I don't think they are a hint that spacetime is not fundamental. But I do think spacetime has to be some kind of real physical reality.

The modifications of spacetime that we see as effects of gravity are relative changes to our immediate surroundings or reference frame.

Similarly how you can't tell who is actually stationary and who is moving when two objects are in freefall and all you can note is the relative speed between the two, it would be equally valid to say the objects inside spacetime are getting distorted relative to spacetime.

eis commented on Astro: All-in-one web framework designed for speed   astro.build/... · Posted by u/thunderbong
drowsspa · 2 years ago
My phone is literally struggling to even scroll through this page.
eis · 2 years ago
Even on my Macbook with Firefox the site has a strange feel when scrolling. It's not exactly struggling but it feels unnatural and slightly off/slow/uneven. Like it's on the edge of struggling. Bit hard to describe. The effect gets worse towards the mid section of the page with the side scrolling logo circles. I removed that section via dev tools which helped with performance. When I have that part of the page in view I get 80-90% CPU usage of one core. But even after removing it I can saturate a core by scrolling around, especially towards the lower part of the page.

It is indeed one of the worst optimized CSS I've seen in a while. Weird for a project that is all about speed.

eis commented on Astro: All-in-one web framework designed for speed   astro.build/... · Posted by u/thunderbong
promiseofbeans · 2 years ago
Gotta apreciate the way the page icon changes to monochrome when you switch away from the tab.
eis · 2 years ago
If every site did that then it would be harder to quickly spot one in a long list of tabs. A neat trick but I don't think it is a particularily good idea.
eis commented on A conversation with a newspaper owner raided by cops   thehandbasket.substack.co... · Posted by u/celtoid
TheFreim · 2 years ago
> But it was the newspaper owner, not the police chief, who was raided.

That's what the title means.

eis · 2 years ago
The title on HN at the current time [0] says the police chief was raided.

There is only one person mentioned and therefor "his" can only refer to that person. "His" can not refer to the newspaper.

[0] "Paper investigating police chief prior to the raids on his office and home."

eis commented on Wendelstein 7-X: Gigajoule energy turnover generated for eight minutes   ipp.mpg.de/5322229/01_23... · Posted by u/greesil
dale_glass · 2 years ago
Oh, English fail on my part then. I had assumed that 100 millionths of a metre == 100 * 1/1000000.
eis · 2 years ago
The german site of the source speaks of 0.1mm so you were correct

   > bei Toleranzen von teilweise nur 0,1 Millimeter
https://www.ipp.mpg.de/de/aktuelles/presse/pi/2020/01_20

eis commented on Nvidia Launches a 100kb text-to-image model called Perfusion   research.nvidia.com/labs/... · Posted by u/enamya
bogtog · 2 years ago
Yes, although it is decently interesting that a model can be fine tuned by just tweaking a small number of weights and training for just a few minutes
eis · 2 years ago
There is some meat to the story, I agree. But it's not surprising. The fine tuning model of course will be small in file size and not take too long to train because by definition it is applying changes to a small subset of the main model and is trained only on a small amount if input data. You can't use the small tuning model for "Teddies" with a query that has nothing to do with Teddies. You could see these small tuning models as a diff file for the main model. And depending on the user query one can choose an appropriate diff to be applied to improve the result for that specific query.

When you train a model with new inputs to fine tune you can save the weights that got changed to a separate file instead of the main file.

In other words one can see the small tuning models as selectively to be applied updates/patches.

u/eis

KarmaCake day4339November 22, 2010View Original