Writingdorky (u/Writingdorky)

Writingdorky commented on An embarrassingly simple approach to recover unlearned knowledge for LLMs arxiv.org/abs/2410.16454... · Posted by u/PaulHoule

yalogin · 10 months ago

This is the first time I am learning about model unlearning. I hope someone can answer this for me - how does federated learning ensure that model unlearning is not happening?

Writingdorky · 10 months ago

You prope the trained model, delete/kill the weights and than you are done.

On federated learning, you just make sure to keep this mechanism in the right stage of your pipeline

Writingdorky commented on M4 MacBook Pro apple.com/newsroom/2024/1... · Posted by u/tosh

lukev · 10 months ago

I really respect Apple's privacy focused engineering. They didn't roll out _any_ AI features until they were capable of running them locally, and before doing any cloud-based AI they designed and rolled out Private Cloud Compute.

You can argue about whether it's actually bulletproof or not but the fact is, nobody else is even trying, and have lost sight of all privacy-focused features in their rush to ship anything and everything on my device to OpenAI or Gemini.

I am thrilled to shell out thousands and thousands of dollars to purchase a machine that feels like it really belongs to me, from a company that respects my data and has aligned incentives.

Writingdorky · 10 months ago

You are just joking right?

From a skill and trust point of view, Google is doing a lot better than apple will ever.

Including ondevice AI

Writingdorky commented on New Mac Mini with M4 apple.com/newsroom/2024/1... · Posted by u/victorbjorklund

etempleton · 10 months ago

I have to think economies of scale are coming into play for Apple. They can cut deals for chips and other components at a scale no one else is really capable of and they have the luxury of being able to pay up front in advance if they need to.

Writingdorky · 10 months ago

I mean yes for sure but apple always had a high margin. I'm pretty sure they did not suddenly become 'nice'.

Would be interesint to know though if the margin stayed the same and they literaly just save a lot of money.

Writingdorky commented on AI Flame Graphs brendangregg.com/blog//20... · Posted by u/JNRowe

have_faith · 10 months ago

> Imagine halving the resource costs of AI ... based on extreme estimates such savings could reduce the total US power usage by over 10% by 2030

Is that implying that by 2030 they expect at least 20% of all US energy to be used by AI?

Writingdorky · 10 months ago

The data source is linked and is based on the ARM Datacenter Energy prediction.

But i don't think its too far fetched.

The compute needed for digital twins, simulating a whole army of robots than uploading it to the robots, who sitll need a ton of compute, is not unrealistic.

Cars like Tesla have A TON of compute build in too.

And we have seen what suddenly happens to an LLM when you switch the amount of parameters. We were in a investment hell were it was not clear in what to invest (crypto, blockchain and NFT bubble bursted) but AI opened up the sky again.

If we continue like this, it will not be far fetched that everyone has their own private agent running and paying for it (private / isolated for data security) + your work agent.

Writingdorky commented on New Mac Mini with M4 apple.com/newsroom/2024/1... · Posted by u/victorbjorklund

etempleton · 10 months ago

What a great little computer at a very reasonable price. A few interesting things with this announcement:

1. Interesting that they did not have this as part of an event. I think this either means they do not have much else to share around the Mac right now or the opposite, there just won't be room to talk about the iMac or Mac Mini. I am leaning towards the former as a I suspect the other computers in their lineup will just receive a spec bump soon.

2. On the product page (https://www.apple.com/mac-mini/) Apple highlights a number of third party accessories. Notably the PS5 controller and several keyboards and mice from different manufacturers. This seems small, but it would have been almost blasphemy under the jobs era.

3. This is quite the little powerhouse. Honestly it is so good it eliminates the need for most people to even consider the Mac Studio.

Writingdorky · 10 months ago

Thats actually a really good price.

The mac book air with the M chip was absolutly a steal already. I'm surprised by this.

Is that some thing to allow cheaper MX / Arm architecture in DCs? Is getting Apple affordable oO?!

Writingdorky commented on The Battery Revolution Is Finally Here insideevs.com/features/73... · Posted by u/xbmcuser

throwaway81523 · 10 months ago

This is pretty interesting. It's about battery tech advances (solid state batteries, and high-silicon anodes in li-ion batteries) that will supposedly give a significant jump to power and energy density in EV batteries. Nothing about cost per KWH. Solid state might not be so great in terms of cycle life.

Right now I'm not in the EV market but am impressed by seeing LiFePO4 batteries at under $100 per KWH retail, for possible use at home with off-grid solar. See places like batteryhookup.com if you want some.

Writingdorky · 10 months ago

It could make sense for you to consider an EV with bi-directional charging. For off-grid solar, you can charge your truck/car/EV for free or/and extend your off-grid battery by using your car to de/uncharge it for your home.

A 100kWh battery can help you out when you come back home if you know you can charge it the next day.