NightlyDev (u/NightlyDev)

NightlyDev commented on Apple M3 Ultra apple.com/newsroom/2025/0... · Posted by u/ksec

johntitorjr · 10 months ago

Lots of AI HW is focused on RAM (512GB!). I have a cost-sensitive application that needs speed (300+ TOPS), but only 1GB of RAM. Are there any HW companies focused on that space?

NightlyDev · 10 months ago

Most recent GPUs will do. An older RTX 4070 is over 400 TOPS, the new RTX 5070 is around 1000 TOPS, and the RTX 5090 is around 3600 TOPS.

NightlyDev commented on Apple M3 Ultra apple.com/newsroom/2025/0... · Posted by u/ksec

mrtksn · 10 months ago

Let's say you want to have the absolute max memory(512GB) to run AI models and let's say that you are O.K. with plugging a drive to archive your model weights then you can get this for a little bit shy of $10K. What a dream machine.

Compared to Nvidia's Project DIGITS which is supposed to cost $3K and be available "soon", you can get a specs matching 128GB & 4TB version of this Mac for about $4700 and the difference would be that you can actually get it in a week and will run macOS(no idea how much performance difference to expect).

I can't wait to see someone testing the full DeepSeek model on this, maybe this would be the first little companion AI device that you can fully own and can do whatever you like with it, hassle-free.

NightlyDev · 10 months ago

The full deepseek R1 model needs more memory than 512GB. The model is 720GB alone. You can run a quantized version on it, but not the full model.

NightlyDev commented on Apple's M4 Max chip is the fastest single-core performer in consumer computing twitter.com/LeakerApple/s... · Posted by u/retskrad

HumblyTossed · a year ago

Both of those chips cost more than an mac mini. 170W !!!!! The mac is, what, 20W?

NightlyDev · a year ago

The CPUs aren't cheap, but they don't cost more than the Mac mini.

The Mac mini will definitely draw more than 20W. TDP numbers can also not be compared between manufacturers at all. And last but not least, for a single core test, maximum power consumption is irrelevant.

Dead Comment

NightlyDev commented on M4 MacBook Pro apple.com/newsroom/2024/1... · Posted by u/tosh

szundi · a year ago

In my country you can buy a device and write off in 2 years, VAT reimbursed, then scrap it from the books and you sell it to people without tax payed to people who otherwise would pay a pretty hefty VAT. This decreases your loss of value to like half.

NightlyDev · a year ago

I don't think tax evasion is something one should recommend people do.

NightlyDev commented on Security research on Private Cloud Compute security.apple.com/blog/p... · Posted by u/todsacerdoti

NightlyDev · a year ago

This marketing is dumb, and if Apple believes that not even they themselves can get access to the information running on the platform, then they could put their money where their mouth is. Increase the max bounty reward from $50 000 to $50 000 000 000 with no other rules than if you can get access to users' request data without having the phone it's sent from, then you get the money, and Apple will not legally pursue the attacker.

Is it as secure as they say? Then it doesn't matter if all the money Apple has is the reward, because nobody can get it. A max bounty of $50 000 for "Accidental or unexpected data disclosure due to deployment or configuration issue" is silly low.

NightlyDev commented on Why TCP needs 3 handshakes pixelstech.net/article/17... · Posted by u/thunderbong

dpig_ · a year ago

it ? is time What What ?

NightlyDev · a year ago

Who is this? What? No! You called me!

Deleted Comment

NightlyDev commented on Throwable tactical camera transmits 360° panoramic thermal images newatlas.com/technology/t... · Posted by u/thunderbong

jameshart · a year ago

Terminology-wise, what’s the better way to communicate that something captures a truly omnidirectional spherical view, not just 360° in a circle? Seems this article has gone for ‘360° panoramic’ but to me that implies blind spots above and below, but the camera placements on this device seem to have full spherical coverage. Shouldn’t they call it a 41,253 square degree camera?

NightlyDev · a year ago

You just said it: Omnidirectional, meaning in every direction :)

NightlyDev commented on Learning to Reason with LLMs openai.com/index/learning... · Posted by u/fofoz

gradus_ad · a year ago

Interesting sequence from the Cipher CoT:

Third pair: 'dn' to 'i'

'd'=4, 'n'=14

Sum:4+14=18

Average:18/2=9

9 corresponds to 'i'(9='i')

But 'i' is 9, so that seems off by 1.

So perhaps we need to think carefully about letters.

Wait, 18/2=9, 9 corresponds to 'I'

So this works.

-----

This looks like recovery from a hallucination. Is it realistic to expect CoT to be able to recover from hallucinations this quickly?

NightlyDev · a year ago

Did it hallucinate? I haven't looked at it, but lowercase i and uppercase i is not the same number if you're getting the number from ascii

u/NightlyDev

KarmaCake day455June 28, 2016View Original