munksbeer (u/munksbeer)

munksbeer commented on Why was Apache Kafka created? bigdata.2minutestreaming.... · Posted by u/enether

I use MQTT daily. I'm not sure why the commenter suggested it; it is orthogonal to queueing or log streams.

MQTT is a publish/subscribe protocol for large scale distributed messaging, often used in small embedded devices or factories. It is made for efficient transfer of small, often byte sized payloads of IoT device data. It does not replace Kafka or RabbitMQ - messages should be read off of the MQTT broker as quickly as possible. ( I know this from experience - MQTT brokers get bogged down rapidly if there are too many messages "in flight")

A very common pattern is to use MQTT for communications, and then Kafka or RabbitMq for large scale queuing of those messages for downstream applications.

munksbeer · 6 days ago

Thank you.

munksbeer commented on Why was Apache Kafka created? bigdata.2minutestreaming.... · Posted by u/enether

von_lohengramm · 7 days ago

The problem is that writing genuinely performant Java code requires that you drop most if not all of the niceties of writing Java. At that point, why write Java at all? Just find some other language that targets the JVM. But then you're already treading such DIY and frictionful waters that just adopting some other cross-platform language/runtime isn't the worst idea.

munksbeer · 6 days ago

>The problem is that writing genuinely performant Java code requires that you drop most if not all of the niceties of writing Java. At that point, why write Java at all?

The reason is quite well known. Supporting multiple languages is a cost. If you only have to support one language, everything is simpler and cheaper.

With Java, you can write elegant code these days, rely on ZGC, not really worry too much about GC and get excellent performance with quick development cycles for most of your use cases. Then with the same language and often in the same repo (monorepo is great) you can write smarter code for your hot path in a GC free manner and get phenomenal performance.

And you get that with only having one build system, one CI pipeline, one deployment system, some amazing profiling and monitoring tooling, a bunch of shared utility code that you don't have to duplicate, and a lot more benefits.

That's the reason to choose Java.

Of course, if you're truly into HFT space, then they'll be writing in C, C++ or on FPGAs.

munksbeer commented on Why was Apache Kafka created? bigdata.2minutestreaming.... · Posted by u/enether

AtlasBarfed · 7 days ago

Don't implement any distributive technology until aphyr has put it through the paces, and even then... Pilot

munksbeer · 6 days ago

https://aphyr.com/about

"Unavailable Due to the UK Online Safety Act"

:(

munksbeer commented on Why was Apache Kafka created? bigdata.2minutestreaming.... · Posted by u/enether

adev_ · 7 days ago

> Why they'd need Kafka was always our first question, never got a good answer from a single one of them

"To follow the hype train, Bro" is often the real answer.

> If you need a queue, great, go get RabbitMQ, ZMQ, Redis, SQS, named pipes, pretty anything but Kafka.

Or just freaking MQTT.

MQTT has been battle-proven for 25 years, is simple and does perfectly the job if you do not ship GBs of blobs through your messaging system (which you should not do anyway).

munksbeer · 6 days ago

> Or just freaking MQTT.

Disclaimer: I'm a dev and I'm not very familiar with the actual maintenance of kafka clusters. But we run the aws managed service version (MSK), and it seems to just pretty much work.

We send terrabytes of data through kafka asynchronously, because of its HA properties and persistent log, allowing consumers to consume in their own time and put the data where it needs to be. So imagine, many apps across our entire stack have the same basic requirement, publish a lot of data which people want to analyse somewhere later. Kafka gives us a single mechanism to do that.

So now my question. I've never used MQTT before. What are the benefits of using MQTT in our setup vs using kafka?

munksbeer commented on Mark Zuckerberg freezes AI hiring amid bubble fears telegraph.co.uk/business/... · Posted by u/pera

chasd00 · 9 days ago

> If we suppose that ANNs are more or less accurate models of real neural networks

i believe the problem is we don't understand actual neurons let alone actual networks of neurons to even know if any model is accurate or not. The AI folks cleverly named their data structures "neuron" and "neural network" to make it seem like we do.

munksbeer · 9 days ago

This is a bit of a cynical take. Neural networks have been "a thing" for decades. A quick google suggests 1940s. I won't quibble on the timeline but no-one was trying to trick anyone with the name back then, and it just stuck around.

munksbeer commented on Pixel 10 Phones blog.google/products/pixe... · Posted by u/gotmedium

madduci · 10 days ago

Me crying for a newer Nexus 4, the best device in terms of quality/price ever made by Google

munksbeer · 9 days ago

The Nexus 4 camera was rubbish and the GPS was rubbish. It could barely ever get a decent lock meaning navigating with it was a awful. I was so glad to replace that phone.

munksbeer commented on End well, this won't: UK commissioner suggests govt stops kids from using VPNs theregister.com/2025/08/1... · Posted by u/rntn

ryandrake · 11 days ago

Oppression doesn't necessarily have to be deliberately planned by brilliant villains in secret smoky rooms, twirling their mustaches and conspiring against the public. It can easily emerge organically out of hundreds of tiny, stupid decisions made by stupid people.

munksbeer · 11 days ago

I don't think that would explain the assertions by the person I was responding to.

munksbeer commented on End well, this won't: UK commissioner suggests govt stops kids from using VPNs theregister.com/2025/08/1... · Posted by u/rntn

lyu07282 · 11 days ago

I don't think anybody thinks this has anything to do with child safety. It's not a coincidence that the UK, US and the EU, all working on implementing similar surveillance and censorship regimes. The platforms will develop the infrastructure, similar to the GFoC just privatized. The legacy media lost all influence with younger generations, just look at what the vast majority of young people think of Israel now. If the media can't fulfill its role anymore they need a big stick.

munksbeer · 11 days ago

In the UK, most of our elected MPs are idiots. I cannot imagine they're anywhere near intelligent enough to be part of some sophisticated conspiracy while on the face of it saying "save the children". So it can't be coming from the MPs. If this is all a cover for full government control, where is it coming from? Who is doing the push and how are they keeping it secret?

munksbeer commented on Thai Air Force seals deal for Swedish Gripen jets scmp.com/news/asia/southe... · Posted by u/belter

corimaith · 14 days ago

>That's always been the deal.

This is a bit of popular myth on sites like this but isn't supported by economists, historians or people in finance. The total volume of oil trade is small fraction of total global trade or capital flows.

Like I said, the USD is the reserve partly because it's beneficial to these surplus economies to have somebody else holding the bags, but also because there aren't viable alternatives because anybody else who can do it dosen't want to. And given there are 180^180 possible exchanges, a reserve currency will exist for practical reasons.

>I don't actually think there's any law of nature that reserve currency status == de-industrialization.

A currency that assumes reserve currency status will strengthen due to increased demand, thus making their exports more expensive and thus uncompetitive on the international stage. Which is incompatible with the export-driven strategies of the EU, China or Japan, all the main contenders for alternative reserve currencies. If you look at the behaviour of their central banks, when they receive capital inflows, they in turn buy assets elsewhere to offset the appreciation to maintain the value of their currency. But the Fed cannot and dosen't do that.

munksbeer · 11 days ago

> Which is incompatible with the export-driven strategies of the EU, China or Japan, all the main contenders for alternative reserve currencies. If you look at the behaviour of their central banks, when they receive capital inflows, they in turn buy assets elsewhere to offset the appreciation to maintain the value of their currency. But the Fed cannot and dosen't do that.

Late reply. Could you supply some source material to look into this. What "assets elsewhere"?

munksbeer commented on Show HN: NextDNS Adds "Bypass Age Verification" · Posted by u/nextdns

munksbeer · 12 days ago

I hope you understand that every single work-around you see popping up is a result of your support of censorship and verification policy. *Your* support is going to push children onto more dangerous sites and expose their private browsing data to honeypots as they seek ways around this.

If my children were older, I would immediately be educating them on the dangers of this policy and of the dangers of seeking ways around it.

I confess, as I type this, I have a lot of anger at the dangers you're putting children into.