mochomocha (u/mochomocha)

mochomocha commented on Netflix to Acquire Warner Bros about.netflix.com/en/news... · Posted by u/meetpateltech

gizzlon · 2 months ago

> ranking content based on clicks and minutes watched.

I suspect they just push what they want you to watch, like their own content. Seems that way to me at least, based on their quite shitty "recommendations"

mochomocha · 2 months ago

> I suspect they just push what they want you to watch, like their own content.

Having worked close to the recsys folks at Netflix, I can tell you that this statement couldn't be further from the truth.

mochomocha commented on Roc Camera roc.camera/... · Posted by u/martialg

jeswin · 4 months ago

I am actually willing to support DIY camera efforts, but if you're semi-serious about taking pictures, this just wouldn't work. First, Raspberry Pi (I'm guessing this is a CM4/CM5) is a disaster for a camera board. Nobody wants a 20s boot every time you want to take a picture, cameras need to be near instantaneous. And you can't keep it on either, because the RPi can't really sleep. There are boards that can actually sleep, but with fewer sensor options.

Now moving on to the sensor (IMX 519 - Arducam?) - it's tinier than the tiniest sensor found on phones. If you really want to have decent image quality, you should look at Will Whang's OneInchEye and Four-thirds eye (https://www.willwhang.dev/). 4/3 Eye uses IMX294 which is currently the only large sensor which has Linux support (I think he upstreamed it) and MIPI. All the other larger sensors use interfaces like SLVS which are impossible to connect to.

If anyone's going to attempt a serious camera, they need to do two things. Use at least a 1 inch sensor, and a board which can actually sleep (which means it can't be the RPi). This would mean a bunch of difficult work, such as drivers to get these sensors to work with those boards. The Alice Camera (https://www.alice.camera/) is a better attempt and probably uses the IMX294 as well. The most impressive attempt however is Wenting Zhang's Sitina S1 - (https://rangefinderforum.com/threads/diy-full-frame-digital-...). He used a full frame Kodak CCD Sensor.

There is a market for a well made camera like the Fuji X-Half. It doesn't need to have a lot of features, just needs to have ergonomics and take decent pictures. Stuff like proofs are secondary to what actually matters - first it needs to take good pictures, which the IMX 519 is going to struggle with.

mochomocha · 4 months ago

I know nothing about photography, but I'll just comment on this point:

> (I'm guessing this is a CM4/CM5) is a disaster for a camera board. Nobody wants a 20s boot every time you want to take a picture, cameras need to be near instantaneous.

You can boot an RPI in a couple hundred milliseconds.

mochomocha commented on Memory access is O(N^[1/3]) vitalik.eth.limo/general/... · Posted by u/jxmorris12

j2kun · 4 months ago

> The empirical argument

> We can ask a question: how long (in nanoseconds) does it take to access a type of memory of which an average laptop has N bytes? Here's GPT's answer:

"Here's what GPT says" is not an empirical argument. If you can't do better than that (run a benchmark, cite some literature), why should I bother to read what you wrote?

mochomocha · 4 months ago

The article started really well, and I was looking forward to the empirical argument.

Truly mind-boggling times where "here is the empirical proof" means "here is what chatGPT says" to some people.

mochomocha commented on Efficient Computer's Electron E1 CPU – 100x more efficient than Arm? morethanmoore.substack.co... · Posted by u/rpiguy

Grosvenor · 7 months ago

Is this the return if Itanium? static scheduling and pushing everything to the compiler it sounds like it.

mochomocha · 7 months ago

On the other hand, Groq seems pretty successful.

mochomocha commented on Compiling a neural net to C for a speedup slightknack.dev/blog/diff... · Posted by u/todsacerdoti

enricozb · 8 months ago

Differentiable Logic Gate Networks [0] are super interesting. However, I still don't like that the wiring is fixed initially rather than learned.

I did some extremely rough research into doing learnable wirings [1], but couldn't get past even learning ~4-bit addition.

[0]: https://arxiv.org/abs/2210.08277

[1]: https://ezb.io/thoughts/program_synthesis/boolean_circuits/2...

mochomocha · 8 months ago

Ha! I have spent the last 2 years on this idea as a pet research project and have recently found a way of learning the wiring in a scalable fashion (arbitrary number of input bits, arbitray number of output bits). Would love to chat with someone also obsessed with this idea.

mochomocha commented on US Administration announces 34% tariffs on China, 20% on EU bbc.com/news/live/c1dr7vy... · Posted by u/belter

rayiner · 10 months ago

It’s not “anarchism” it’s simply rolling back the bad parts of Reagan’s legacy: free trade, immigration/amnesty, and foreign empire.

When Democrats embraced free trade and globalism with Clinton, most of the liberal Reagan republicans and neocons became Democrats. What MAGA is today is what the bulk of the GOP has always been: a coalition of social conservatives and business owners.

mochomocha · 10 months ago

What is so bad about free trade?

Isn't competition in free markets something Republicans believe in anymore? Because forcing Americans to buy inferior locally-made products at a premium through artificial restrictions surely isn't that.

Free trade and globalization are also a pacifying force, by creating mutual dependencies between countries.

Protectionism doesn't work.

mochomocha commented on Calculate Throughput with LLVM's Scheduling Model myhsu.xyz/llvm-sched-inte... · Posted by u/stosssik

mochomocha · 10 months ago

Nothing substantive to add to the discussion, but to praise Min's blog posts which I have found very well written and instructive.

mochomocha commented on PyTorch Native Architecture Optimization: Torchao pytorch.org/blog/pytorch-... · Posted by u/jonbaer

brrrrrm · a year ago

it's not about the API. its about the documentation + ecosystem.

TF's doesn't seem very good. I just tried to figure out how to learn a linear mapping with TF and went through this:

1. googled "linear layer in tensorflow" and got to the page about linear.

2. spent 5 minutes trying to understand why monotonicity would be a central tenet of the documentation

3. realizing that's not the right "linear" I couldn't think of what the appropriate name would be

4. I know MLPs have them, google "tensorflow mlp example"

5. click the apr '24 page: https://www.tensorflow.org/guide/core/mlp_core

6. read through 10[!] code blocks that are basically just boiler-plate setup of data and visualizations. entirely unrelated to MLPs

7. realize they call it "dense" in tensorflow world

8. see that "dense" needs to be implemented manually

9. think that's strange, google "tensorflow dense layer"

10. find a keras API (https://www.tensorflow.org/api_docs/python/tf/keras/layers/D...)

mochomocha · a year ago

11. notice that there's a unicode rendering error ("'" for apostrophe) on kernel_initializer and bias_initializer default arguments in the documentation, and wonder why on earth for such a high-level API one would want to expose lora_rank as a first class construct. Also, 3 out of the 5 links in the "Used in the guide" links point to TF1 to TF2 migration articles - TF2 was released 5 years ago.

mochomocha commented on Noisy neighbor detection with eBPF netflixtechblog.com/noisy... · Posted by u/el_duderino

jeffbee · a year ago

This is nifty, but not really congruent with my understanding of the "noisy neighbor" phenomenon. This work seems to reveal when there are more runnable threads than CPUs, leading to tasks waiting to run. The way I use "noisy neighbor" is that it is a concurrent task that trashes some microarchitectural resource, forcing the victim process to use more CPU time. For example, a process on another CPU core in the same cache domain that trashes all of the shared cache lines, or fills up all the load/store slots, or that uses more thermal power causing a global clock speed slowdown.

mochomocha · a year ago

Yep in Netflix case they pack bare-metal instances with a very large amount of containers and oversubscribe them (similar to what Borg reports: hundreds of containers per VM is common), so there are always more runnable threads than CPUs and your runqueues fill up.

mochomocha commented on Noisy neighbor detection with eBPF netflixtechblog.com/noisy... · Posted by u/el_duderino

wmf · a year ago

In this case the noise is coming from inside the house, er, the VM so it's not Nitro's problem.

mochomocha · a year ago

Yep. In Netflix case each Titus host can run hundreds of containers per bare-metal instance at any given time. One advantage of running a multi-tenant platform like this is that you get better observability on multi-tenancy issues since you're doing the scheduling yourself and know who is collocated with who. It's much harder to debug noisy-neighbor issues when it's happening on the cloud provider side and your caches get thrashed by random other AWS customers.

One thing I was pitching internally when advocating for this platform is that when you have the scale to run it for the economics to make sense, you can reclaim some of AWS margins instead of having your cold tiny VMs subsidize other AWS customers higher perf. If you run the multi-tenant platform yourself, you can oversubscribe every app in a way that makes sense for your business and trade latency or throughput of software for $ on a per-container basis, so you can make much more granular and optimal decisions globally. VS having each team individually right-size their own app deployed on VMs and sharing CPU caches with randos.

I remember once at Netflix we investigated a weird latency issue on a random load balancer instance and got AWS involved: it turned out to be a noisy-neighbor on the underlying VM that gets chopped up into multiple customer-facing LB instances.