I'm rather puzzled by how bad the COCO ground truth is. This is the benchmark dataset for object detection? Wow. I would say Gemini's output is better than the ground truth in most of the example images.
Readit Newsmuxamilian commented on Is Gemini 2.5 good at bounding boxes? simedw.com/2025/07/10/gem... · Posted by u/simedw
muxamilian commented on Ironwood: The first Google TPU for the age of inference blog.google/products/goog... · Posted by u/meetpateltech
Can anyone comment on where efficiency gains come from these days at the arch level? I.e. not process-node improvements.
Are there a few big things, many small things...? I'm curious what fruit are left hanging for fast SIMD matrix multiplication.
In-memory computing (analog or digital). Still doing SIMD matrix multiplication but using more efficient hardware:
https://arxiv.org/html/2401.14428v1https://www.nature.com/articles/s41565-020-0655-z
muxamilian commented on Europe bets once again on RISC-V for supercomputing theregister.com/2025/03/0... · Posted by u/muxamilian
Everybody who "bets on RISC-V for supercomputing sovereignty" will probably end up buying Chinese anyway.
Why? Genuinely curious
muxamilian commented on Coral USB Accelerator with Google's Edge TPU coral.ai/products/acceler... · Posted by u/achristmascarl
It seems more than dead and only supports small neural networks. Viable alternatives are Hailo and Axelera (https://www.axelera.ai), which is a newer.
muxamilian commented on YOLOv5 on FPGA with Hailo-8 and 4 Pi Cameras fpgadeveloper.com/multi-c... · Posted by u/geerlingguy
Any good write up on Hailo and similar ?
BTW, is it possible to have 10 of these connected to a single board/cpu ?
Maybe not 10 but in principle it’s possible: https://www.lannerinc.com/products/edge-ai-appliance/deep-le...
muxamilian commented on YOLOv5 on FPGA with Hailo-8 and 4 Pi Cameras fpgadeveloper.com/multi-c... · Posted by u/geerlingguy
Depending on what you're trying to do you might not need it. A popular option for object detection people use with their home hosted video surveillance (using Frigate and Home Assistant) is the Coral TPU and Raspberry Pi or some decommissioned thin client.
Google Coral seems abandoned by Google. Not official but last news on their page from May 2022
muxamilian commented on YOLOv5 on FPGA with Hailo-8 and 4 Pi Cameras fpgadeveloper.com/multi-c... · Posted by u/geerlingguy
I am not familiar with this NN accelerator.
Does anyone have a comparison between Hailo and, say, a mid or high-end GPU or a TPU?
It’s a competitor to Google Coral (seems abandoned) and NVIDIA Jetson. I’ve been using it for more than a year and the hardware seems to be one of the best on the market. The software (how to actually do inference on the chip) is subpar though.