Readit NewsI couldn't see any source for the figure in the headline?
That's because this tweet is written to maximize engagement. Number 3 uses a screenshot of some other random tweet that says all people of indian descent in the US are "agents" (5.1 million people).
fenced_load commented on Apple's MLX adding CUDA support github.com/ml-explore/mlx... · Posted by u/nsagent
In the absence of hardware unified memory, CUDA will automatically copy data between CPU/GPU when there are page faults.
There is also NVLink c2c support between Nvidia's CPUs and GPUs that doesn't require any copy, CPUs and GPUs directly access each other's memory over a coherent bus. IIRC, they have 4 CPU + 4 GPU servers already available.
This isn’t any different with QSFP unless you’re suggesting that one adds a 200GbE switch to the mix, which:
* Adds thousands of dollars of cost,
* Adds 150W or more of power usage and the accompanying loud fan noise that comes with that,
* And perhaps most importantly adds measurable latency to a networking stack that is already higher latency than the RDMA approach used by the TB5 setup in the OP.
https://www.bhphotovideo.com/c/product/1926851-REG/mikrotik_...