It seems like a lot of the most exciting research is happening here - making unbelievable progress with such small parameter sizes.
Am so much more excited about tiny models gaining real intelligence. Just today I have been running Qwen3.5 0.8B model on images and am pleasantly surprised by how good it is compared to even 4B and 8B models from a few months ago.
See his interview in Dwarkesh's podcast: https://www.youtube.com/watch?v=c0-0gGdDJyE&t=4983s
This also goes back to something I said long ago, AI companies are relearning software engineering poorly. I can think of so many ways to speed up AI crawlers, im surprised someone being paid 5x my salary cannot.
Although I have been a skeptic of MCPs, it has been an immense help with agents. I do not have an alternative at the moment.