I made a 4B Qwen3 distill of this model (and a synthetic dataset created with it) a while back. Both can be found here: https://huggingface.co/flashresearch
Readit Newssumo43 commented on Π0: Our First Generalist Policy physicalintelligence.comp... · Posted by u/krishpop
Isn't this a real big deal? They manage to train a foundation model that connects the physical understanding gained from unsupervised training on images and videos with the real physical understanding necessary to control a robot. They have impressive videos to show for it. The approach seems indeed scalable and generalist. I've thought for a while that the keystone missing for household androids is connecting the understanding of large multimodal language models with physical hardware. To me this looks like exactly that. It actually makes me optimistic that we will see household robots within a decade. Now I wonder why Tesla, Figure etc. are messing around so much with Teleoperation if this indeed works. Maybe I don't understand what's going on.
I think the fine tuned policies are still very brittle, but I agree that this is super promising. It's also one of the most open (the model is still closed) research blogposts we've seen from any private embodied AI lab
sumo43 commented on Octo: An Open-Source Generalist Robot Policy octo-models.github.io/... · Posted by u/jasondavies
seems like an improvement on the aloha approach? You still need to finetune it on roughly the same amount of OOD examples. Contrast this with google's approach over 2023, which was training large vision-language models with the goal of generalizing on OOD.
Location: US
Remote: Yes
Willing to relocate: Yes (US)
Technologies: Python, PyTorch, HuggingFace, C++
Résumé/CV: https://drive.google.com/file/d/1qY-m1tKz4_QpHgxaGryC2vk-DGs...
Email: sumo43@proton.me
ML Engineer & Research Scientist. Ex AI grant startup, hedge fund. I've previously worked on inference for LLMs and vision models & have experience with data curation and multinode training. Looking for summer internships or part time positions
There's at least an argument to be made that this is because all the models are heavily trained on GPT-4 outputs (or whatever the SOTA happens to be during training). All those models are, in a way, a product of inbreeding.
Maybe true for instruct, but pretraining datasets do not usually contain GPT-4 outputs. So the base model does not rely on GPT-4 in any way.
sumo43 commented on Ask HN: Looking for a project to volunteer on? (February 2024) · Posted by u/theycallhermax
SEEKING VOLUNTEERS: open source self-play training for language models
we are a small team associated with EleutherAI. looking to push the frontier of open source language models through self-play. so far we have implemented SPIN. compute included.
email tyoma9k@gmail.com
edit: formatting
Constraints are the fun part here. I know this isn't the 8x Blackwell Lamborghini, that's the point. :)