Readit News logoReadit News
jspisak commented on Code Llama, a state-of-the-art large language model for coding   ai.meta.com/blog/code-lla... · Posted by u/marcopicentini
coder543 · 2 years ago
I wish that Meta would release models like SeamlessM4T[0] under the same license as llama2, or an even better one. I don't understand the rationale for keeping it under a completely non-commercial license, but I agree that is better than not releasing anything at all.

There seem to be opportunities for people to use technology like SeamlessM4T to improve lives, if it were licensed correctly, and I don't see how any commercial offering from smaller companies would compete with anything that Meta does. Last I checked, Meta has never offered any kind of translation or transcription API that third parties can use.

Whisper is licensed more permissively and does a great job with speech to text in some languages, and it can translate to English only. However, it can't translate between a large number of languages, and it doesn't have any kind of text to speech or speech to speech capabilities. SeamlessM4T seems like it would be an all-around upgrade.

[0]: https://github.com/facebookresearch/seamless_communication

jspisak · 2 years ago
Yeah - different projects have different goals and licenses aren't one size fits all. Depending on the project, type of technology, goals, etc.. we will select or even develop the right license that aligns with those goals. Hope this helps :)
jspisak commented on Code Llama, a state-of-the-art large language model for coding   ai.meta.com/blog/code-lla... · Posted by u/marcopicentini
darrenf · 2 years ago
Facebook Connect is what used to be called Oculus Connect. Kinda their equivalent of Apple's WWDC, I guess. It's when and where the Quest 3 will be officially unveiled in full, for example.
jspisak · 2 years ago
Yep - here is the site: https://www.metaconnect.com/en/home
jspisak commented on Code Llama, a state-of-the-art large language model for coding   ai.meta.com/blog/code-lla... · Posted by u/marcopicentini
msoad · 2 years ago
Is there any place we can try those models? Are they available on HuggingFace?
jspisak · 2 years ago
Partner integrations will follow. For now we just have the weights available.

But don't worry, this community moves fast!

jspisak commented on Code Llama, a state-of-the-art large language model for coding   ai.meta.com/blog/code-lla... · Posted by u/marcopicentini
maccam912 · 2 years ago
It appears we do have a 34B version now, which never appeared for non fine tuned llama 2.
jspisak · 2 years ago
It would be interesting to understand if a ~30B Llama-2 model would be interesting and for what reasons.
jspisak commented on Code Llama, a state-of-the-art large language model for coding   ai.meta.com/blog/code-lla... · Posted by u/marcopicentini
lolinder · 2 years ago
Does anyone have a good explanation for Meta's strategy with AI?

The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?

jspisak · 2 years ago
If you watch the Connect talks, I'll be speaking about this..
jspisak commented on ESMAtlas – a repository of 600M predicted protein structures   esmatlas.com/... · Posted by u/ebetica0
jspisak · 3 years ago
thanks for posting this - you can learn more here: https://ai.facebook.com/blog/protein-folding-esmfold-metagen...

Cheers!

jspisak commented on Welcoming PyTorch to the Linux Foundation   linuxfoundation.org/blog/... · Posted by u/smhx
jspisak · 3 years ago
It's really awesome to finally see this landed. Congrats to the team and to the PyTorch community!
jspisak commented on Tensorflow User Experience   nostalgebraist.tumblr.com... · Posted by u/luu
m0zg · 6 years ago
If PyTorch had something like TensorFlow Lite, TF would probably be dead already. I certainly wouldn't need it. At the moment, though, TFLite is the most sane option for inference on phones and other ARM devices.
jspisak · 6 years ago
PyTorch Mobile is a start and is available for iOS and Android. Given folks like PFN and Microsoft are (or will be heavy contributors) i would expect support for more devices to broaden. Have you tried it out yet? No need for a separate set of op semantics or framework.. :) https://pytorch.org/mobile/home/
jspisak commented on Tensorflow User Experience   nostalgebraist.tumblr.com... · Posted by u/luu
ddtaylor · 6 years ago
Yup. Google gave us TPU usage for free and we gave up on using it.

Also, everything you think or do is deprecated. This comment has been deprecated.

jspisak · 6 years ago
We have been working with G on TPU support for PyTorch. Have you tried it out? https://github.com/pytorch/xla

u/jspisak

KarmaCake day33January 5, 2017View Original