mesebrec (u/mesebrec)

mesebrec commented on Former Google CEO Eric Schmidt's Leaked Stanford Talk github.com/ociubotaru/tra... · Posted by u/gregzeng95

doomlaser · a year ago

It's not leaked. It was posted publicly to YouTube, which is where I watched it. It was the first or second video in my recommended feed. I even left a comment, "Thank you, Stanford, for uploading this talk for us." which Stanford put a heart on, pinning it to the top of the YouTube comments: https://i.imgur.com/LSi6mqN.png

It was a good talk on a technical level. My guess is he ran into trouble when he briefly criticized modern Google's corporate culture when it comes to work-from-home?

mesebrec · a year ago

The video is currently private: https://m.youtube.com/watch?v=LxDM8io4lUA

mesebrec commented on Open source AI is the path forward about.fb.com/news/2024/07... · Posted by u/atgctg

causal · a year ago

You are definitely allowed to train other models with these models, you just have to give credit in the name, per the license:

> If you use the Llama Materials or any outputs or results of the Llama Materials to create, train, fine tune, or otherwise improve an AI model, which is distributed or made available, you shall also include “Llama” at the beginning of any such AI model name.

mesebrec · a year ago

Indeed, this is something they changed in the 3.1 version of the license.

Regardless, the license [1] still has many restrictions, such as the acceptable use policy [2].

[1] https://huggingface.co/meta-llama/Meta-Llama-3.1-8B/blob/mai...

[2] https://llama.meta.com/llama3_1/use-policy

mesebrec commented on Open source AI is the path forward about.fb.com/news/2024/07... · Posted by u/atgctg

mkolodny · a year ago

Llama’s code is open source: https://github.com/meta-llama/llama3/blob/main/llama/model.p...

mesebrec · a year ago

This is like saying any python program is open source because the python runtime is open source.

Inference code is the runtime; the code that runs the model. Not the model itself.

mesebrec commented on Open source AI is the path forward about.fb.com/news/2024/07... · Posted by u/atgctg

JumpCrisscross · a year ago

> no one has bothered to release their training data

If the FOSS community sets this as the benchmark for open source in respect of AI, they're going to lose control of the term. In most jurisdictions it would be illegal for the likes of Meta to release training data.

mesebrec · a year ago

Regardless of the training data, the license even heavily restricts how you can use the model.

Please read through their "acceptable use" policy before you decide whether this is really in line with open source.

mesebrec commented on Open source AI is the path forward about.fb.com/news/2024/07... · Posted by u/atgctg

sidcool · a year ago

Honest question. As far as LLMs are concerned, isn't open weights same as open source?

mesebrec · a year ago

Open source requires, at the very least, that you can use it for any purpose. This is not the case with Llama.

The Llama license has a lot of restrictions, based on user base size, type of use, etc.

For example you're not allowed to use Llama to train or improve other models.

But it goes much further than that. The government of India can't use Llama because they're too large. Sex workers are not allowed to use Llama due to the acceptable use policy of the license. Then there is also the vague language probibiting discrimination, racism etc.. good luck getting something like that approved by your legal team.

mesebrec commented on Open source AI is the path forward about.fb.com/news/2024/07... · Posted by u/atgctg

redleader55 · a year ago

"Use it for whatever you want(conditions apply), but not if you are Google, Amazon, etc. If you become big enough talk to us." That's how I read the license, but obviously I might be missing some nuance.

mesebrec · a year ago

You also can't use it for training or improving other models.

You also can't use it if you're the government of India.

Neither can sex workers use it. (Do you know if your customers are sex workers?)

There are also very vague restrictions for things like discrimination, racism etc.

mesebrec commented on Open source AI is the path forward about.fb.com/news/2024/07... · Posted by u/atgctg

ChadNauseam · a year ago

> you can't meaningfully modify them given there is almost no information available about the training data, how they were trained, or how the training data was processed.

I was under the impression that you could still fine-tune the models or apply your own RLHF on top of them. My understanding is that the training data would mostly be useful for training the model yourself from scratch (possibly after modifying the training data), which would be extremely expensive and out of reach for most people

mesebrec · a year ago

Indeed, fine-tuning is still possible, but you can only go so far with fine-tuning before you need to completely retrain the model.

This is why Silo AI, for example, had to start from scratch to get better support for small European languages.

mesebrec commented on Open source AI is the path forward about.fb.com/news/2024/07... · Posted by u/atgctg

nuz · a year ago

Everyone complaining about not having data access: Remember that without meta you would have openai and anthropic and that's it. I'm really thankful they're releasing this, and the reason they can't release the data is obvious.

mesebrec · a year ago

Without Meta, you would still have Mistral, Silo AI, and the many other companies and labs producing much more open models with similar performance.

mesebrec commented on Open source AI is the path forward about.fb.com/news/2024/07... · Posted by u/atgctg

mesebrec · a year ago

Note that Meta's models are not open source in any interpretation of the term.

* You can't use them for any purpose. For example, the license prohibits using these models to train other models. * You can't meaningfully modify them given there is almost no information available about the training data, how they were trained, or how the training data was processed.

As such, the model itself is not available under an open source license and the AI does not comply with the "open source AI" definition by OSI.

It's an utter disgrace for Meta to write such a blogpost patting themselves on the back while lying about how open these models are.

mesebrec commented on Is OpenSUSE at Crossroads? ludditus.com/2024/07/18/i... · Posted by u/jandeboevrie

criticalfault · a year ago

> Oh, they would also be used by those mentally retarded zoomers who really can use GNOME without cursing every five seconds and without feeling they have zero productivity. One should be born into macOS to like GNOME, and even then.

Stopped reading after this.

mesebrec · a year ago

Oh, wow, I came here for the same thing. The tone of the post got more and more annoying as it progressed.

Posting quotes from reddit as if they're intellectual discussions was a red flag, but this specific statement was just too much to ignore.

Although I work on Linux almost daily, I'm happy to say it's possible to simply avoid those kinds of people. Fostering a healthy environment where people can discuss and disagree respectfully is incredibly important for volunteer-led projects like Linux distributions.

u/mesebrec

KarmaCake day976April 21, 2020

About

Merlijn Sebrechts

Teaching and researching computer science at Ghent University and imec in Belgium

https://merlijn.sebrechts.be

View Original