A company that is homogenous in race and culture turns out products that don't support, they turn out ads that get called out for racial and cultural insensitivity, and actually exclude people that aren't reflected by the population making it's products. Running a company that excludes non-majority race and cultured employees is a deeply political statement that caters to old-world ideals that are dying fast, just like the politicians pushing them.
There is deep rooted bias around the entire world, to act like it doesn't exist is simply coddling the classic narratives of racial superiority propped up for ages by people who are creating a cultural advantage for themselves. We battle the ideal of immigration for some cultures, while other cultures can travel anywhere they want freely, and it highlights a willful ignorance and mentality that is deep rooted, but also contradictory to progress and innovation. It may feel comfortable to only be surrounded by people with the same cultural norms and upbringing as yourself, but if you only live in that bubble, you're part of the problem. Life is far better when we open up to new experiences and people, and that's exactly what diversity represents...
There is a far more fair way to interview candidates, where bias can be eliminated, but most companies foist untrained, unskilled, and politically biased leaders into leadership positions all the time without any sort of accountability. So many companies completely miss the mark on why diversity is necessary, even governments miss the plot completely. There are still so many racially homogenous countries out there build on ideals of racial and cultural superiority that it infects the world deeply in some of the most disguised ways possible.
On the inverse, as Bill Burr cited numerous times [Language Warning] (e.g. -- https://youtu.be/O1xgXJ5_Q34?si=n5XZ2MqPhHHgvSdu&t=195), Diversity and inclusion programs often are frequently led and geared towards the advancement of already privileged Caucasian women, which although rightfully under-represented, rank far above racial minority women and often above racial minority men in terms of pay and responsibility.
They can fight all the political wars they want over this issue, but in my long history of work, I have never seen a culturally homogenous business succeed in the long term, without differences in experience and culture, ideas are stale and tone deaf. It works in all ways too of course, but these days, the biggest indication of flawed leadership is a company or agency leadership photo where the majority percentage of the people in it are all the same skin tone.
Does this opinion come from your actual experience or just from your ideological indoctrination?
Virtually all non-western businesses have zero concern about fostering racial diversity, they are all failures in your opinion?
If I can come out with a model a year later, and it can provide 95% of the performance while costing 10% as much to run, I think I would end up stealing a lot of customers before they had a chance to break even.
Take Llama3-8B for example, this is an 8 billion parameter model from 2024 that performs about as well the the original ChatGPT, a 175 billion parameter model from 2022. It only took 2 years before a model that can run on a desktop could compete with a model that required a data center.
Or is it the total overall cost of buying TPUs / GPUs, developing infrastructure, constructing data centers, putting together quality data sets, doing R&D, paying salaries, etc. as well as training the model itself? I could see that overall investment into AI scaling into the tens of billions over the next few years.
That's a really weird settlement.
... with hammers
Also the size of the model itself isn't the only factor that determines performance, LLama 3 70B outperforms LLama 2 70B even though they have the same size.