Readit News logoReadit News
hurrdurr57 commented on New Phi-3.5 Models from Microsoft, including new MoE   huggingface.co/microsoft/... · Posted by u/thecal
hurrdurr57 · a year ago
The Phi models always seem to do really well when it comes to benchmarks but then in real world performance they always fall way behind competing models.
hurrdurr57 commented on Google Releases Powerful AI Image Generator You Can Use for Free   petapixel.com/2024/08/19/... · Posted by u/mikece
hurrdurr57 · a year ago
Will it generate racially diverse Nazis at higher resolutions than their old model?
hurrdurr57 commented on The movement to diversify Silicon Valley is crumbling amid attacks on DEI   washingtonpost.com/techno... · Posted by u/marban
winternett · a year ago
As someone who works in a very diversified company, and frequently hires candidates of all cultures and creeds, the entire "DEI" discussion is deeply cringe-worthy to me, especially the comments under this article.

A company that is homogenous in race and culture turns out products that don't support, they turn out ads that get called out for racial and cultural insensitivity, and actually exclude people that aren't reflected by the population making it's products. Running a company that excludes non-majority race and cultured employees is a deeply political statement that caters to old-world ideals that are dying fast, just like the politicians pushing them.

There is deep rooted bias around the entire world, to act like it doesn't exist is simply coddling the classic narratives of racial superiority propped up for ages by people who are creating a cultural advantage for themselves. We battle the ideal of immigration for some cultures, while other cultures can travel anywhere they want freely, and it highlights a willful ignorance and mentality that is deep rooted, but also contradictory to progress and innovation. It may feel comfortable to only be surrounded by people with the same cultural norms and upbringing as yourself, but if you only live in that bubble, you're part of the problem. Life is far better when we open up to new experiences and people, and that's exactly what diversity represents...

There is a far more fair way to interview candidates, where bias can be eliminated, but most companies foist untrained, unskilled, and politically biased leaders into leadership positions all the time without any sort of accountability. So many companies completely miss the mark on why diversity is necessary, even governments miss the plot completely. There are still so many racially homogenous countries out there build on ideals of racial and cultural superiority that it infects the world deeply in some of the most disguised ways possible.

On the inverse, as Bill Burr cited numerous times [Language Warning] (e.g. -- https://youtu.be/O1xgXJ5_Q34?si=n5XZ2MqPhHHgvSdu&t=195), Diversity and inclusion programs often are frequently led and geared towards the advancement of already privileged Caucasian women, which although rightfully under-represented, rank far above racial minority women and often above racial minority men in terms of pay and responsibility.

They can fight all the political wars they want over this issue, but in my long history of work, I have never seen a culturally homogenous business succeed in the long term, without differences in experience and culture, ideas are stale and tone deaf. It works in all ways too of course, but these days, the biggest indication of flawed leadership is a company or agency leadership photo where the majority percentage of the people in it are all the same skin tone.

hurrdurr57 · a year ago
>the biggest indication of flawed leadership is a company or agency leadership photo where the majority percentage of the people in it are all the same skin tone.

Does this opinion come from your actual experience or just from your ideological indoctrination?

Virtually all non-western businesses have zero concern about fostering racial diversity, they are all failures in your opinion?

hurrdurr57 commented on New EU rules promoting repair of goods enter into force   commission.europa.eu/law/... · Posted by u/janandonly
kyriakos · a year ago
will that be 5 years from date of sale (like a warranty) or date of manufacture or date of first release? it makes a big difference since you could buy last year's model and expect 5 years of updates.
hurrdurr57 · a year ago
Realistically, I think it would have to be from the release date.
hurrdurr57 commented on AI models that cost $1B to train are underway, $100B models coming   tomshardware.com/tech-ind... · Posted by u/pulse7
sigmoid10 · a year ago
This. The seemingly neverending run for foundation models only works as long as companies can afford it. If one of them spends 100+B, it will be a long time before compute catches up to the point that a competitor could reproduce it at reasonable budgets. This is essentially the race of who's going to own AGI and it shouldn't be surprising that people are willing to spend these amounts.
hurrdurr57 · a year ago
Given how quickly AI is progressing from the software side, and how poorly AI scales from just throwing raw compute time at a model, I don't see a company holding onto the lead for very long with that strategy.

If I can come out with a model a year later, and it can provide 95% of the performance while costing 10% as much to run, I think I would end up stealing a lot of customers before they had a chance to break even.

Take Llama3-8B for example, this is an 8 billion parameter model from 2024 that performs about as well the the original ChatGPT, a 175 billion parameter model from 2022. It only took 2 years before a model that can run on a desktop could compete with a model that required a data center.

hurrdurr57 commented on AI models that cost $1B to train are underway, $100B models coming   tomshardware.com/tech-ind... · Posted by u/pulse7
hurrdurr57 · a year ago
Well, I guess the question I have is, what exactly does he mean by the "cost to train"? As in, just the cost of the electricity used to train that one model? That seems really excessive.

Or is it the total overall cost of buying TPUs / GPUs, developing infrastructure, constructing data centers, putting together quality data sets, doing R&D, paying salaries, etc. as well as training the model itself? I could see that overall investment into AI scaling into the tens of billions over the next few years.

hurrdurr57 commented on Survivor of Parkland school massacre wins ownership of shooter's name in lawsuit   yahoo.com/news/survivor-p... · Posted by u/koolba
hurrdurr57 · a year ago
>Cruz cannot give any interviews without his permission

That's a really weird settlement.

hurrdurr57 commented on Open-Sora does pretty good video generation on consumer GPUs   backprop.co/environments/... · Posted by u/kristoo
wegfawefgawefg · 2 years ago
A hammer can be used to hit nails or bash skulls. There are billions of hammers.
hurrdurr57 · 2 years ago
Hammers don't kill people, people kill people

... with hammers

hurrdurr57 commented on Why has LLM progress seemingly stalled around the GPT-4 level? Or has it?    · Posted by u/vigneshatm
atleastoptimal · 2 years ago
Parameters is the literal size of the model. How is it a marketing term? Is saying that a computer has 16GB of ram just a marketing term?
hurrdurr57 · 2 years ago
Well, the statement that GPT-4 is 1.8T parameters is a little misleading since it's really a 8 x 220B MoE (according to the rumors at least).

Also the size of the model itself isn't the only factor that determines performance, LLama 3 70B outperforms LLama 2 70B even though they have the same size.

hurrdurr57 commented on The 'Compact' Version of Stable Diffusion 3 Is Generating Monstrous Human Bodies   xatakaon.com/robotics-and... · Posted by u/poopcat
TeMPOraL · 2 years ago
I imagine if they filtered out just the bits with some action going on, they'd still have approximately infinite feed of naked human bodies in all possible poses, which would be unoffensive out of context (or at least less offensive), and would be equivalent to art classes models for the purpose of training.
hurrdurr57 · 2 years ago
This would be doable, but expensive. You'd need to pay people to go through 10,000 pornographic images and manually blur out all of the fun bits.

u/hurrdurr57

KarmaCake day24January 2, 2024View Original