Readit News logoReadit News
vikiomega9 commented on A Visual Guide to Vision Transformers   blog.mdturp.ch/posts/2024... · Posted by u/md2rp
causal · a year ago
I like this, but think there is some crucial motivation missing in steps 10.1-10.3 regarding what query/key weights are and why they're needed.
vikiomega9 · a year ago
this post made sense to me https://teltam.github.io/posts/soft-dictionary-keys.html

It helps to think of kqv as a form of look up.

vikiomega9 commented on Arm China Has Gone Rogue   semianalysis.substack.com... · Posted by u/xbmcuser
throwaway894345 · 4 years ago
Dang dude, this is clearly bothering you. You should find a professional therapist to talk through this with, sincerely.
vikiomega9 · 4 years ago
Thank you for being flippant. I'm too poor for a therapist.
vikiomega9 commented on Arm China Has Gone Rogue   semianalysis.substack.com... · Posted by u/xbmcuser
throwaway894345 · 4 years ago
> For all its innumerable faults, flaws, and outright human rights violations: the West of the latter 20th century seemed like a plausible v0.0.1 of some future, hypothetical, benevolent society.

A large digression, but I do wish we didn't need these silly ritual flagellations each time we mention that the West was actually pretty good. To call these things "human rights violations" implies that the West defied some accepted standard for how we treated people, but the West was always on the leading edge for human rights (slavery, colonialism, racism, etc were normal on virtually every continent until the West decided they were wrong). We often talk about the West as though it is some great failure because it didn't emerge from the mists of history fully-formed and prepared to adhere to our modern moral standards, ignoring the fact that our modern moral standards are precisely the product of millennia of Western progress.

vikiomega9 · 4 years ago
I agree with you except post-independence in the middle of the 19th and 20th century, the supposedly benevolent West hedged and continue to plunder and usurp Africa and Asia. Values based? Sure, see how rational it is, for you but not for us. We must agree upon universal declarations and you better listen up we know what we're doing.

I have no idea why you think these are `silly ritual flagellations`. Drop everything, the British left the Indian subcontinent in flames. Oh wait, this sounds a lot like Afghanistan. Down vote me for all I care, but if you've not experienced the horror of colonialism and the mess we have to pickup after and fix, with poverty, disease and f_cking IP (TB, Aids, Food Security), and fragile democracy setup to serve external masters, in the presence of evolved men, I respectfully ask you to be empathetic to a lot of voices that still can't be heard. You clearly don't seem to understand the utter s_it some of us and our parents have lived through.

Sure, the awesome Western cultural evolution is grand and something to wait for, who knows what form it will take.

Ok, let's drop all of history except the last 70 years. The zenith of evolution. A poor country had to give you, the West, the finger to save the less fortunate from Aids[1].

I respectfully ask you to continue to self-flagellate.

[1] https://qz.com/india/1666032/how-indian-pharma-giant-cipla-m....

vikiomega9 commented on Embarrassed by your Olympic javelin: did cavemen do it better? (2012)   npr.org/sections/krulwich... · Posted by u/Brajeshwar
p1key · 4 years ago
My source for this was watching the final myself. When I watched the broadcast myself it was clear to me that this was the problem. Also the (Finnish) commentators were very knowledgeable in the sport and pointed out the problem many times.

I was unable to find a clip of his throws in YouTube, but here's a Google Translated article from a Finnish newspaper: https://bit.ly/3xvZWMk.

vikiomega9 · 4 years ago
Thanks. Seems like a technical problem on his throw then? I'm not aware of the intricacies of surface and I assumed it was a standardized setup.
vikiomega9 commented on Embarrassed by your Olympic javelin: did cavemen do it better? (2012)   npr.org/sections/krulwich... · Posted by u/Brajeshwar
p1key · 4 years ago
But it has been close? Johannes Vetter got a result of 97.76m under a year ago, that is only 0.72m shy of the world record. Also the reason he was underperforming in the olympics was that the surface of the run-up track was not able to take his weight on the final step and he would slip, making it impossible to perform on his normal high level.
vikiomega9 · 4 years ago
Source for the reason Johannes Vetter failed? Does not look like this was covered well in the press.
vikiomega9 commented on Why is China smashing its tech industry?   noahpinion.substack.com/p... · Posted by u/exceptione
Animats · 4 years ago
China is not "smashing its tech industry". It's cracking down on private Internet companies that acquired too much power through network effects. This is completely consistent with CCP doctrine. Anything that central has to be state-owned.

Xi declared this year that while digitization is important, “we must recognize the fundamental importance of the real economy… and never deindustrialize.” Right. China, remember, has a national industrial policy. It's expressed in the national 5 year plan, which is taken seriously and used to set priorities.

What those priorities are is no secret. The current 5 year plan, the 14th, lists them.[1] Specific technology goals are in blue boxes. Semiconductors, gas turbines, biotech, new energy vehicles, robotics, advanced agricultural equipment. Internet services are mentioned in the Plan. One key line section out here: "We will strengthen the economic supervision of internet platforms in accordance with laws and regulations, clarify platform enterprise positioning and regulatory rules, improve the laws and regulations concerning the identification of monopolies, and crack down on monopolies and unfair competition. ... We will intensify anti-monopoly and anti-unfair competition law enforcement and judicial efforts and prevent the disorderly expansion of capital."

If you think this isn't to be taken seriously, go back and look at the 13th 5 year plan and check off the completed items.

[1] https://cset.georgetown.edu/wp-content/uploads/t0284_14th_Fi...

vikiomega9 · 4 years ago
I'm still reading up so looking for resources. What's a good introduction that talks about how the Chinese state is looking at individual choices? 5 year planning makes sense but the implementation is key (India for example had similar planning processes). Is there writing on how Xi or the CCP thinks about incorrect choices in the planning or a fail-safe that prevents what happened to the Soviet Union? Have they ever talked about getting things wrong?
vikiomega9 commented on Why is China smashing its tech industry?   noahpinion.substack.com/p... · Posted by u/exceptione
mc32 · 4 years ago
It would be quite interesting to see a cleaving between us in the “West” and those who follow China’s model.

I can see the disadvantage of the saccharine part of our economy and the advantages of focusing on nuts and bolts.

It’s the difference between letting people decide what’s right for them and having a more planned society. Obviously planned societies have been a recurring theme in history, most notably socialism and its chronological counterpart national socialism. Neither made good faith efforts and both resulted in millions of deaths. But we also experienced unnecessary deaths from unregulated parts of the economy, though not as many deaths and at least it involved more free will.

vikiomega9 · 4 years ago
One idea that seems to make sense to me is that social mobility is the equivalent of starvation in a socialist setup. What we see today with the poorer sections of society especially African Americans is a strong indicator that all systems of power should be viewed critically and with compassion. The vast majority of the poor in America for example are obese and that's one cost I can think of that we pay for the current system. Btw, I'm not saying poverty is the cause, just that the system is setup to maximize free market outcomes that are not good but we put up with them, https://www.washingtonpost.com/lifestyle/food/the-true-conne...
vikiomega9 commented on Why is China smashing its tech industry?   noahpinion.substack.com/p... · Posted by u/exceptione
caeril · 4 years ago
> China may simply see things differently. It’s possible that the Chinese government has decided that the profits of companies like Alibaba and Tencent come more from rents than from actual value added

Excellent observation, and I hope, for China's sake, that this is the reason.

The United States is likely in for a long-term rude awakening when it finally realizes that an economy predicated on negative-value-add activities like clicking heart icons on photos, repackaging financial securities into products with impossible-to-detangle risk profiles, advertisement and addiction optimization, and political outrage, will not remain any definition of "global superpower" for long.

Facebook and Netflix are excellent examples of companies that contribute greatly to our GDP whilst simultaneously draining our reserves of actual capital and mental health.

vikiomega9 · 4 years ago
Indeed, one of the more interesting ideas I've been considering is how does society think about the delayed effects on mental health and attention deficit. For example, one might argue maybe Netflix is easier to moderate at the level of a family or community, like having parental locks on time spent on quality content. But what do you do with Internet Porn? There is enough evidence that novelty stimulation has detrimental effects. For either scenario, the internet has made it easier to consume more and at a faster rate, but we don't have a quick and easy mechanism to talk about these things and develop cultural practices. One of the more interesting ideas for me is finding that balance between liberal individual right to choice and recognizing all systems including human society is a feedback loop and drifts into failure (either expanding freedoms or curbing them).
vikiomega9 commented on German gymnastics team, tired of sexualisation, wears unitards at Tokyo Olympics   abc.net.au/news/2021-07-2... · Posted by u/DocFeind
vikiomega9 · 4 years ago
Does appearing taller win more points for gymnastics?

I've always found it weird that some sports have women wearing scant clothing compared to the mens events. Volleyball for example is a big one where it's unclear how bikini bottoms help over shorts.

vikiomega9 commented on I still use plain text for everything. (2016)   lifehacker.com/i-still-us... · Posted by u/behnamoh
thaumasiotes · 4 years ago
There is a universal, open format for text mixed with images. It's HTML. Support already exists everywhere.
vikiomega9 · 4 years ago
Yes exactly, was looking to comment this. HTML and other formats (markdown) are driven by adoption and stick around for that reason.

u/vikiomega9

KarmaCake day439March 31, 2013
About
AWS
View Original