adhocmobility (u/adhocmobility)

adhocmobility commented on $10M AI Mathematical Olympiad Prize aimoprize.com/... · Posted by u/jasondavies

As the parent of a young adult currently half way through their maths undergrad, this kind of fills me with foreboding.

I know that proof assistants etc have existed for quite a while now, but what with this and the murmours about OAI's Q* model, I do wonder what will happen to maths as a human endeavour - and as a enabling skill for jobs that can financially support people like my child.

adhocmobility · 2 years ago

I think its pretty clear that in the coming decade intelligence and cognitive labor is going to become very cheap. So your kid should develop some skills outside of that to stay competitive in the job market.

adhocmobility commented on OpenAI and Jony Ive in talks to raise $1B from SoftBank for AI device venture ft.com/content/4c64ffc1-f... · Posted by u/lafreb

pc_edwin · 2 years ago

The interesting thing is they have the bankroll to actually make this work and it actually makes a lot of sense.

I remember watching a Google I/O presentation back in 2016 when voice assistants were trending. There was all sorts of ideas like APIs to access google assistant, voice/chat being the new interface etc.

The future presented there made so much intuitive sense to me and now the tech has finally caught up. The current static state off affairs has clearly outlived its usefulness.

Its not all sunshine and roses, Apple is an order of magnitude better position to take this leap then OpenAI. I know this may be a little out there but I think Apple made the right move by not jumping the gun with LLMs, IMO it makes more to let the dust settle and either partner with one of the winners or pick up the open standard (Llama 5?)

adhocmobility · 2 years ago

Apple has invested a lot in making sure that they STAY in "an order of magnitude better position". They know that the ultimate winner in personalized AIs will be whoever has the best edge hardware. That is why they have been investing so heavily in special purpose on-device chips for running neural networks.

adhocmobility commented on OpenAI and Jony Ive in talks to raise $1B from SoftBank for AI device venture ft.com/content/4c64ffc1-f... · Posted by u/lafreb

adhocmobility · 2 years ago

The answer to what they're building is written on Karpathy's twitter - "A kind of Jarvis"

adhocmobility commented on I wish GPT4 had never happened chaudhry.notion.site/I-wi... · Posted by u/adhocmobility

adhocmobility · 3 years ago

Hi everyone, author of the article here. I'm sorry if the article sounds overly pessimistic. I'm not making any claims with this article. I'm not proposing anything either. I do think technological progress is a good thing, even in this case. But I wrote this blog because I did have an emotional response to this technology, and wanted to pen down my thoughts.

Its one thing to look at a report about the economic impact of new technology, but another to experience it first-hand. This is just a story about someone who will be impacted. Calling it a "sob" story is very harsh. This story is very real and the feeling of losing your job to automation is anything but pleasant.

adhocmobility commented on HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace arxiv.org/abs/2303.17580... · Posted by u/r_singh

simon_000666 · 3 years ago

“To be able to be good at predicting the next word you need to have an internal model of the reality that produced that next word.”

Now that’s an interesting claim - that I would deeply dispute. It learns from text. Text itself is a model of reality. So chatgtp if anything proves that in order to be good at predicting the next word all you need is a good model of a model of reality. GTP knows nothing of actual reality only the statistics around symbol patterns that occur in text.

adhocmobility · 3 years ago

You are being given a chance to dispute it. Give an example of a problem that any human would be easily able to solve but GPT4 wouldn't.

>> "good model of a model of reality"

That is just a model of reality. Also, a "model of reality" is what you'd typically call a world model. Its an intuition for how the world works, how people behave, that apples fall from trees and that orange is more similar to red than it is to grey.

Your last line shows that you still have a superficial understanding of what its learning. Yes it is statistics, but even our understanding of the world is statistical. The equations we have in our head of how the world works are not exact, they're probabilistic. Humans know that "Apples fall from the _____" should be filled with 'tree' with a high probability because that's where apples grow. Yes, we have seen them grow there, whereas the AI model has only read about the growing on trees. But that distinction is moot because both the AI model and humans express their understanding in the same way. The assertion we're making is that to be able to predict the next word well, you need an internal world model. And GPT4 has learnt that world model well, despite not having sensory inputs.

adhocmobility commented on Data Version Control dvc.org/... · Posted by u/HerrMonnezza

kortex · 3 years ago

I've used both extensively. Git-lfs has always been a nightmare. Because each tracked large file can be in one of two states - binary, or "pointer" - it's super easy for the folder to get all fouled up. It would be unable to "clean" or "smudge", since either would cause some conflict. If you accidentally pushed in the wrong state, you could "infect" the remote and be really hosed. I had this happen numerous times over about 2 years of using lfs, and each time the only solution was some aggressive rewriting of history.

That, combined with the nature of re-using the same filename for the metadata files, meant that it was common for folks to commit the binary and push it. Again, lots of history rewriting to get git sizes back down.

Maybe there exist solutions to my problems but I had spent hours wrestling with it trying to fix these bad states, and it caused me much distress.

Also configuring the backing store was generally more painful, especially if you needed >2GB.

DVC was easy to use from the first moment. The separate meta files meant that it can't get into mixed clean/smudge states. If you aren't in a cloud workflow already, the backing store was a bit tricky, but even without AWS I made it work.

adhocmobility · 3 years ago

We resolve this in two ways

1. All git-lfs files are kept in the same folder

2. No one can directly push commits to one of the main branches, they need to raise a PR. This means that commits go through review and its easy to tell if they've accidentally commit a binary, and we can just delete their branch form the remote bringing the size back down.

adhocmobility commented on Data Version Control dvc.org/... · Posted by u/HerrMonnezza

adhocmobility · 3 years ago

If you just want a git for large data files, and your files don't get updated too often (e.g. an ML model deployed in production which gets updated every month) then git-lfs is a nice solution. Bitbucket and Github both have support for it.

adhocmobility commented on Vancouver proposes 10k-dollar annual fee for gas stations without EV charging driving.ca/auto-news/loca... · Posted by u/grawprog

brewdad · 4 years ago

We would need to develop a single standard and a limited number of battery sizes for this to ever be feasible. Go look at how many different starter batteries your typical auto parts store has to stock. Now imagine doing that with batteries that are much larger and much riskier if they are stored/handled improperly.

adhocmobility · 4 years ago

I can't imagine it, which is why I asked. You certainly seem skeptical. Your arguments aren't very convincing though.

>> Too many different start batteries

Okay... that's because there's no standard. But isn't that why standards are developed? Could you explain why developing a standard and a limited number of battery sizes is not feasible?

>> Risk of storing and handling them improperly

Could you explain why batteries are riskier than petrol?

And while we're discussing this China's decided to try it out [0].

[0] https://www.reuters.com/business/autos-transportation/inside...