Readit News logoReadit News
twak commented on AI: Accelerated Incompetence   slater.dev/accelerated-in... · Posted by u/stevekrouse
Artgor · 7 months ago
You know, sometimes I feel that all this discourse about AI for coding reflects the difference between software engineers and data scientists / machine learning engineers.

Both often work with unclear requirements, and sometimes may face floating bugs which are hard to fix, but in most cases, SWE create software that is expected to always behave in a certain way. It is reproducible, can pass tests, and the tooling is more established.

MLE work with models that are stochastic in nature. The usual tests aren't about models producing a certain output - they are about metrics, that, for example, the models produce the correct output in 90% cases (evaluation). The tooling isn't as developed as for SWE - it changes more often.

So, for MLE, working with AI that isn't always reliable, is a norm. They are accustomed to thinking in terms of probabilities, distributions, and acceptable levels of error. Applying this mindset to a coding assistant that might produce incorrect or unexpected code feels more natural. They might evaluate it like a model: "It gets the code right 80% of the time, saving me effort, and I can catch the 20%."

twak · 7 months ago
i agree; but perhaps also it is the difference between managers and SWE? The former (SWE team leaders included) can see that engineers aren't perfect. The latter are often highly focused on determinism (this works/doesn't) and struggle with conflicting goals.

Through a career SWEs start rigid and overly focused on the immediate problem and become flexible/error-tolerant[1] as they become system (mechanical or meat) managers. this maps to an observation that managers like AI solutions - because they compare favourably to the new hire - and because they have the context to make this observation.

[1] https://grugbrain.dev/#:~:text=grug%20note%20humourous%20gra...

twak commented on An online exhibition of pretty software bugs   glitchgallery.org/... · Posted by u/tobr
twak · 7 months ago
i used to do lots of graphics, and love these bugs. They give an enjoyable insight to the development process and algorithms as the progress through a project!

i have my own archive of my own bugs/"artworks" - https://twak.org/glitches-in-the-worlds-geometry-engine/

twak commented on Project Aardvark: reimagining AI weather prediction   turing.ac.uk/blog/project... · Posted by u/bentobean
bazzargh · 9 months ago
When I saw this I thought... "The Turing Institute? Does that still exist?"

https://en.wikipedia.org/wiki/Turing_Institute

There was a previous Turing Institute in Glasgow doing AI research (meaning, back then rules-based systems, but IIRC my professor was doing some work with them on neural networks), which hit the end of the road in 1994. There was some interesting stuff spun out of there, but it's a whole different institute.

twak · 8 months ago
The Turing had an interesting approach to naming, not only stealing the Glasgow group's name, but also choosing the initials 'ATI' (in 2015...).

It's recently struggling for relevance.

https://www.ft.com/content/6bfea441-e16c-499a-a887-69f735c29... (https://archive.ph/ujfhb)

I hope they turn it around because the UK need for AI academic coordination/leadership is so high.

twak commented on Aicracy – Governed by Algorithms   aicracy.net... · Posted by u/hemmert
twak · 3 years ago
My old supervisor wrote a book on computational socialism back in 93. I rather like some of the ideas (can a participatory centrally planned economy work now that we have internet/cybernetics?), but suspect it wouldn't work in practice.

https://en.wikipedia.org/wiki/Towards_a_New_Socialism

twak commented on Is DALL-E 2 ‘gluing things together’ without understanding their relationships?   unite.ai/is-dall-e-2-just... · Posted by u/Hard_Space
_nhynes · 3 years ago
I ended up reading the book Blindsight (Peter Watts) that's been floating around in comments recently. A major theme in the book is intelligence and its relation to consciousness (including whether consciousness is even beneficial). If you agree with the idea, you'd consider that DALL-E is indeed intelligent even though it appears to be a "Chinese Room". Humans would be "gluing things together" in just the same way, but with this odd introspective ability that makes it seem different.
twak · 3 years ago
fantastic book. Made me consider the question of whether consciousness exists at all or if it is just some hack by evolution to allow introspection.

I haven't found a definition of consciousness which is quantifiable or stands up to serious rigour. If it can't be measured and isn't necessary for intelligence, perhaps there is no magic cut-off between the likes of Dall-E and human intelligence. Perhaps the Chinese-room is as conscious as a human (and a brick)?

twak commented on Deep Learning Papers Are Kinda Bullsh-T   dagshub.com/blog/unraveli... · Posted by u/codeinassembly
lpasselin · 3 years ago
One detail some might not realize is the fact that research code is often a heaping pile of garbage written by a single graduate student. Some are ashamed of their code and simply don't want to publish shit code. Also, strategically, it is probably better to _not_ publish code than risk being rejected by a future job interviewer because your research code is shitty and you didn't prioritize refactoring it.

With that being said, this is not an excuse for refusing to share paper code or making sure the experiments are reproducible.

twak · 3 years ago
Other causes include the pressure to publish quickly in ML (while your approach is en vogue), with small teams, before your funding runs out, while hitting conference deadlines.

In these situations, I have suggested releasing anonymous implementations after the paper is accepted just to get the code out there. I am not certain this is the right thing to do!

twak commented on Deep Learning Papers Are Kinda Bullsh-T   dagshub.com/blog/unraveli... · Posted by u/codeinassembly
twak · 3 years ago
Academics are judged by the publications not their implementations, so the system favours over-sold manuscripts and it-ran-once implementations. Until funding is conditional-on (and provided for) robust well maintained code it will remain challenging to get reproducibility.

Frequently the PIs (bosses) will not even glance at the repositories written by junior members, probably can't read code anyway, and certainly won't allocate time for their maintenance. Even worse, most academics who do publish code have never been exposed to real world software engineers, their techniques, or tools.

twak commented on Deepfake used to attack activist couple shows new disinformation frontier   reuters.com/article/us-cy... · Posted by u/aaron695
WhitneyLand · 5 years ago
What do you think is unconvincing about them and in what way do you believe that expertise in Photoshop has any relation to this technology?

At best Photoshop can play a role in covering tracks of evidence or artifacts of this much more sophisticated approach to faking identifies.

It’s not to say the developers and scientists at Adobe are lesser, it’s that it’s not the same tool or problem that’s being solved.

Put crudely Photoshop can let you draw a mustache on someone’s photo. This is about inventing a photo that never existed before.

twak · 5 years ago
> It’s not to say the developers and scientists at Adobe are lesser

adobe research scientists are crazy-strong in the area of deep/neural graphics[1]. Perhaps we should disentangle adobe research from photoshop?

[1] https://research.adobe.com/publications/

twak commented on Self-hosted, super simple photo stream   github.com/maxvoltar/phot... · Posted by u/harper
twak · 6 years ago
Look awesome - I've been looking for some hackable code like this to present my photos from google drive. Cheap photo hosting from google + minimal load on my server...
twak commented on The cyclist behind an anti-cyclist Facebook group   cyclingtips.com/2018/08/f... · Posted by u/lamby
gadders · 7 years ago
The culture between the UK an Europe is quite different for cycling.

In the UK, 90% of the cyclists are older men in the latest lycra racing gear on //edit//road bikes. In Brugges, people just get on a regular bike with a basket on the front wearing their normal clothes.

twak · 7 years ago
Within the UK there is a large variety of cycling cultures. Cambridge is a city where everyone cycles to work in jeans/office clothes.

(Don't confuse "track bikes" and "road bikes"...)

u/twak

KarmaCake day70February 20, 2008
About
twak.org
View Original