gcanko (u/gcanko) - Readit News

gcanko commented on Chemical knowledge and reasoning of large language models vs. chemist expertise nature.com/articles/s4155... · Posted by u/bookofjoe

alganet · 2 months ago

> I think a huge reason why LLMs are so far ahead in programming

Are they? Last time I checked (couple of seconds ago), they still made silly mistakes and hallucinated wildly.

Example: https://imgur.com/a/Cj2y8km (AI teaching me about the Coltrane operator, that obviously does not exist).

gcanko · 2 months ago

You're using the worst model when it comes to programming, not sure what point you're trying prove here. That's why when someone starts ranting how useless ai models are when it comes to coding I always assume they're just using inferior models.

gcanko commented on Amazon to invest another $4B in Anthropic cnbc.com/2024/11/22/amazo... · Posted by u/swyx

rmbyrro · 9 months ago

Sonnet is better than 4o for virtually all use cases.

The only reason I still use OpenAI's API and chatbot service is o1-preview. o1 is like magic. Everything Sonnet and 4o do poorly, o1 solves like a piece of cake. Architecting, bug fixing, planning, refactoring, o1 has never let me know on any 'hard' task.

A nice combo is have o1 guiding Sonnet. I ask o1 to come up with a solution and explanation, then simply feed its response into Sonnet to execute. That running on Aider really feels like futuristic stuff.

gcanko · 9 months ago

Exactly my experience as well. Like Sonnet can help me in 90% of the cases but there are some specific edge cases where it struggles that o1 can solve in an instant. I kinda hate it because of having to pay for both of them.

gcanko commented on Jim Simons has died simonsfoundation.org/2024... · Posted by u/fgblanch

filoleg · a year ago

His whole RenTech story was fascinating.

Effectively an outsider in finance who gathered a bunch of other outsiders (aka big mathematicians), and decided to start a hedge fund that takes zero interest in the actual companies and trades solely on math. Which makes sense, since none of the main people involved in its creation had any corporate or finance experience, but tons of math experience and knowledge.

This is oversimplifying it like crazy, but I recommend anyone to anyone with even a passing curiosity for this look up the details (or read “The Man Who Solved The Market”, which is documenting the beginnings and growth of RenTech, as well as that of Simons; very enjoyable read).

gcanko · a year ago

When I read "The Man Who Solved The Market”, I blown away with the story of Robert Mercer who arguably paved the way for Brexit and the election of Donald Trump. I wonder how different the world would be if Simmons didn't exist, the butterfly effect can sometimes have some massive unintended consequences.

gcanko commented on After AI beat them, professional Go players got better and more creative henrikkarlsson.xyz/p/go... · Posted by u/iNic

lordnacho · a year ago

This is the tip of the iceberg, right? It's foreshadowing AI helping experts become better. I can see it happening in a lot of creative fields, including software. Perhaps this is where it really pulls the experts from the juniors, because only experts will be able to judge whether the AI has helped him create something actually good.

gcanko · a year ago

It's exactly like the invention of agriculture. Not having to hunt for food gave more opportunities for intellectual pursuits because of having more free time.

gcanko commented on Sora: Creating video from text openai.com/sora... · Posted by u/davidbarker

superconduct123 · 2 years ago

I'm conflicted though because on the flip side it could open up filmmaking to way more people who don't have the skills/money/time

Like what if any artist could make a whole movie by themself without needing millions of dollars or hundreds of people

Similar to how you used to need a huge studio full of equipment to record music and now someone in their bedroom with a DAW can do it

gcanko · 2 years ago

I think an important skill in the future would be just having good ideas. That's going to differentiate the winners from the losers

gcanko commented on Stable-Audio-Demo stability-ai.github.io/st... · Posted by u/beefman

romanzubenko · 2 years ago

As with Stable Diffusion, text prompting will be the least controllable way to get useful output with this model. I can easily imagine midi being used as an input with control net to essentially get a neural synthesizer.

gcanko · 2 years ago

I think it would be ideal if it could take the audio recording of humming or singing a melody together with a text prompt and spitting out a track that resembles it

gcanko commented on Stable-Audio-Demo stability-ai.github.io/st... · Posted by u/beefman

shon · 2 years ago

Interestingly, Ed Newton-Rex, the person hired to build Stable Audio, quit shortly after it was released due to concerns around copyright and the training data being used.

He’s since founded https://www.fairlytrained.org/

Reference: https://x.com/ednewtonrex

gcanko · 2 years ago

There has to be a solution for the copyright roadbloacks that companies encounter when training models. I see it no different than an artist creating music which is influenced by the music the artist has been listening throughout his whole life, fundementally it's the exact same thing. You cannot create music or art in general in a vacuum

gcanko commented on What Makes for 'Good' Mathematics? quantamagazine.org/what-m... · Posted by u/digital55

eachro · 2 years ago

Every year I see tons of CS students captivated by the beauty of algorithms in theoretical CS. I lose track of all the bright eyed undergraduates saying they love thinking about algorithms and would ideally like to spend their summer doing research on these sorts of problems. More often than not, I end up telling them they should focus their efforts on the systems side of things and chat with an OS or DB professor rather than a prof in TCS, but very few of them actually take this advice.

gcanko · 2 years ago

I’m curious why would it better to focus on the system side of things instead of algorithms?

gcanko commented on Bard's latest updates: Access Gemini Pro globally and generate images blog.google/products/bard... · Posted by u/meetpateltech

empath-nirvana · 2 years ago

https://en.wikipedia.org/wiki/The_Innovator%27s_Dilemma

Google is a search engine company and LLMs and related technologies are basically an existential risk to their core business -- ads in search. Anything they do to improve AI has a potential to kill their golden goose. Like imagine they actually do produce a breakthrough LLM but don't know how to monetize it yet and traffic to google search craters.

If you're the best horse and buggy company in the world, do you go all in on building cars or just keep doing what you're good at and extract profits while you still can? I don't think the right answer is obvious -- just like it's not at all obvious that ICE car companies should pivot to electric, and they've been pretty bad at electric cars for the same reasons.

gcanko · 2 years ago

They should cannibalize themselves just Apple did with the iPhone effectively killing the iPod. If they don’t do it someone else will. Kodak was in a similar situation with digital photos as they were scared that it would kill off their film business.

gcanko commented on Law for Computer Scientists (2020) lawforcomputerscientists.... · Posted by u/jruohonen

mo_42 · 2 years ago

When I was studying CS, I had to take some courses outside of CS and I took law. It was pretty fascinating and I even thought once or twice of switching.

I now have the very nerdy perspective that law is the operating system our socially run on. Laws are small snippets of code similar to a predicate in Prolog. We apply them once the conditions are fulfilled.

gcanko · 2 years ago

Law is basically man made math. You have laws which can be seen as axioms and lawyers essentially use the existing axioms to prove to a judge a certain conclusion