nielsinho (u/nielsinho)

nielsinho commented on SATO: Stable Text-to-Motion Framework sato-team.github.io/Stabl... · Posted by u/Sajarin

ideashower · 2 years ago

this is very cool. is it possible to rig this to game engine?

nielsinho · 2 years ago

Unity is integrating a similar but more production-ready tool, Muse Animate, with their Muse platform. It does text-to-animation, and can fill in motion if you just provide keyframes. See usage here: https://youtu.be/tMCPz_yI7pY?si=OXAyxgGxHbCDywHm

nielsinho commented on ConvNetJS Deep Q Learning Demo (2013) cs.stanford.edu/people/ka... · Posted by u/eigenvalue

eigenvalue · 2 years ago

This is related to the Q* stuff that is making the rounds now. I was quite impressed with this when I first saw it years ago. The little 2D robot is able to learn sophisticated looking behaviors with just reward based reinforcement. If you find this interesting, you should also check out Karpathy’s ScriptBots project from back when he was a college student:

https://youtu.be/RjweUYtpNq4?si=IGUwl7cZ47V2DSGB

nielsinho · 2 years ago

I stumbled across ScriptBots when I was a kid, and became obsessed with implementing my own variants, and subsequently with neural networks. This one [1] is close to Karpathy's original, and this one [2] turns the world 3D and the beings are slightly more advanced. Both are implemented in MoonScript/Lua and run with Love2D. In part due to this this YouTube video, I work as a Machine Learning Engineer today.

[1] https://github.com/nilq/genesis [2] https://github.com/nilq/plane

nielsinho commented on Show HN: Gdańsk AI – full stack AI voice chatbot github.com/jmaczan/gdansk... · Posted by u/yu3zhou4

kjok · 3 years ago

What's the reason for the high inference latency? Any ideas on how this could be improved?

nielsinho · 3 years ago

TorToiSe is composed of many large models: GPT-2 for text encodings, as well as a large VQVAE encoder + large diffusion model decoder.

Only the big spaghetti inference code (+ weights) has been published, so there's a high entrance barrier for re-training / improving it.

nielsinho commented on Show HN: Gdańsk AI – full stack AI voice chatbot github.com/jmaczan/gdansk... · Posted by u/yu3zhou4

benreesman · 3 years ago

Related, what’s the current SOTA on STT models freely available? T5 is pretty good but the closed Google and Meta stuff seems better.

nielsinho · 3 years ago

TorToiSe (https://github.com/neonbjb/tortoise-tts) produces the best quality speech of any freely available model. However, its long inference times makes it impractical for voice chatbots like Gdansk.

nielsinho commented on Roku filed an 8-K saying that of its $1.9B of cash, $487M is stuck at SVB vikashruhil.medium.com/ro... · Posted by u/dhdhd1

soundsgoodtome · 3 years ago

Sounds like you should get up to date on US terms then, since they’re what matter.

nielsinho · 3 years ago

Tissemand.

nielsinho commented on Show HN: ML paper podcast generator using GPT and Tortoise-TTS scribepod.substack.com/p/... · Posted by u/yacine_

ax8080 · 3 years ago

and it's funny how sometimes it makes ahhrhrhrhrhhhhh sounds what is the reason behind that?

nielsinho · 3 years ago

It happens quite often with TorToiSe that it collapses in this way. Especially for unseen tokens that wouldn't have appeared in the training data, which likely consisted of a lot of transcribed stuff and read text like audio books. Trying to make it laugh by prompting it with "hahaha" (which you won't really see in mentioned data) often gets you demon and zombie noises.

nielsinho commented on Show HN: ML paper podcast generator using GPT and Tortoise-TTS scribepod.substack.com/p/... · Posted by u/yacine_

tehsauce · 3 years ago

How did they get to use the joe rogan voice though? It seems that one isn’t public?

nielsinho · 3 years ago

It uses the TorToiSe TTS model for generation. It's simple to generate conditioning voice latents using short audio samples. Likely transcribed JRE episodes were part of the TorToiSe training data, explaining how it's so good at recreating his voice characteristics in particular.

nielsinho commented on Ask HN: What to do to be healthy when old? · Posted by u/jonathan-kosgei

nielsinho · 3 years ago

The book "Jellyfish Age Backwards" is very good and covers as well as sorts modern science in anti-aging and health. Definitely recommend this book.

nielsinho commented on Tesla Dojo Custom AI Supercomputer at HC34 servethehome.com/tesla-do... · Posted by u/belltaco

mg · 4 years ago

It's interesting to see to what extent matrix multiplication and backpropagation are dominating the AI space these days.

I wouldn't be surprised if other approaches like genetic programming will make a comeback one day.

If there are any papers out there arguing for/against neural networks to stay in the king's seat forever, I would love to see them.

nielsinho · 4 years ago

You can take a look here: https://youtu.be/27PYlj-qNb0

nielsinho commented on Who is going to replace Google for us? michaeldehaan.substack.co... · Posted by u/zdw

marginalia_nu · 4 years ago

Dunno about you, but easily half the emails I get are advertisements.

nielsinho · 4 years ago

Are you sure it's Gmail sending you those advertisements?

u/nielsinho

KarmaCake day10April 2, 2022View Original