Readit News logoReadit News
lajamerr commented on Scalable MatMul-Free Language Modeling   arxiv.org/abs/2406.02528... · Posted by u/lykahb
logicchains · 2 years ago
It's also a fundamentally different class of model than the original BitNet; it's a linear transformer, without quadratic attention.
lajamerr · 2 years ago
So a mishmash of ideas from other papers(Not to downplay the results). This is exciting times of hackery and basically using puzzle pieces and piecing together stuff.

This is the kind of stuff that can only be done so quickly by having more and more people brought into the field to try these ideas out. The more people the more permutations of ideas.

lajamerr commented on AWS charge for using IPv4 expected to bring $1B/year and speed up IPv6 adoption   tomshardware.com/networki... · Posted by u/simonpure
jazzyjackson · 2 years ago
64 bits is too many bits. honestly could have slapped a country+area code in front and gained a few hundred IPv4 addresses per person.
lajamerr · 2 years ago
128 bits*
lajamerr commented on SSH3: SSHv2 using HTTP/3 and QUIC   github.com/francoismichel... · Posted by u/kieto
mmaunder · 2 years ago
How intentionally vague.
lajamerr · 2 years ago
I assume he means with the encrypted metadata in HTTP/3 / QUIC that it makes it harder as a security admin to "peek" at what is going on in the network.

In my opinion its short sighted, because if we care about security, then we should care about user security and privacy as well. Because if the security admin has the ability to packet inspect stuff, so does a potential malicious app.

lajamerr commented on Color-Diffusion: using diffusion models to colorize black and white images   github.com/ErwannMillon/C... · Posted by u/dvrp
erwannmillon · 2 years ago
temporal coherence is def an issue with these types of models, though I haven't tested it out with ColorDiffusion. Assuming you're not doing anything autoregressive (from frame to frame) to do temporal coherence, you can also parallelize the colorization of each frame, which would affect cost.

Tbh most cost effective would be a conditional GAN though

lajamerr · 2 years ago
Change up the model. That allows it to see previous frames and 1-2 future frames.

Then train the model on movies that are color and then turn them black and white.

That way you can train temporal coherence.

lajamerr commented on Hackers manage to unlock Tesla software-locked features   electrek.co/2023/08/03/ha... · Posted by u/1970-01-01
hot_gril · 2 years ago
What's the difference between the second and the third?
lajamerr · 2 years ago
Probably the same sentiment between DLC vs Expansions in gaming.

But fundamentally no difference because you are getting a discounted price in exchange for the soft locked feature. So 2 and 3 are the same imo.

lajamerr commented on Embracing change and resetting expectations – Terence Tao   unlocked.microsoft.com/ai... · Posted by u/lajamerr
lajamerr · 3 years ago
For context Terence Tao is often referred to as one of the greats of modern mathematicians of our time.

He also has a Mastodon account where he sometimes goes over the implications of LLMs and in this post is his musings of how he sees it's current potential and possible impact in the near future for mathematics.

"The 2023-level AI can already generate suggestive hints and promising leads to a working mathematician and participate actively in the decision-making process. When integrated with tools such as formal proof verifiers, internet search, and symbolic math packages, I expect, say, 2026-level AI, when used properly, will be a trustworthy co-author in mathematical research, and in many other fields as well."

Deleted Comment

lajamerr commented on Emergent Mind: AI News, Curated and Explained by AI   emergentmind.com/... · Posted by u/janpio
matt1 · 3 years ago
Hey all, Matt here, Emergent Mind's creator.

I shared Emergent Mind on HN yesterday [1], but it didn't wind up making it onto the homepage. Someone shared it here again today, so here we are again.

Copy/pasting my comment from the post yesterday for context on the site:

--

Like many of you, I've found it difficult to stay on top of all the latest AI news and research. I wanted a simpler way to surface and learn about about what's happening in the AI world, so built Emergent Mind.

Here's the idea:

- A bot named Emma automatically finds trending AI news and posts it to Emergent Mind, though human users can sign up and share links as well.

- Emma automatically summarizes links that are shared and also explains key terms from the page, which is especially helpful for academic research.

- Posts also display popular tweets about that news item, giving you a sense of what others in the AI world are saying about it.

- Posts are grouped by day, making it easy to tell what's going on today. And within each day, posts are ordered by how popular that news item is which is based on a combination of votes, page views, and Twitter shares.

- We're also working on a newsletter which you're welcome to sign up for if you'd prefer to get the news daily or weekly via email.

We have lots more planned for the site in the coming weeks, but are excited to share this initial version with you all.

Feedback/suggestions welcome on any of it!

--

[1] https://news.ycombinator.com/item?id=35340703

lajamerr · 3 years ago
Thanks, I just hope this is sustainable. I like newsletters and the site design is simple and basic. I hope there's some way you can set up like a monthly contribution of like $1-$5 to pay for some of the hosting/API costs.

The main concern though for me is long term vision for the site. I'd really like it to stay user/community oriented and hopefully the users can pay for the costs with donations/contributions.

lajamerr commented on Khan Academy integrates GPT-4 as every student’s customized tutor   openai.com/customer-stori... · Posted by u/pr337h4m
Buttons840 · 3 years ago
My daughter is in 2nd grade and math is her favorite subject. I liked math too. I've looked forward to helping her learn more advance math through the years, but a doubt has entered my mind; will I have any reason to help her?
lajamerr · 3 years ago
AI can efficiently teach your daughter how to solve math problems, but as a human, you can provide her with the context and understanding of why and what she's learning. AI is great at handling the technical aspects, freeing us to focus on cultivating our uniquely human qualities of empathy, creativity, and critical thinking. Letting the AI teach the how and the human teach the why and what can lead to a more holistic and enriching education.

u/lajamerr

KarmaCake day168October 18, 2018View Original