Readit News logoReadit News
exebook commented on Large Enough   mistral.ai/news/mistral-l... · Posted by u/davidbarker
drewnick · 2 years ago
All 3 models you ranked cannot get "how many r's are in strawberry?" correct. They all claim 2 r's unless you press them. With all the training data I'm surprised none of them fixed this yet.
exebook · 2 years ago
Tokenization can be bypassed like this; (mistral large 2)

How many letters R are in the word "s-t-r-a-w-b-e-r-r-y"?

The word "s-t-r-a-w-b-e-r-r-y" contains three instances of the letter "R."

How many letters R contain the word strawberry?

The word "strawberry" contains two instances of the letter "R."

exebook commented on Yes, social media is a cause of the epidemic of teenage mental illness   afterbabel.com/p/phone-ba... · Posted by u/throwup238
exebook · 2 years ago
I'd guess these poor teenagers were mentally sick of something else before the social networks thing came to be. And they will be sick of another thing after social networks get replaced.

Important thing is that we have developed rules that parents teach to kids in regards to many things, but we've developed those rules for centuries, now with internet we need generations before kids will be ready to dangers of internet as good as they are prepared for the dangers of the street for example. Damn we still have bullying in schools, because schools are around just recently, like 100+ years, we have not adapted yet.

exebook commented on JWST Captures Image of Supernova That 'Absolutely Shattered' a Star   smithsonianmag.com/smart-... · Posted by u/Brajeshwar
jsbisviewtiful · 2 years ago
A good premise for a sci-fi series: In the distant future, a large fleet of earth's best and brightest travels the stars while desperately trying to invent Earth's last ditch-effort to save its 12 billion inhabitants from a soon-to-be cataclysmic, near-earth supernovae: FTL travel. After decades of progress finally nears fruition, the fleet permanently loses contact with earth; humanity's home Solar System's remnants lost to the beautiful, nightmare... The fleet of 80,000 now works to save itself, the last of humanity.
exebook · 2 years ago
Sounds like a cross over of The Age of Supernova and Tri-body Problem. In the former Supernova radiation kills all people on earth except kids under 13.
exebook commented on Ask HN: Anyone using proportional fonts for coding?    · Posted by u/rpastuszak
exebook · 3 years ago
I made my own proportional font Variable.ttf and refined it for over a decade. I am using it daily. Over many iterations I refined space width and each important coding character's shape and size. Added some ligatures in the last few years. It's very good I consider it a work of art, and I cannot think about going back to fixed fonts. Only me and my friend use it.

https://github.com/exebook/variable

exebook commented on Xterm: It's better than you thought (2021)   aduros.com/blog/xterm-its... · Posted by u/ecliptik
csdvrx · 3 years ago
xterm is very good. It's only now that I've moved to Linux on the desktop that I found better with wezterm (for tabs mostly) and foot (for a quick quaketerm).

wezterm is now becoming my favorite: it's not just very fast and responsive, but it supports sixels and has many little "details" I need like ligatures, telling you when a font doesn't support some unicode character, font fallbacks to maximize unicode coverage, and a very active community that can help you with whatever may not be clear from reading the documentation alone (I'm lua-challenged lol)

As for tabs in xterm, and a few other nice defaults I recommend the config I made during my last foray with Linux on the desktop: https://github.com/csdvrx/cutexterm

exebook · 3 years ago
When you say community, where exactly you find people who can help with wezterm?
exebook commented on Why split lexing and parsing into two separate phases?   tratt.net/laurie/blog/202... · Posted by u/ltratt
matheusmoreira · 3 years ago
Lexer is just a parser for a regular language. They output a linear stream of tokens, conceptually similar to a stream of characters, only smaller in size and easier to create a grammar for since superfluous elements like spaces are discarded. You could totally parse at the character level if you want to by treating each character as a token, it's just that it makes things needlessly hard.

The general rule seems to be: lexer is for parsing linear structures like numbers and symbols while parsers are for recursive nested structures like lists and objects.

exebook · 3 years ago
And especially strings, which with all those escape codes are small programming languages in it's own right.
exebook commented on Why split lexing and parsing into two separate phases?   tratt.net/laurie/blog/202... · Posted by u/ltratt
WalterBright · 3 years ago
In my first C compiler, I combined the lexer and preprocessor. That was a mistake. The (much) later one I wrote, Warp, tokenized and then preprocessed. It was much easier to work with.
exebook · 3 years ago
It is also about performance.

I've watched a video recently from a guy who compiled entire Linux kernel in under 1 second I believe, he used TinyC and also noticed that something like 90% of compilation is tokenization of headers that are included many times, like there are headers that are included thousands of times in almost every C file, so he ended up caching tokens. So a big reason to have a separate tokenizer is that tokenization is a simpler task and can be optimized with all low level approaches, like perfect hashes, crafted nested switch/if tries, branchless algs, compiler intrinsics etc.

The good tokenizer is about as fast as a speed of writing the output array of records into memory. Which means it is important to choose right memory layout for your tokenized data so that when parser reads tokens it has as little cache misses and indirect memory access as possible. Tokenization can be thought of as a sort of in memory compression.

exebook commented on Alien Supercivilizations Absent from 100k Nearby Galaxies (2015)   scientificamerican.com/ar... · Posted by u/_Microft
anonzzzies · 3 years ago
Something like this indeed; imagine us in 1000 years (if we don’t blow ourselves up or something before that); we would have brain up/download, the tinniest and energy efficient chip-equivalent that can run your brain and photorealistic VR.

Even with those simple extrapolations, it’s easy to see that we can stick a few billion ‘humans’ (brains-on-chip) in a solar powered spaceship and just let it hang there for eternity or it could do a journey to somewhere. But what’s the point of a journey as inside this relatively tiny ship, these brains will live in a world (probably a clone of older earth) with a universe around it they can explore.

This seems all rather feasible given time and we would not seem very advanced from the outside; you would hardly be able to detect us at all and yet 100s of billions people live in perpetual paradise (or hell, but again; why would you make it bad if you don’t have to).

exebook · 3 years ago
Exploration seems like a natural way for civilisation to live, but that's because exploration is needed to expand knowledge and grow more intelligent, we as a civilisation mostly became obsessed with intellect dozens generation ago, if not less, and gathering knowledge and exploring for us seems so important right now. It might be less important if important at all for species who have been intelligent for a long time and gathered orders of magnitude more knowledge than we do.

Related question is do species really need intellect at all and how much. It could be that the main purpose of intellect is to increase chances to survive, but what if civilisation already figured survival, will they even need to stay intelligent? Maybe their goal is to be happier or maybe have billion orgasms per second.

Another more obvious reason to explore the universe is lack of resources, at least Earth was mostly explored to be exploited. If resources are solved, one reason to explore less.

exebook commented on Ask HN: Most interesting tech you built for just yourself?    · Posted by u/l2silver
exebook · 3 years ago
Huawei y8p, Android 10, 2400x1080, Chromium 88. Hope this helps.
exebook · 3 years ago
posted here because I couldn't find the repository. I was looking here https://github.com/memechain
exebook commented on Ask HN: Most interesting tech you built for just yourself?    · Posted by u/l2silver
bussyfumes · 3 years ago
Thank you, I'm aware that it sometimes looks off on certain Android phones, however I haven't had a case where it is unplayable. Could you tell me your phone model, what size/resolution is the screen?

I can't promise a speedy resolution since I don't have an Android but I'll definitely look into it when I get a chance. You can share your details here, send them to me by email or open an issue in the repo.

exebook · 3 years ago
Huawei y8p, Android 10, 2400x1080, Chromium 88. Hope this helps.

u/exebook

KarmaCake day212May 21, 2015View Original