Readit News logoReadit News
johan_felisaz commented on What Is Entropy?   jasonfantl.com/posts/What... · Posted by u/jfantl
anon84873628 · 8 months ago
Nitpick in the article conclusion:

>Heat flows from hot to cold because the number of ways in which the system can be non-uniform in temperature is much lower than the number of ways it can be uniform in temperature ...

Should probably say "thermal energy" instead of "temperature" if we want to be really precise with our thermodynamics terms. Temperature is not a direct measure of energy, rather it is an extensive property describing the relationship between change in energy to change in entropy.

johan_felisaz · 8 months ago
Nitpick of the nitpick... Temperature is actually an intensive quantity, i.e. combining two subsystems with the same temperature yields a bigger system with the same temperature, not twice bigger.
johan_felisaz commented on Rewilding the Self   worldsensorium.com/rewild... · Posted by u/dnetesn
arn3n · a year ago
This is a take on environmental communication I’ve heard more and more of recently. Out of curiosity, do you know of other literature or people trying to reframe the human/nature relationship?
johan_felisaz · a year ago
The anthropologist Philippe Descola with his main work Beyond Nature and Culture has been trying to classify the nature/culture relations by studying comparatively several societies.
johan_felisaz commented on Rewriting Rust   josephg.com/blog/rewritin... · Posted by u/yett
johan_felisaz · a year ago
The section on comp time is written in a way which makes you think that zig invented the concept. It slightly irritated the lisper in me...

Great article apart from that.

johan_felisaz commented on Tegelwippen   nk-tegelwippen.nl/... · Posted by u/madc
microtonal · 2 years ago
Its like german but with english syntax

I don't want to be too pedantic, but it's not. Dutch syntax is very similar to German, both are typically analyzed as an SOV (subject-object-verb) language with movement of the finite verb to the V2 position in declarative main clauses, unlike English.

Word order of Dutch and German clauses (+ some other Germanic languages) are typically described in terms of topological fields [1] and Dutch and German have very similar (albeit not the same) topological field constraints, leading to very similar word orders. Like German, Dutch has grammatical genders (three like German, though only two are distinguished in definite articles), similar verb conjugation, etc.

People are often led to believe that Dutch is more similar to English because it doesn't have overt case marking.

[1] Simplified, a clause is partitioned into a vorfeld, mittelfeld, and nachfeld by the so-called brackets, which are the V2 and verb cluster positions.

johan_felisaz · 2 years ago
Coming from a quantum physics point of view, it is very strange to see the term "topological fields" in this context !

Do you have recommended references about these grammatical constructs ?

johan_felisaz commented on Neural network training makes beautiful fractals   sohl-dickstein.github.io/... · Posted by u/telotortium
PheonixPharts · 2 years ago
I find this result absolutely fascinating, and is exactly the type of research into neural networks we should be expanding.

We've rapidly engineered our way to some very impressive models this past decade, and yet gap in our real understanding of what's going on has widened. There's a large list of very basic questions about LLMs that we haven't answered (or in some cases, really asked). This is not a failing of people researching in this area, it's only that things move so quickly there's not enough time to ponder things like this.

At the same time, the result, unless I'm really misunderstanding, gives me the impression that anything other than grid search hyper parameter optimization is a fools errand. This would give credence to the notion that hyper parameter tuning really is akin to just re-rolling a character sheet until you get one that is over powered.

johan_felisaz · 2 years ago
There is an expanding field of study looking at machine learning with statistical physics tools. While there is still a lot of work to do in this area, it yields interesting insights on neural networks, e.g. linking their training with the evolution of spin glasses (a typical statistical physics problem). We can even talk about phase transition and universal exponents.

Most of the research is done with simpler models though (because mainly math people do it, and it's hard to prove anything on something as complex as a transformer).

johan_felisaz commented on VS Code Org Mode   github.com/vscode-org-mod... · Posted by u/spac
johan_felisaz · 3 years ago
I feel like it would have been nicer to have a perfect match with orgmode syntax (e.g. they use square brackets instead of chevrons for time stamps). It would make migration easier... Really impressive project nonetheless!
johan_felisaz commented on They Called It LISP for a Reason: List Processing (2005)   gigamonkeys.com/book/they... · Posted by u/susam
ducktective · 3 years ago
Can anyone link a screencast of doing Common Lisp with all its cool interactive features? (REPL-driven, SLY/SLIME, restarts, etc) and I mean doing real small projects not just simply touting how cool lisp is or talking about (+ 2 3) and C-c C-c

I tried searching on YouTube but didn't find anything particularly unique.

johan_felisaz · 3 years ago
I would recommend this: https://m.youtube.com/user/CBaggers/featured

This is a real project, this guy wrote a compiler, to convert common lisp to GLSL (I'm not talking about a simple DSL with code generation, but also type checking and so on).

In his Livestreams, he usually try to implement a specific 3D feature (like triplanar mapping, the Phong of lighting, ...).

Everything is done in a single window, with the program being recompiled while running, pure lisp style.

He is on a hiatus right now though with livestreams, but there is plenty of material already to watch ...

johan_felisaz commented on Why is it so hard to write a scaffolding tool? (2019)   jfreeman.dev/blog/2019/05... · Posted by u/noworriesnate
maydup-nem · 3 years ago
... and God granted zoomers homoiconicity, macros and parenthesis.

"No," said the zoomers, "we want to write XML, build scaffolding tools and eat shit."

"Your language will never be a LISP," was the God's reply.

johan_felisaz · 3 years ago
Does it come from somewhere or you just made that up ? I have a really strong feeling of déjà vu but cannot figure out from where.

u/johan_felisaz

KarmaCake day66November 11, 2020View Original