Readit News logoReadit News
michaelsbradley · 2 months ago
There’s also Functional Differential Geometry by the same Sussman and Wisdom:

https://mitp-content-server.mit.edu/books/content/sectbyfn/b...

noosphr · 2 months ago
I've often dreamed of a "Structure and interpretation" series of books.

Scheme is pretty close to a universal computation substrate that provides enough ergonomics to be human understandable and writing anything out in it provides genuine illumination to what's going on under the hood.

The "little" books are a tease of what that series could be.

fouronnes3 · 2 months ago
I want to write Structure and Interpretation of Geometric Optics. I have an outline already in my notes and I'm convinced that the computing-first approach would benefit the field immensely. I've been learning optics for a while and writing a python library [0]. With a background in software it's very obvious that there is strong SICP vibes in lenses, refraction, etc. I just need someone to trust me and write me a check for 1 or 2 years salary so I can go full bunker mode and write it =)

[0] https://victorpoughon.github.io/torchlensmaker/

noosphr · 2 months ago
Sicp is not computation first. Sicp is understanding first.

Doing the calculations automatically is a happy side effect of finding the right abstractions for describing what's happening physically and those abstractions being expressed in scheme already.

E.g. Exercise 3.73 in SCIP asks how to implement an electrical circuit using a stream data structure. Because of all the work done beforehand you end up with an expression which describes the time behaviour of the circuit using the same expressions that describe its layout.

dang · 2 months ago
Related. Others?

Structure and Interpretation of Classical Mechanics (2015) - https://news.ycombinator.com/item?id=40805136 - June 2024 (12 comments)

Structure and Interpretation of Classical Mechanics - https://news.ycombinator.com/item?id=31568387 - May 2022 (1 comment)

Structure and Interpretation of Classical Mechanics - https://news.ycombinator.com/item?id=23153778 - May 2020 (40 comments)

Structure and Interpretation of Classical Mechanics (2015) - https://news.ycombinator.com/item?id=19765019 - April 2019 (87 comments)

Structure and Interpretation of Classical Mechanics - https://news.ycombinator.com/item?id=9560567 - May 2015 (20 comments)

Structure and Interpretation of Classical Mechanics - https://news.ycombinator.com/item?id=6947257 - Dec 2013 (37 comments)

Structure and Interpretation of Classical Mechanics - https://news.ycombinator.com/item?id=1581696 - Aug 2010 (20 comments)

Jtsummers · 2 months ago
By the same authors so related but not SICM itself:

Functional Differential Geometry (2012) [pdf] - https://news.ycombinator.com/item?id=7884551 - June 2014 (38 comments)

throwaway81523 · 2 months ago
I didn't get anywhere trying to read this book. Then I watched a youtube video about calculus of variations and suddenly Lagrangian dynamics made total sense to me. I should probably try reading the book again.
arunix · 2 months ago
Do you remember which video that was?
griffzhowl · 2 months ago
I don't know which it was but Dr. Jorge Diaz has an excellent video on Lagrangian mechanics as part of a series on quantum mechanics (this video just pertains to the formalism applicable classically)

https://www.youtube.com/watch?v=QbnkIdw0HJQ

throwaway81523 · 2 months ago
I don't remember the specific video but it was pretty elementary and got across the point that I had missed, you're not looking for a global optimum through some fancy operations on function spaces, you're just doing the old fashioned calculus thing of finding a maximum by setting a derivative to zero. Except you are doing that only at one endpoint of the mystery function, and its value (the boundary value) and derivative at that point (zero) are known, and you can work out the ODE that continues the solution. That's the Euler-Lagrange equation and suddenly everything makes sense.
zkmon · 2 months ago
Funny that we call it classical. Newton wouldn't have called it so. Maybe we should categorize sciences based on the spatial scale at which they operate.A specific scale might define a world that has it's logic system, purpose, reasoning etc. For example, quantum scale, human scale and cosmic scales have their own physics, logic and causality.
kergonath · 2 months ago
> Newton wouldn't have called it so.

Of course. To him that would be modern mechanics. Or just mathematical natural philosophy, or whatever.

> Maybe we should categorize sciences based on the spatial scale at which they operate.

That would not be very useful, because there is no boundary. Nothing in general relativity says "below this everything is Newtonian". As a matter of fact we need to consider relativistic effects in quantum chemistry calculations that involve some heavy elements, at length scales smaller than 0.1 nm. Similarly, they just gave a Nobel prize for work on "Quantum properties on a human scale".

> For example, quantum scale, human scale and cosmic scales have their own physics, logic and causality.

That is not at all how these frameworks are built, and that is not the dominant epistemological approach. The mainstream view is that there is a theory of everything that exists but is unknown to us, and that our various theories are approximations of that theory under different assumptions. They look categorically different because we don’t understand the overarching framework, not because nature is fundamentally different depending on scale.

Also, I don’t see how the logic is fundamentally different between e.g. quantum mechanics and general relativity. Both rely heavily on things like Hamiltonian mechanics or symmetries. Some behaviours are different (like photons following geodesics and not straight lines, or superpositions of quantum states), but these are not a fundamental problem: a straight line is a limit case of a geodesic in a flat space, and a unique state is a limit case of superposition.

I am not saying that everything is fine and we know everything, just that there is no clear boundary between the situations in which different theories are required and we cannot neatly decompose the universe into different realms where different theories apply.

zkmon · 2 months ago
From my little knowledge, logic at Quantum scale appears quite different:

* Things don't have their own location or identity

* Spatial and temporal extents don't exist

* Something may be true and false at the same time, or concept of true and false may not be defined

* cause and effect goes for a toss, as behavior of time is different

* Existence and non-existence co-exist, or come into existence together

Similar effects at relatively-infinite scale (maybe purely mathematical)

* Comparisons (big/small/equal) breakdown

* Regular arithmetic and logic breaks down

IAmBroom · 2 months ago
> > Maybe we should categorize sciences based on the spatial scale at which they operate.

> That would not be very useful, because there is no boundary. Nothing in general relativity says "below this everything is Newtonian". As a matter of fact we need to consider relativistic effects in quantum chemistry calculations that involve some heavy elements, at length scales smaller than 0.1 nm. Similarly, they just gave a Nobel prize for work on "Quantum properties on a human scale".

You are just saying "well ackshually". I dare you to build a cabinet using the Hamiltonian. I double-dog-dare you.

> > For example, quantum scale, human scale and cosmic scales have their own physics, logic and causality.

> That is not at all how these frameworks are built, and that is not the dominant epistemological approach.

Again, 99.999% of all functional mechanics don't involve epistemology.

> The mainstream view is that there is a theory of everything that exists but is unknown to us, and that our various theories are approximations of that theory under different assumptions.

Oh! You're so close to seeing the point... There are multiple levels of approximation (at least two), and the one we all experience is Newtonian. Perhaps more accurately, our senses mostly believe pre-Newtonion approximations, which is why it took until Newton to realize how inaccurate they were.

> Also, I don’t see how the logic is fundamentally different between e.g. quantum mechanics and general relativity.

You're pretty radically moving the goalposts here. GP was talking about Newtonian mechanics, not Hamiltonian.

IAmBroom · 2 months ago
We call music from Newton's age "classical".

As the past recedes, "the golden age" advances in time. "Hollaback Girl" is now a classic oldie.

seanhunter · 2 months ago
The music of Newton’s age is Baroque music. Classical music either refers to the whole tradition of Western serious art music (starting approximately with Palestrina and continuing to the current day) or it refers to the period after Baroque.

So “ Baroque” is J.S. Bach, Handel, Charpentier, Purcell etc (1600-1750 ish), “classical” is mozart, J.C. Bach, Hayden etc up to Beethoven (1750ish-1800ish).

Classical mechanics as I was taught it is not to do with the time period,it means “mechanics when you don’t need to worry about relativity or quantum anything “.

hyperjeff · 2 months ago
These days “classical” just distinguishes all things quantum from non-quantum. General relativity is considered a classical theory, for example.
seanhunter · 2 months ago
That is very definitely classical mechanics, just that it emphasises the Lagrangian and Hamiltonian formulations rather than the Newtonian one (they explain their rationale for this in the beginning). These three formulations of classical mechanics are entirely equivalent though. When you learn mechanics at first you don’t learn the Hamiltonian at all and the Lagrangian isn’t mentioned by name but by formulating some problems in terms of kinetic and potential energy rather than equations of motion and showing that is equivalent. (Eg when I did mechanics we did that for simple harmonic motion).

I mean Newton wouldn’t recognize most of what we teach as Calculus because we use Leibnitz’ notation[1] or Lagrange’s notation almost exclusively, and only use Newton’s notation for derivatives with respect to time and don’t ever use Newton’s terminology (fluxions etc).

[1] So named because it was mostly invented by Euler.

in_a_hole · 2 months ago
Does anyone know a text which justifies why the Lagrangian approach works? This text and many others I have encountered just start with the Principle of Least Action taken as given and go from there but I'm left wondering why we define the Action as this object and why we should expect it to be minimised for the physical trajectory in the first place.

Failing a full derivation from the ground up, a proof of the equivalence to Newtonian mechanics would be interesting.

nchagnet · 2 months ago
Regarding the "why the action is this object" part of the question, I find that the easiest way to think about it is from the Hamiltonian perspective. There you can think of it as minimising energy along a trajectory. From that point, a Lagrangian is just a mathematical trick to express the symplectic structure differently.

But if your question was more about "why minimizing something yields trajectories", I personally would argue this is beyond physics. As an empirical science, physicists have seen this kind of behaviour broadly (optics, classical mechanics, quantum mechanics) and just unified it as an overarching principle.

Finally regarding the proof to newtonian mechanics, I don't have anything handy from the pure Newtonian perspective beyond the usual "minimises the lagrangian and your equations of motions look the same". However, you might be interested in proofs which show newtonian gravity as low energy approximation of general relativity. And since general relativity has a nice action formulation, it all gets nicely tied in.

Hope this helps!

in_a_hole · 2 months ago
But simply getting to the Lagrangian picture from the Hamiltonian picture would just leave me wondering why the Hamiltonian picture works!

My motivation for getting to the bottom of all this is to fill the gaps in my physics understanding at least up to quantum mechanics. I have a grasp of QM but I would like to have some insight into the conceptual leaps that brought us there from classical mechanics. QM works in the Hamiltonian picture and I recall from my undergrad days that you get there from a Legendre transformation on the Lagrangian (or something to that effect) so I'm trying to understand the justification of that approach before moving up the conceptual ladder.

Ideally I would like to be able to trace my way from simple postulates based on observation of the physical world all the way to QM, then maybe to QFT after that.

omnicognate · 2 months ago
It's an old book and I can't vouch for it as I only just discovered it myself, but it appears to be very highly regarded, it focuses on precisely the questions you (and I) have, and just from the preface I like the author already [1]: The Variational Principles of Mechanics, by Cornelius Lanczos.

There's a PDF here: https://pages.jh.edu/rrynasi1/PhysicalPrinciples/literature/...

[1] An appetising quote:

> The author is well aware that he could have shortened his exposition considerably, had he started directly with the Lagrangian equations of motion and then proceeded to Hamilton’s theory. This procedure would have been justified had the purpose of this book been primarily to familiarize the student with a certain formalism and technique in writing down the differential equations which govern a given dynamical problem, together with certain “recipes” which he might apply in order to solve them. But this is exactly what the author did not want to do. There is a tremendous treasure of philosophical meaning behind the great theories of Euler and Lagrange, and of Hamilton and Jacobi, which is completely smothered in a purely formalistic treatment, although it cannot fail to be a source of the greatest intellectual enjoyment to every mathematically-minded person. To give the student a chance to discover for himself the hidden beauty of these theories was one of the foremost intentions of the author.

DarmokJalad1701 · 2 months ago
The author of this book is the same Lanczos that the "Lanczos Resampling" algorithm (used in image resizing for example), is named after:

https://en.wikipedia.org/wiki/Lanczos_resampling

in_a_hole · 2 months ago
I had heard about this book and that quote makes me want to read it. Thank you.
ano-ther · 2 months ago
It’s been a while but I seem to remember that the first book of Landau-Lifschitz‘ Theroretical Mechanics starts with a 20 page discussion that does this and culminates in the Lagrangian.
in_a_hole · 2 months ago
I recently got hold of a copy of that. I started Hand & Finch - Analytical Mechanics but their woolly discussion of virtual work and virtual displacement was very frustrating and unenlightening. Perhaps I'll have a better time with L&L.
computerfriend · 2 months ago
It's a great introduction to Lagrangian mechanics, but as I recall (it's also been a while for me), the motivation for extremising the action is also somewhat vaguely presented.
lucozade · 2 months ago
> why we define the Action as this object and why we should expect it to be minimised for the physical trajectory in the first place.

The most coherent explanation I've heard was from Feynnman [0]. As far as I understand it (and I may well not have understood it at all well), at the quantum level, all paths are taken by a particle but the contributions of the paths away from the stationary point tend to cancel each other. So, at a macroscopic level, the net effect appears to be be that the particle is following the path of least action.

> a proof of the equivalence to Newtonian mechanics

The Lagrangian method isn't really equivalent to Newton's method. Again, Feynman talks about this in [0]. It's that for a certain class of action, the Euler-Lagrange equations are equivalent to Newton's laws.

It's perfectly plausible to come up with actions that recover systems that represent Einsteinian relativity or quantum mechanics. This is the main reason (as I understand it) why it's considered a more powerful formalism.

[0] https://www.feynmanlectures.caltech.edu/II_19.html

aap_ · 2 months ago
Unfortunately I can't help with the classical picture, but in quantum physics it all comes out very nicely: You can interpret the Lagrangian as giving all possibilities to build a trajectory through spacetime. In the path integral formulation we then follow one such trajectory from one configuration to another configuration and find its amplitude. And then we integrate over all possible trajectories that we could have picked. For incoherent trajectories there will always be another one that cancels out the amplitude. Where the amplitudes add up constructively you will find stationary action and the classical behavior in the limit. So this is a depth-first approach: first follow one trajectory completely, then add up all possible trajectories.

The Hamiltonian approach in contrast is breadth-first: you single out a time axis, start with some initial state, and consider all possibilities that a particle (or field in QFT) could evolve forwards in time just a tiny bit (this is what the Hamiltonian operator does). Then you add up all these possibilities to find the next state, and so you move forwards through time by keeping track of all possible evolutions all at once. This massive superposition of everything that is possible (with corresponding amplitudes) is what you call a state (or wavefunction) and the space that it lives in is the Hilbert (or Fock) space.

So Lagrangian/path-integral: follow full trajectories, then add up all possible choices. depth-first

Hamiltonian/time-evolution: add up all choices for a tiny step in time, then simply do more steps: breadth-first

I imagine it a bit like a scanline algorithm calculating an image as it moves down the screen (Hamiltonian) vs something like a stochastic raytracer that can start with an empty image and refine it pixel by pixel by shooting more rays (Lagrangian)

This is my layman explanation anyways...hopefully it helps, even though i can't say much about their relationship in classical physics.

whatshisface · 2 months ago
The least action principle conceptually emerged from the least time principle for light. Light refracts along the path that gets it from the starting to the ending point the quickest, and the index of refraction is what regulates its speed. The question went like this: we know that potential and kinetic energy work together to regulate the speed of moving objects. Is there a way to combine the two quantities into something like an index of refraction? The analogy between potential fields and optics isn't just conceptual - beams of charged particles are focused using electromagnetic "lenses," made out of fields.
in_a_hole · 2 months ago
Do you know any references that discuss this in detail? I'm interested in the history of these developments. Who noticed this? Who asked this question?
wbpaelias · 2 months ago
I believe Veritasium had a series where they derive the equivalence to Newton's laws
abdullahkhalids · 2 months ago
There is no explanation for this, same as there is no real explanation for why energy is conserved or why closed systems have non-decreasing entropy. As others have pointed out, you can show correspondence to Newtonian mechanics under some assumptions, but the Lagrangian approach is applicable to a wide variety of areas in physics - classical mechanics, optics, quantum mechanics, quantum field theory, etc.

The universe has these weird laws, and for now, all we can do is accept them as is. But hopefully, in the future, someone will figure out deeper and simpler principles.

nh23423fefe · 2 months ago
Seems false. Energy conservation is explained via time translation symmetry and noether's theorem. 2nd law is explained by boltzmann's H-theorem.
Cleonis · 2 months ago
While most authors posit the stationary action concept as a given, it is in fact possible to go from the newtonian formulation to the Lagrangian formulation, and from there to Hamilton's stationary action.

That is, the relations between the various formulations of classical mechanics are all bi-directional.

At the hub of it al is the work-energy theorem.

I created a resource with interactive diagrams. Move a slider to sweep out variation. The diagram shows how the kinetic energy and the potential energy respond to the variation that is applied.

Starter page: http://cleonis.nl/physics/phys256/stationary_action.php The above page features a case that allows particularly vivid demonstration. An object is launched upwards, subject to a potential that increases with the cube of the height. The initial velocity was tweaked to achieve that after two seconds the object is back to height zero. (The two seconds implementation is for alignment with two other diagrams, in which other potentials have been implemented; linear and quadratic.)

Article with mathematical treatment: http://cleonis.nl/physics/phys256/energy_position_equation.p...

To go from F=ma to Hamilton's stationary action is a two stage proces:

- Derivation of the work-energy theorem from F=ma

- Demonstration that in cases such that the work-energy theorem holds good Hamilton's stationary action holds good also.

General remarks: In the case of Hamilton's stationary action the criterion is: The true trajectory corresponds to a point in variation space such that the derivative of Hamilton's action is zero. The criterion derivative-is-zero is sufficient. Whether the derivative-is-zero point is at a mininum or a maximum of Hamilton's action is of no relevance; it plays no part in the reason why Hamilton's stationary action holds good.

The true trajectory has the property that the rate of change of kinetic energy matches the rate of change of potential energy. Hamilton's stationary action relates to that.

The power of an interactive diagram is that it can present information simultaneously. Move a slider and you see both the kinetic energy and the potential energy change in response. It's like looking at the same thing from multiple angles all at once.

in_a_hole · 2 months ago
This seems promising, I'll dig into this later.
Schiphol · 2 months ago
Does anybody know of a way to run the code in this book? I've tried a couple of times but never quite succeeded.
gsf_emergency_4 · 2 months ago
gugagore · 2 months ago
The bug being "perturbation confusion"?
kkylin · 2 months ago
MIT Scheme (and ScmUtils) are unfortunately not getting enough maintainence, but they still work with a little effort. Probably better on Linux than any other environment. If you have a Mac you may try this:

https://github.com/kkylin/mit-scheme-intel-mac-patch?tab=rea...

Works well on Intel Macs and (with effort) mostly works on Apple Silicon.

nemoniac · 2 months ago
You can run it in Racket with the SICP language.

https://docs.racket-lang.org/sicp-manual/SICP_Language.html

Schiphol · 2 months ago
Ah, nice, I'll try that. SICM in particular relies on numerical routines and things for scientific computing that this perhaps doesn't cover. We'll see. Thanks!
tantony · 2 months ago
I was able to get pretty far using Clojure and this package instead of Scheme: https://github.com/sicmutils/sicmutils

I was able to make "CloJupyter" notebooks with the examples from the book. You can see some of my notes here (only goes till Chapter 2): https://www.thomasantony.com/projects/sicm-workbook/

HexDecOctBin · 2 months ago
I found this, will try tomorrow: https://hub.docker.com/r/sritchie/mechanics/
noosphr · 2 months ago
Schiphol · 2 months ago
This is what I tried, unsuccessfully if I remember correctly. I'll give it another try, thanks!
mindaslab · 2 months ago
What software they used to create this wonderful book?