Even did a ~7 year career detour through quant finance "if I like Software Engineering and Mathematics so much, why don't I combine the two?"
Finally realized that the best use of my time was to just to work hard at a career I deeply enjoy (Software Engineering), working on products I actually care about (not valuing arcane derivatives products), and just invest the excess in diversified index funds (with some single stock selections here and there, thanks TSLA and NVDA).
Just as engineers can get "nerd sniped", I feel like "trading" is a somewhat malevolent strong attractor for a lot of folks. Folks do need general financial literacy, but an extra hour spent per day working harder to progress day job / long term career likely has a higher net present value than trading options or crypto.
If this isn't the Singularity, there's going to be a big crash. What we have now is semi-useful, but too limited. It has to get a lot better to justify multiple companies with US $4 trillion valuations. Total US consumer spending is about $16 trillion / yr.
Remember the Metaverse/VR/AR boom? Facebook/Meta did somehow lose upwards of US$20 billion on that. That was tiny compared to the AI boom.
I was working on crypto during the NFT mania, and THAT felt like a bubble at the time. I'd spend my days writing smart contracts and related infra, but I was doing a genuine wallet transaction at most once a week, and that was on speculation, not work.
My adoption rate of AI has been rapid, not for toy tasks, but for meaningful complex work. Easily send 50 prompts per day to various AI tools, use LLM-driven auto-complete continuously, etc.
That's where AI is different from the dot com bubble (not enough folks materially transaction on the web at the time), or the crypto mania (speculation and not utility).
Could I use a smarter model today? Yes, I would love that and use the hell out of it. Could I use a model with 10x the tokens/second today? Yes, I would use it immediately and get substantial gains from a faster iteration cycle.
…and this is the worst the capabilities will ever be.
Watching the video created a glimmer of doubt that perhaps my current reality is a future version of myself, or some other consciousness, that’s living its life in an AI hallucinated environment.
400Mhz Pentium 2
128MB
Nvidia Riva TNT
3DFX Voodoo2
CDRW (4x4x24 I think)
Syquest SparQ (Awesome, but had major issues)
Internal Zip Drive
Just a ridiculous system for the time. Quake 2 and Starsiege Tribes were really popular in our dorm and that system was just perfect for it. Also popular was burning lots of pirated games, so we'd order CDRs in bulk from this really random site overseas. High quality "gold" CDRs and they were far more reliable than any of the ones you'd find in stores in the US for about half the cost.Halfway through my freshman year I decided to swap the motherboard and CPU for a crazy motherboard/CPU combo. There was a brief moment where Intel Celerons didn't really prevent you from using them in a dual CPU setup, so I had two 366mhz Celerons overclocked to ~433mhz (sometimes up to 533mhz, but that was less stable) and started playing around with OSs like Linux and BeOS to actually take advantage of them.
edit: corrected the amount of memory
/end reminiscing about a simpler time
Convinced my parent's to buy a new PC, they organized with a local computer store for me to go in and sit with the tech and actually build the PC. Almost identical specs in 1998: 400Mhz Pentium 2, Voodoo 2, no zip drive, but had a Soundblaster Live ($500 AUD for this at the time).
I distinctly remember the invoice being $5k AUD in 1998 dollars, which is $10k AUD in 2024 dollars. This was A LOT of money for my parents (~7% of their pretax annual income), and I'm eternally grateful.
I was in grade 8 at the time (middle school equivalent in USA) and it was the PC I learnt to code on (QBasic -> C -> C++), spent many hours installing Linux and re-compiling kernel drives (learning how to use the command line), used SoftICE to reverse engineer shareware keygen (learning x86 assembly), created Counterstrike wall hacks by writing MiniGL proxy dlls (learning OpenGL).
So glad there wasn't infinity pools of time wasting (YouTube, TikTok, etc) back then, and I was forced to occupy myself with productive learning.
/end reminiscing
I've wondered if a similar thing can be how much people are affected by things like Virtual Reality. After the initial five minute first try I never could get very immersed in VR (more than a regular 2D game). I could never feel any fear of height or anything for instance, it didn't grab me.
I've wondered a while if that is a correlation that spans other people. If the people who get blown away by VR would also have large lasting effects of psychedelics, and vice versa.
Ketamine was very interesting. Proper completely dissociative "K-hole" experience. I feel like it helped with Anxiety, but I can't pinpoint "why" from an introspective perspective.
Psilocybin on the other hand. Was a hero dose, and I'm a changed person afterwards.
Could feel the "layers" of my identity being stripped off, almost regression to a more child-like state. Very interesting experience. Had strong synesthesia: sounds would produce colors, colors would produce tastes, fun experience.
Near the peak of the experience I had these strong recurring auditory hallucination of my mothers says all these random words from my youth, these were accompanied by strong feeling of anxiety. After a lot of post-experience integration and reflection I realized that my mothers anxiety about the world was effectively "programmed" into my brain during my upbringing. e.g. Generationally transmitted anxiety.
Therapy always talks about childhood trauma, etc, but actually experiencing it was another level, and really helped me on my journey to being a less anxious person.
Before the Psilocybin experience, I suffered from existential depression: what's the point of living if the sun is going to explode in ~x billion years. Towards the peak of the experience everything was super chaotic, I felt like I was being transported into different realities (e.g. realities with different laws of physics, or different space time geometries). This was hugely anxiety inducing and would otherwise be called a "bad trip." I felt "lost" in this sea of all different realities.
As I was coming down from the peak and started to reintegrate, I had a strong distinct sense of "coming back" to our current reality. It felt like finding a safe tropical island in a sea of chaos: e.g. our currently reality is a safe space and point of stability in a sea of chaos and uninviting realities.
I was truly, deeply, grateful to be able to return to the familiar and it made me really really deeply appreciate myself and the blessing that our reality is to us.
Post the experience I also acquired the ability to observe my emotions from a third person perspective. e.g. rather than feeling "angry" I could tag the emotion "angry" and react accordingly, almost as if I gained ring 0 access to my brain when I previously only have ring 1 access.
All-in-all probably the most profound and healing experience of my life.
1. Deeply felt and understood my anxiety was generationally passed on from my mother's anxiety,
2. Eliminated my existential depression, giving me a deep appreciation for the beauty of our reality,
3. Gave me ring 0 access to my emotions making me a much more stable, calm person.
What I mean by this, is the process of coming up with novel ideas a single capability that has to be trained and reinforced.
Or is it a ladder of capabilities of increasing complexity in that a model that could figure of General Relativity from scratch would not be able to continue the process and perhaps come up with a viable “theory of everything.”
One thing I’ve wanted to do, I’m sure somebody has tried it, is build a dataset to RL a model to be more creative: Get a human expert in a field, have them ask a reasoning model some open questions, and then have the expert look at 20 outputs and rank them by creativity / insight. Have the expert iterate and see how much new “insight” they can mine from the model.
Do this across many fields, and then train a model on these rankings.
Perhaps creativity is a different way of moving in latent space which is “ablated” from existing models because they’re tuned to be “correct” rather than “creative.”
Also curious what techniques there are to sample a reasoning model to deliberately perturb its internal state into more creative realms. Though these a fine line between insight and hallucination.
In some respects creativity is hallucination. As a human, you’re effectively internally postulating creative ideas “hallucinations” and then one of them “hits” and fires a whole bunch of neurons which indicate: “ok that wild idea actually has grounding and strong connections to the existing knowledge in your brain.”
Most spot on visual depictions of psychedelic artifacts I’ve witnessed.
Saw them together last year and it’s the no. 1 artistic experience of my life. The richness, and complexity of Fractaled Vision’s visuals are almost unbelievable.
Even knowing a lot about shader programming, etc. some of the effects I was like “wtf how did he do that”.
Here’s the set, doesn’t fully capture the experience, but gives a feel: Seeing this in 4k at 60fps was next level.
- GLiNet Mudi v2: https://store.gl-inet.com/products/mudi-v2-portable-4g-lte-r...
- EIOT Physical eSim https://store.gl-inet.com/products/esim-experience-seamless-...
- 20GB Worldwide Airalo for 365 days ($69): https://www.airalo.com/global-esim/discover-365days-20gb
Buy the airalo esim on my iphone. Download the QR code. Upload it to the mudi router. Activate it there. Voila! I then wireguard back to my home internet in case I need a US on the router. Can also use tailscale, but if my gf wants US internet its helpful.
https://docs.gl-inet.com/router/en/4/tutorials/how_to_set_up...
Any limitations / bumps in the road, or it "just works"?