Readit News logoReadit News
ginbazinga commented on How Might We Learn?   andymatuschak.org/hmwl/... · Posted by u/ColinWright
criddell · a year ago
For me, school was mostly frustrating.

I loved kindergarten and first and second grades which mostly seemed to be play. I think it was effective for me as far as creativity and socialization goes.

From third grade through high school I was bored with most of the material. A lot of it was not interesting and sometimes the pace was too slow.

At university, the work load was too high. I think if I had taken six years to complete the 4 year program, I would have been a lot better off. Too often I didn’t have the time to really dig into the material and explore related ideas (side quests). Instead I settled for memorization which was enough to do well on exams. My GPA at graduation did not reflect my command of the material.

Like Andy, I think an AI-powered course of learning could be great. The strength, I think, would be its adaptability. If while learning topic A I stumble across an interesting idea, it would have no problem with changing course and running down topic B.

ginbazinga · a year ago
I resonated with this urge to dig into the material a lot.

For me, two use cases of "digging" come up a lot: 1. I want to know how the concept I'm learning can connect with other concepts that I'm interested in (i.e., related concepts); 2. I want to know what other materials are available out there that can provide different perspectives (i.e., related resources). So I ended up building a map visualizing concepts (https://afaik.io/) where the proximity indicates relatedness and under each concept there are various resources attached.

In addition to those more "objective" connections, I think what AI could really help is to find a more "subjective" connection that's very user-specific and utilize those connections to build a personalized tutoring experience, hence the adaptability. For now, I think the barrier to realizing that level of adaptiveness is the high hallucination rate.

ginbazinga commented on Show HN: I made a cheap alternative to college-level math & physics tutoring    · Posted by u/eltonlin
andrewlgood · a year ago
I am always curious regarding new education solutions. I firmly believe the US pre-college education systems are fundamentally broken most benefit from edtech (huge fan of Khan Academy).

As an MIT alum myself ('89), I am surprised to hear your description of your experience at MIT. Did you experience this across all classes and departments or only for a few (e.g. 18.01 which is required for most freshman)? While certain professors were not the most helpful, I found most of the teaching staff to be incredibly helpful when I made the effort to engage them. No doubt the focus was on attendance in lectures.

In addition to lectures there were: - Recitations - each class of the larger classes had recitations with a TA to allow smaller groups the opportunity to ask specific questions. - Office hours with the lecturer. I did not avail myself of them as I considered them useful for bigger questions (should I be a physics major if I don't understand this) rather then review of homework questions. - Bibles. Each living group (I was in a fraternity but dorms had them as well) had a library of class notes, exams, quizzes, etc for each class assembled by people who previously took the class and did well. Often the Bible author was still available for questions. - Friends/Fellow Students. MIT has an incredibly open policy on working together. My recollection is some classes could not be reasonably completed by people working alone (e.g. Aero/Astro's Unified Engineering). A fellow student may simply have looked at a topic from a different perspective which drove their comprehension.

Today, MIT offers OpenCourseWare (ocw.mit.edu) which hosts complete courses online (video, lecture notes, syllabi, additional readings, quizzes). This is an incredible resource that I have found helps my lifetime learning goals.

Again, I am always excited for edtech. I think its development needs to be tempered with an understanding of why current systems are not working. What problem are you solving? Is your solution simply remote tutoring? If so, how is it different that a job board with zoom?

ginbazinga · a year ago
I'm also enthusiastic about new education solutions, and I found traditional MOOCs are 1. too long for one sit; 2. passive; 3. lack personalization. So I'm building a new solution that aims at solving these problems: https://afaik.io/, and you can learn college physics and calculus for free.

The goal is to map out the prerequisite structures among all subjects as knowledge is actually a continuous map, and let everyone have their own personalized learning path. It's visualized like this: https://afaik.io/nebula?category=brickset&id=VLlOnZLl&mode=d.... The learning unit (called brick, like Lego brick) is designed to be 10 minutes, questions are asked at the end to check understanding.

Don't get me wrong; I love OCW and I think it's still one of the best free resources online. But I do think great resources combined with AI can bring such innovative edtech solutions that everyone can have their own private tutor almost for free, and most importantly, without worrying about hallucination effects.

ginbazinga commented on Relearning math as an adult   gmays.com/how-im-relearni... · Posted by u/gmays
galaxyLogic · 2 years ago
I find the concept of "underlying knowledge graph" interesting. What does it mean?

I assume it means such a graph connects the topics together as "pre-requisites". To understand A you need to already understand B and C, and to understand B you need to understand D and ... etc.

But the thing about such a graph is that really it must be a tree, not just a directed graph. Why? Because there cannot be cycles in it. If to understand A you need to understand B, and to understand B you would need to understand A, you could never understand either of them. Right?

ginbazinga · 2 years ago
"underlying knowledge graph" is a directed acyclic graph (DAG), based on prerequisite relations among topics. So you are right that there cannot be cycles but it's not a tree either because a tree (technically) only allows one parent.
ginbazinga commented on Relearning math as an adult   gmays.com/how-im-relearni... · Posted by u/gmays
ginbazinga · 2 years ago
If OP still wants to learn the mathematical foundation of transformers, I built a free alternative learning tool: https://afaik.io/nebula?mode=nebula&category=blueprint&id=ed...

It's also based on an underlying knowledge graph, connecting concepts across various subjects like maths, machine learning, physics, etc. You can check the graph for transformer here: https://afaik.io/nebula?category=brickset&id=VLlOnZLl&mode=d... (only available on desktop...

Basically, it frees you from learning maths from scratch and just learning the prerequisites required to grasp the concept, and there are free resources attached.

Don't get me wrong, I can totally relate to the desire to relearn maths. One of the reasons that I'm building this tool is for me to relearn physics and know how to get there with my maths and cs background. I just feel in this specific scenario there might be more effective ways to learn in depth and have fun at the same time.

ginbazinga commented on Bad numbers in the “gzip beats BERT” paper?   kenschutte.com/gzip-knn-p... · Posted by u/ks2048
ks2048 · 2 years ago
Hi, that's my blog post. I'm pretty sure about what I wrote here, but may need the authors to chime-in in case I am missing something. I just submited an issue on github, https://github.com/bazingagin/npc_gzip/issues/3
ginbazinga · 2 years ago
Hi, I'm the first author of the paper and I read your blog post. The reason I chose k=2 is because it's recommended to use n^{1/2} and I wanted to pick a k that's compatible with 5-shot setting. But you are right this is a bit odd. As I mentioned in both the paper and the twitter, different values of k will affect the result and I reported the _max_ result we can get so it does mean an ideal situation when the guess is always right. I also use this strategy for W2V and SentBERT. But it doesn't make the result top2 accuracy. As far as I know, top2 accuracy means in the top2 predicted classes, either one is correct, we score. However, as you mentioned, in knn when k=2, there is a situation when the 2 nearest neighbours point to the same class - we are missing another class candidate if reporting top2 accuracy. But I would love to add results for different strategies and different k values when I upload newest version to arxiv when I have time. The strategy of "decrement" you mentioned in the blog is really nice and I would love to add it to the repo if you want. I apologize for the short and late reply; I haven't checked the repo yet. I'm preparing for tomorrow's thesis defence and will reply & resolve the issue when I finish.

u/ginbazinga

KarmaCake day12June 26, 2023View Original