Readit News logoReadit News
miguelrochefort commented on iPhone 16 Pro and iPhone 16 Pro Max   apple.com/newsroom/2024/0... · Posted by u/mfiguiere
swyx · a year ago
i clipped the 5 mins on apple intelligence here for those interested https://x.com/swyx/status/1833231875537850659

notes:

- photos/album search now includes video understanding, which imo seems very good from the first 2 examples they showed. includes scroll to exact time of the moment you describe.

- Mail and Notifications will show summaries instead of str[:x]

- Siri now knows iPhone, becomes the ultimate manual on how to use the increasingly complicated iOS 18. and can read your texts (!) to suggest actions with Personal Context Understanding (also it will try to advertise apple tv shows to you... i'm SURE it will be totally objective and aligned to your preferences amirite)

- new iphone 16 camera control button is PRIME real estate - notice how OpenAI/ChatGPT is now next to Google search, and both are secondary clicks to Apple's visual search, which comes first

- camera adds events to calendar!

- "all done on device" and on cloud (though craig doesnt say that haha)

overall i think insanely good ideas on ai + phone integrations.

miguelrochefort · a year ago
I predicted those features weeks ago [1], but I still feel they could do so much more. If anything, their implementation feels like a rushed afterthought.

In their demos, they use the action button to capture an ambient song for Shazam, the power button to capture a voice command for Siri, and the camera button for an image for Visual Intelligence. All 3 captures should be performed using the same button.

And screenshots still require pressing 2 buttons simultaneously. Unless you want to share your screen with Siri in which case it's the power button...

People are going to use this button as a voice recorder, and Apple will announce native support next year.

[1] https://miguelrochefort.com/blog/capture-button

miguelrochefort commented on How far are we from intelligent visual deductive reasoning?   arxiv.org/abs/2403.04732... · Posted by u/belter
cgearhart · a year ago
The Georgia Tech Knowledge Based AI course involved building a program to answer ravens progressive matrix questions. The course was offered in the online MS program, so thousands of students have taken the course. The most impressive result I saw was one student who got nearly perfect results in about 25 lines of Python code.

This may be a case where humans do well on the test, but you can do very well on the test without doing anything the way a human would. The fact that GPTs aren’t very good at the test isn’t probably evidence that they’re not really very smart, but it doesn’t really mean that if we fix them to do very well on the test that they’ve gotten any smarter.

miguelrochefort · a year ago
CS7637 was a fun course! One can get pretty far (80% accuracy) by using xor masks and comparing centroids.
miguelrochefort commented on Ord Phone   ordphone.com... · Posted by u/walz
miguelrochefort · 2 years ago
How is this better than a custom launcher?
miguelrochefort commented on Multi-Layered Calendars   julian.digital/2023/07/06... · Posted by u/bpierre
miguelrochefort · 2 years ago
I highly resonate with this. In fact, I spent over a year buildng it [1].

My thesis is that the calendar will play a significant role in the next OS UI paradigm, replacing the old grid of icons and overlapping windows. Everything will happen around a unified timeline, through which you will launch an app by time-blocking its use, check notifications by looking at the past, forecast battery life or weather by looking at the future, undo/redo actions (or view snapshots/backups) by time traveling, etc.

It is shocking how far behind our map of time (e.g., Google Calendar) is compared to our map of space (e.g., Google Maps). Every spatial feature has an obvious temporal equivalent that just isn't implemented. I want to be able to search, save, and review events. I want to schedule an itinerary of events. I want turn-by-turn navigation in time.

Of course, solving time is just the beginning. The real magic happens when you combine space and time. For this, we may need to wait for more AR/VR adoption, whose added dimension should make this realization obvious to most and significantly facilitate its implementation.

[1] https://chronomize.com/

u/miguelrochefort

KarmaCake day3843June 8, 2012
About
miguelrochefort.com
View Original