Readit News logoReadit News
cortensinger commented on Mouth-based touchpad enables people living with paralysis to use computers   news.mit.edu/2024/mouth-b... · Posted by u/gmays
nashadelic · 2 years ago
How did we not have this 10-15 years ago? It just feels like not enough people work on, or care enough about assistive tech till it impacts them personally.
cortensinger · 2 years ago
Exactly. Its unfortunate that this is the way the world works...but we hope that the MouthPad^ can change that tired script! Universal design benefits us all, not just those at the extremes -- we should all care. See the history of curb cuts on our sidewalks as a small example.
cortensinger commented on Augmental's tongue controller now supports head tracking [video]   youtube.com/watch?v=6TTIs... · Posted by u/cortensinger
cortensinger · 2 years ago
Last year, Augmental (www.augmental.tech) released their first product, the MouthPad^, which is type of 'smart mouthware' that functions as a bluetooth-enabled mouse. The MouthPad^ is worn on the upper jaw and makes use tongue gesture to enable more universal access to one's personal electronics. Now, the MouthPad^ supports head-tracking, allowing users to move the cursor with their head motion while still supporting tongue-based clicks and other gestures.
cortensinger commented on MouthPad – In-Mouth Bluetooth Mouse Uses Tongue Sensitive Trackpad   augmental.tech/... · Posted by u/MasterYoda
eimrine · 3 years ago
> Also, as we optimize our firmware to support improved power-saving techniques, we hope to see our current battery lifetimes increase from ~5.5 hours.

Do you have a plans to use thermal energy or something based on movement? I would like to blow a whistle or to do something with sculls to rotate some generator.

cortensinger · 3 years ago
I cant say that Im not interested in clever ways to draw power from the mouth, of which there are many cool options, but the reality is such that we wont really be able to address many of these features until we receive funding to support our growth so that we can dedicate an R&D team to tackle some of these tasks. Until then, our team count remains in the single digits.
cortensinger commented on MouthPad – In-Mouth Bluetooth Mouse Uses Tongue Sensitive Trackpad   augmental.tech/... · Posted by u/MasterYoda
jaggirs · 3 years ago
I have had periods of time where I couldn't use my hands to use the computer due to bad rsi. I used an eye tracker for controlling the mouse and a voice recognition tool (talon) for typing. However, I couldn't use these for very long because I got a sore throat from speaking in a way the computer understands, and focusing places with my eyes all the time gave me headaches.

While a mouthpad seems slighly superior to an eye tracker, the real benefit lies in having more alternatives in my opinion. So you can use your tongue when your eyes are tired and your eyes when your tongue is tired.

cortensinger · 3 years ago
+1 on the complementary potential of the MouthPad^.

As you mention, the MouthPad^ would serve as an awesome tool in tandem with gaze-based cursor control. I’d like to point out that there are also other interface combinations that could work well, too. For example, we have tested using our device in tandem with voice-assistant systems and found preliminary success as our device does not prevent speech. In the end, everyone has different needs and preferences, and each interface has their quirks, so we aim to create a better option by leveraging the power of the tongue (comprised of 8 different muscles, and intrinsically dexterous).

cortensinger commented on MouthPad – In-Mouth Bluetooth Mouse Uses Tongue Sensitive Trackpad   augmental.tech/... · Posted by u/MasterYoda
zamalek · 3 years ago
Which is somewhat unfortunate. Having the device go mainstream is one way to reduce the cost per unit, or even subsidize the cost for people who really need it. Many accessibility technologies end up being an improvement for everyone.

I would certainly be interested in the device purely from a keeping-both-hands-on-the-keyboard perspective.

cortensinger · 3 years ago
This is a fair point.

Although our promotional video features people with quadriplegia, the MouthPad^ is designed for everyone and anyone interested in using their tongue and mouth to control their personal devices. We believe strongly in universal design, and how designing for extremes can create an improved experience for all users, and this has led us to work closely with the disability community. A classic example of the benefits of universal design can be seen in curb cuts, which were initially built into our sidewalks to help accommodate the needs of people living with mobility issues, but ended up providing value to many other groups, such as mothers with strollers, workers with carts, travelers with luggage, runners, skateboarders, etc.

cortensinger commented on MouthPad – In-Mouth Bluetooth Mouse Uses Tongue Sensitive Trackpad   augmental.tech/... · Posted by u/MasterYoda
eimrine · 3 years ago
I want to repeat this in USB2 version and use it for reading books. What kind of moving sensor might be a good choice? I want something like a stylophone with tongue-controlled five buttons (traditional joystick approach) plus tooth-controlled ctrl as a regular button. Buttons might be sensed like licking AG4 battery (the least 1.5V battery I ever seen) - but I do not understand an electronic design which is going to sense the tongue.

5 hours of active use with no ability to change the battery is a shit, let's be honest. It will be 4 hours after 100 full recharges, you know this process. Also Bluetooth HID devices will never be acceptable for shooters while non-Bluetooth tongue controller may be a pivot point in cyber-sport industry because of less lag between the brain and the HID.

cortensinger · 3 years ago
We have actually created a few USB/wired versions of our device, specifically with gaming latency concerns in mind! We made a version for our friend and Augmental champion, Rocky NoHands (https://twitter.com/RockyNoHands), to complement his QuadStick gaming setup. In our test sessions together, there were no battery power issues as the wired prototype uses the USB for both communication and power. With that prototype, we had the added benefit of being able to debug simultaneously over Bluetooth without interfering with any USB data transmission. You can watch Rocky play Apex using this wired version as a Left Analog Input (movement commands) in a few clips in our promotional video. Hopefully one day in the future we will be able to offer a wired version of the MouthPad^ to our customers! Also, as we optimize our firmware to support improved power-saving techniques, we hope to see our current battery lifetimes increase from ~5.5 hours.
cortensinger commented on MouthPad – In-Mouth Bluetooth Mouse Uses Tongue Sensitive Trackpad   augmental.tech/... · Posted by u/MasterYoda
kotaKat · 3 years ago
I 100% would love to try this but seeing the FAQ and the "prioritizing close to San Francisco" does kinda suck. I know it's still a stupid early prototype but I wish I could register a "please let me override your location demands" because I'd be willing to travel/go through /some/ hoops.
cortensinger · 3 years ago
If you are considering signing up to our waitlist, I encourage you to enter information like this in the optional text box at the end of the sign-up form to let us know. We are mainly interested in prioritizing Beta customers who are in close proximity so that we can provide amazing, personalized support during the onboarding process and in the ensuing early days of usage, but we are not absolutists by any means. If there are any other interested Beta customers who would be willing to travel to us, we would be happy to know that and will take it into consideration as we move forward in processing all the incoming waitlist requests. Thanks!
cortensinger commented on MouthPad – In-Mouth Bluetooth Mouse Uses Tongue Sensitive Trackpad   augmental.tech/... · Posted by u/MasterYoda
molasses · 3 years ago
I guess you can't talk while it is in.
cortensinger · 3 years ago
Due to the fact that we incorporate each user’s custom 3D dental scan into the design process, the MouthPad^ is actually quite thin and doesnt prevent speech when worn. With our earliest test users, we have already explored using the MouthPad^ as a complementary tool to voice-control systems.

One example is asking a voice assistant to open “today’s news”, and then using the MouthPad^ to navigate through the options and select the desired link, which is captured briefly in our promotional video (a scene where Krystina is controlling her smart phone). Another example that can be found in our video is when Rocky NoHands uses his MouthPad^ to call his girlfriend, during which he is able to speak with ease. Of course, results may vary, but we have found all our test users are able to speak just fine so far.

cortensinger commented on MouthPad – In-Mouth Bluetooth Mouse Uses Tongue Sensitive Trackpad   augmental.tech/... · Posted by u/MasterYoda
omgtehlion · 3 years ago
Nice idea! Is it using nRF52832 or smth similar?
cortensinger · 3 years ago
Yep, although we started with the 32, we are now using nRF52840.

u/cortensinger

KarmaCake day9September 25, 2019
About
Cofounder/Engineer @ Augmental

B.S. Computer Science @ UC Berkeley '17 B.S. Cognitive Science @ UC Berkeley '17 M.S. EECS @ UC Berkeley '18

View Original