How to point your iPhone at a sign and have it read aloud?
June 11, 2020 3:45 AM Subscribe
I have a dear friend who is rapidly losing his sight. There are plenty of ways to get iPhone to read a website aloud, and several iPhone apps that can (for example) read the text on a sign or in a book and instantly translate it into a different language for you, but I haven't been able to find a simple app where you can just point your phone at a sign or magazine and have it read aloud. Help?
The few relevant apps I've found seem to assume you have enough eyesight to click on lots of tiny grey buttons with pale gray text, and that is just not an option. My friend needs voice commands and the ability to just point his damn phone and have it reads things out loud. I know the capability exists out there but I'm having a devil of a time finding an app that will do this.
I've looked at Prizmo but while it showed promise and they say it can use voice commands, I haven't been able to figure out how to use voice commands with it because their documentation sucks monkey butt. That app also uses a pale-on-pale UI style and lets you know when it's (finally) focused on the text with a pale blue glow around the words, and again, that crap's not going to work with my friend's severe level of vision loss. I've experimented with VoiceOver but it can't seem to recognize text in a photo and it's been buggy as hell on multiple devices. Why is an app like this so hard to find? (Point camera at text... hear text out loud. That's it!) My friend has been really struggling and this would mean so much to him. If you know of an app that will get the job done, please speak up! Or it doesn't have to be an app, or even an iPhone thing, so long as it actually works.
The few relevant apps I've found seem to assume you have enough eyesight to click on lots of tiny grey buttons with pale gray text, and that is just not an option. My friend needs voice commands and the ability to just point his damn phone and have it reads things out loud. I know the capability exists out there but I'm having a devil of a time finding an app that will do this.
I've looked at Prizmo but while it showed promise and they say it can use voice commands, I haven't been able to figure out how to use voice commands with it because their documentation sucks monkey butt. That app also uses a pale-on-pale UI style and lets you know when it's (finally) focused on the text with a pale blue glow around the words, and again, that crap's not going to work with my friend's severe level of vision loss. I've experimented with VoiceOver but it can't seem to recognize text in a photo and it's been buggy as hell on multiple devices. Why is an app like this so hard to find? (Point camera at text... hear text out loud. That's it!) My friend has been really struggling and this would mean so much to him. If you know of an app that will get the job done, please speak up! Or it doesn't have to be an app, or even an iPhone thing, so long as it actually works.
Be My Eyes is human-powered, so there may be a short wait for someone to read out the sign for you, but it is likely to be more accurate, more of the time.
posted by Happy Dave at 5:47 AM on June 11, 2020 [6 favorites]
posted by Happy Dave at 5:47 AM on June 11, 2020 [6 favorites]
Check out the technology page on National Federation of the Blind’s website. They also have how-to videos and blogs.
In the US, each state has an Assistive Technology office, typically found online with the department of disabilities website. Ours are open remotely, so your friend can call them and see what tech might fit their situation, as macular degeneration might be different from, say, diabetes-related vision loss. These centers also have loaner libraries, so the people they serve can try-before-they-buy if a deeper dive than an app would be beneficial.
Often websites and tech that are designated specifically for people with low vision or blindness are oriented for audio engagement. It’s worth reading the reviews of people who are not newly diagnosed, or gifting without great engagement, to get a sense of what is possible. Many people expect miracles when it’s like all technology- context matters, such as lighting, contrast, font size and language. Often people need to learn the technology, even if it’s getting familiar with the accessible features of existing tech or software. YouTube has how-to videos on most assistive tech and apps, though mileage varies widely.
posted by childofTethys at 6:18 AM on June 11, 2020 [3 favorites]
In the US, each state has an Assistive Technology office, typically found online with the department of disabilities website. Ours are open remotely, so your friend can call them and see what tech might fit their situation, as macular degeneration might be different from, say, diabetes-related vision loss. These centers also have loaner libraries, so the people they serve can try-before-they-buy if a deeper dive than an app would be beneficial.
Often websites and tech that are designated specifically for people with low vision or blindness are oriented for audio engagement. It’s worth reading the reviews of people who are not newly diagnosed, or gifting without great engagement, to get a sense of what is possible. Many people expect miracles when it’s like all technology- context matters, such as lighting, contrast, font size and language. Often people need to learn the technology, even if it’s getting familiar with the accessible features of existing tech or software. YouTube has how-to videos on most assistive tech and apps, though mileage varies widely.
posted by childofTethys at 6:18 AM on June 11, 2020 [3 favorites]
My friend needs voice commands and the ability to just point his damn phone and have it reads things out loud. I know the capability exists out there but I'm having a devil of a time finding an app that will do this.
Is your friend using Voiceover on their iPhone, or are they relying solely on voice commands?
My husband, who's blind, uses Be My Eyes, mentioned above, on his iPhone while simultaneously running Voiceover and finds it extremely useful. One of the its features is that if the description is in any way confusing, the user is talking in real time to a human describer and can ask for clarification or further detail. If an AI-based app mucks something up, this isn't an option.
Speaking of voice commands, Be My Eyes recently added Siri shortcut features.
It's a free service. Because the app is contacting a volunteer describer, there is occasionally a short wait. My husband reports that he has never had to wait more than a minute or two, and he's often connected rather immediately.
There's also Aira, but unlike Be My Eyes, it has a range of pricing with a free option.
I'll echo the recommendation above for the AFB's resources -- their guide to assistive technology for reading printed text on a smartphone is helpful.
AMI Canada's podcast/show Double Tap features blind and visually impaired hosts who review a wide range of assistive technology.
posted by mandolin conspiracy at 7:30 AM on June 11, 2020 [2 favorites]
Is your friend using Voiceover on their iPhone, or are they relying solely on voice commands?
My husband, who's blind, uses Be My Eyes, mentioned above, on his iPhone while simultaneously running Voiceover and finds it extremely useful. One of the its features is that if the description is in any way confusing, the user is talking in real time to a human describer and can ask for clarification or further detail. If an AI-based app mucks something up, this isn't an option.
Speaking of voice commands, Be My Eyes recently added Siri shortcut features.
It's a free service. Because the app is contacting a volunteer describer, there is occasionally a short wait. My husband reports that he has never had to wait more than a minute or two, and he's often connected rather immediately.
There's also Aira, but unlike Be My Eyes, it has a range of pricing with a free option.
I'll echo the recommendation above for the AFB's resources -- their guide to assistive technology for reading printed text on a smartphone is helpful.
AMI Canada's podcast/show Double Tap features blind and visually impaired hosts who review a wide range of assistive technology.
posted by mandolin conspiracy at 7:30 AM on June 11, 2020 [2 favorites]
I've experimented with VoiceOver but it can't seem to recognize text in a photo
Just wanted to add: Voiceover, as a screen reader, isn't designed to do this. It renders machine text (i.e., website text, text built into programs/applications, etc.) to speech rather than performing optical character recognition tasks.
posted by mandolin conspiracy at 7:39 AM on June 11, 2020
Just wanted to add: Voiceover, as a screen reader, isn't designed to do this. It renders machine text (i.e., website text, text built into programs/applications, etc.) to speech rather than performing optical character recognition tasks.
posted by mandolin conspiracy at 7:39 AM on June 11, 2020
Another option for signs specifically might be Microsoft Soundscape. It essentially narrates your surroundings to you as you walk (like an audio map), but may not read every specific sign text.
posted by Lutoslawski at 9:50 AM on June 11, 2020
posted by Lutoslawski at 9:50 AM on June 11, 2020
Response by poster: Seeing AI looks like just the thing! I'll also have a look at Envision AI and I'll ask my friend if he wants to try Be My Eyes. Thank you, folks! If anybody has additional suggestions, please keep them coming. Even if we end up sticking with one of the apps already mentioned this could be a very helpful thread for people with vision difficulties.
posted by Ursula Hitler at 1:29 PM on June 11, 2020
posted by Ursula Hitler at 1:29 PM on June 11, 2020
In that spirit, the AppleVis website offers community recommendations, peer tech support, reviews and podcasts. Developers working on apps for blind and low vision iPhone, Watch, TV, and Mac users often show up in comments.
posted by Jesse the K at 12:25 PM on June 12, 2020
posted by Jesse the K at 12:25 PM on June 12, 2020
« Older Can a sound technician claim copyright to music... | Reading recommendation trans rights Newer »
This thread is closed to new comments.
posted by RichardP at 4:20 AM on June 11, 2020 [1 favorite]