The Canadian Press - ONLINE EDITION

MIT's FingerReader device helps people with vision impairment read with the swipe of a finger

  • Print

CAMBRIDGE, Mass. - Scientists at the Massachusetts Institute of Technology are developing an audio reading device to be worn on the index finger of people whose vision is impaired, giving them affordable and immediate access to printed words.

The so-called FingerReader, a prototype produced by a 3-D printer, fits like a ring on the user's finger, equipped with a small camera that scans text. A synthesized voice reads words aloud, quickly translating books, restaurant menus and other needed materials for daily living, especially away from home or office.

Reading is as easy as pointing the finger at text. Special software tracks the finger movement, identifies words and processes the information. The device has vibration motors that alert readers when they stray from the script, said Roy Shilkrot, who is developing the device at the MIT Media Lab.

For Jerry Berrier, 62, who was born blind, the promise of the FingerReader is its portability and offer of real-time functionality at school, a doctor's office and restaurants.

"When I go to the doctor's office, there may be forms that I wanna read before I sign them," Berrier said.

He said there are other optical character recognition devices on the market for those with vision impairments, but none that he knows of that will read in real time.

Berrier manages training and evaluation for a federal program that distributes technology to low-income people in Massachusetts and Rhode Island who have lost their sight and hearing. He works from the Perkins School for the Blind in Watertown, Massachusetts.

"Everywhere we go, for folks who are sighted, there are things that inform us about the products that we are about to interact with. I wanna be able to interact with those same products, regardless of how I have to do it," Berrier said.

Pattie Maes, an MIT professor who founded and leads the Fluid Interfaces research group developing the prototype, says the FingerReader is like "reading with the tip of your finger and it's a lot more flexible, a lot more immediate than any solution that they have right now."

Developing the gizmo has taken three years of software coding, experimenting with various designs and working on feedback from a test group of visually impaired people. Much work remains before it is ready for the market, Shilkrot said, including making it work on cellphones.

Shilkrot said developers believe they will be able to affordably market the FingerReader but he could not yet estimate a price. The potential market includes some of the 11.2 million people in the United States with vision impairment, according to U.S. Census Bureau estimates.

Current technology used in homes and offices offers cumbersome scanners that must process the desired script before it can be read aloud by character-recognition software installed on a computer or smartphone, Shilkrot said. The FingerReader would not replace Braille — the system of raised dots that form words, interpreted by touch. Instead, Shilkrot said, the new device would enable users to access a vast number of books and other materials that are not currently available in Braille.

Developers had to overcome unusual challenges to help people with visual impairments move their reading fingers along a straight line of printed text that they could not see. Users also had to be alerted at the beginning and end of the reading material.

Their solutions? Audio cues in the software that processes information from the FingerReader and vibration motors in the ring.

The FingerReader can read papers, books, magazines, newspapers, computer screens and other devices, but it has problems with text on a touch screen, said Shilkrot.

That's because touching the screen with the tip of the finger would move text around, producing unintended results. Disabling the touch-screen function eliminates the problem, he said.

Berrier said affordable pricing could make the FingerReader a key tool to help people with vision impairment integrate into the modern information economy.

"Any tool that we can get that gives us better access to printed material helps us to live fuller, richer, more productive lives, Berrier said.

Fact Check

Fact Check

Have you found an error, or know of something we’ve missed in one of our stories?
Please use the form below and let us know.

* Required
  • Please post the headline of the story or the title of the video with the error.

  • Please post exactly what was wrong with the story.

  • Please indicate your source for the correct information.

  • Yes

    No

  • This will only be used to contact you if we have a question about your submission, it will not be used to identify you or be published.

  • Cancel

Having problems with the form?

Contact Us Directly
  • Print

You can comment on most stories on winnipegfreepress.com. You can also agree or disagree with other comments. All you need to do is be a Winnipeg Free Press print or e-edition subscriber to join the conversation and give your feedback.

You can comment on most stories on winnipegfreepress.com. You can also agree or disagree with other comments. All you need to do is be a Winnipeg Free Press print or e-edition subscriber to join the conversation and give your feedback.

Have Your Say

New to commenting? Check out our Frequently Asked Questions.

Have Your Say

Comments are open to Winnipeg Free Press print or e-edition subscribers only. why?

Have Your Say

Comments are open to Winnipeg Free Press Subscribers only. why?

The Winnipeg Free Press does not necessarily endorse any of the views posted. By submitting your comment, you agree to our Terms and Conditions. These terms were revised effective April 16, 2010.

letters

Make text: Larger | Smaller

LATEST VIDEO

Raw: Video shows destroyed West Hawk Inn

View more like this

Photo Store Gallery

  • Marc Gallant/Winnipeg Free Press. Local- Peregrine Falcon Recovery Project. Baby peregrine falcons. 21 days old. Three baby falcons. Born on ledge on roof of Radisson hotel on Portage Avenue. Project Coordinator Tracy Maconachie said that these are third generation falcons to call the hotel home. Maconachie banded the legs of the birds for future identification as seen on this adult bird swooping just metres above. June 16, 2004.
  • JJOE.BRYKSA@FREEPRESS.MB.CA Local-Postcard  Day-Horror frost and fog created a most beautiful setting at Assiniboine Park Thursday morning in WInnipeg- Enviroent Canada says the fog will lifet this morning and will see a high of -7C-  JOE BRYKSA/WINNIPEG FREE PRESS- Feb 18, 2010

View More Gallery Photos

Poll

What do you think of the new school-zone speed limit?

View Results

View Related Story

Ads by Google