fiat1.ppt 1311KB Jun 23 2011 12:14:22 PM
Vision for the Blind.
Stat 19 SEM 2. 263057202. Talk
1.
Alan Yuille. [email protected]
UCLA. Dept. Statistics and
Psychology.
www.stat.ucla/~yuille
Goal of the Course.
• How can technology and neuroscience
help the blind and disabled?
• (A) Artificial Intelligence systems.
• (B) Brain Implants. Neural Prostheses.
• Introduce and review the state of the art.
• Today, an overview.
Course Mechanisms.
• Maximum work load is 3 hours per week.
• Grading: Pass/Fail.
• Requirement. Don’t miss more than 2
lectures.
• Reading assignments. Short reports.
My Research Interests are:
• Designing computer vision systems
(artificial intelligence).
• Understanding how biological vision
systems work.
• I also work with a company that builds
prototype systems for the blind.
• Collaborate with the Smith-Kettlewell
Eye Research Institute (San Francisco).
What is Vision?
• Aristotle “to know what is where by looking”.
• Vision is information processing.
• Light rays that reach your eyes carry
information about the external world.
• Vision decodes the light rays and
reconstructs the world.
• Vision is a very complex task. Harder than
Mathematics? More on vision next lecture.
What would you miss most if
you went blind?
• Probably the ability to detect and read
text.
• Navigation is possible using a cane
and/or
guide dog. Recognize people by their
voices. Hear oncoming traffic.
Experiment: Spend an hour with your
eyes closed.
What can blind people see if
they recover their sight?
• Mike May is one of the very few people
who attained his sight after being blind.
• (Successful businessman & skier).
• But how well can he use vision to get
information about the world?
• Infant’s vision systems develop in
stages. Some abilities develop at 1
month, others at 3 months, etc.
Mike May
• Mike May can see light, but required
extensive training before he could
distinguish a cube from a sphere.
• He cannot recognize faces (even his wife
and children).
• It took two years before his vision helped
his skiing.
• Handout. Interview with Mike May.
• Mike Mays’ Journal:
www.sendergroup.com/mike.htm
• Radio Interview. http://psy.ucsd.edu/~fine
How Big is the Problem?
• Legally Blind population of the US is 600900,000. (20/200 best correctly acuity).
• At least, 3,000,000 people have low
vision.
• These numbers are predicted to double
in the next ten years!
• Eyesight gets worse with age – and
people live longer.
Artificial Intelligence
Solutions.
• Navigation: Global
Positioning
Satelites (GPS).
(Loomis. UCSB).
Computer Vision
• Digital Camera +
Portable Computer
+
Speech
Synthesizer.
Brain Implants.
• Artificial Retina:
• Connected to (i)
the retina, (ii) the
optic nerve, or (iii)
the cortex.
• Dr. Dobelle.
• Portugal.
Vision to Tactile.
• Dr. Bach y Rita. (Ex: Smith-
Kettlewell).
• 1970. Project an image
onto the back of a blind
person. Claim: could
recognize faces.
• Few tactile receptors on
back. Better to use
fingertips, lips, or tongue.
• Erik Weihenmayer. Climber.
Mt. Everest.
Neural Prostheses:
• Control by
Thought.
• Movement
Planning Neurons.
• Clint Eastwood
film. Firefox.
Summary.
• The course will describe these artificial
intelligence and biological techniques.
• Can describe other topics: e.g. Cochlear
implants.
• Mike Mays’s handout. Web journal:
• www.sendergroup.com/mike.htm
• Radio Interview: http://psy.ucsd.edu/~fine
• Contact information: [email protected]
Stat 19 SEM 2. 263057202. Talk
1.
Alan Yuille. [email protected]
UCLA. Dept. Statistics and
Psychology.
www.stat.ucla/~yuille
Goal of the Course.
• How can technology and neuroscience
help the blind and disabled?
• (A) Artificial Intelligence systems.
• (B) Brain Implants. Neural Prostheses.
• Introduce and review the state of the art.
• Today, an overview.
Course Mechanisms.
• Maximum work load is 3 hours per week.
• Grading: Pass/Fail.
• Requirement. Don’t miss more than 2
lectures.
• Reading assignments. Short reports.
My Research Interests are:
• Designing computer vision systems
(artificial intelligence).
• Understanding how biological vision
systems work.
• I also work with a company that builds
prototype systems for the blind.
• Collaborate with the Smith-Kettlewell
Eye Research Institute (San Francisco).
What is Vision?
• Aristotle “to know what is where by looking”.
• Vision is information processing.
• Light rays that reach your eyes carry
information about the external world.
• Vision decodes the light rays and
reconstructs the world.
• Vision is a very complex task. Harder than
Mathematics? More on vision next lecture.
What would you miss most if
you went blind?
• Probably the ability to detect and read
text.
• Navigation is possible using a cane
and/or
guide dog. Recognize people by their
voices. Hear oncoming traffic.
Experiment: Spend an hour with your
eyes closed.
What can blind people see if
they recover their sight?
• Mike May is one of the very few people
who attained his sight after being blind.
• (Successful businessman & skier).
• But how well can he use vision to get
information about the world?
• Infant’s vision systems develop in
stages. Some abilities develop at 1
month, others at 3 months, etc.
Mike May
• Mike May can see light, but required
extensive training before he could
distinguish a cube from a sphere.
• He cannot recognize faces (even his wife
and children).
• It took two years before his vision helped
his skiing.
• Handout. Interview with Mike May.
• Mike Mays’ Journal:
www.sendergroup.com/mike.htm
• Radio Interview. http://psy.ucsd.edu/~fine
How Big is the Problem?
• Legally Blind population of the US is 600900,000. (20/200 best correctly acuity).
• At least, 3,000,000 people have low
vision.
• These numbers are predicted to double
in the next ten years!
• Eyesight gets worse with age – and
people live longer.
Artificial Intelligence
Solutions.
• Navigation: Global
Positioning
Satelites (GPS).
(Loomis. UCSB).
Computer Vision
• Digital Camera +
Portable Computer
+
Speech
Synthesizer.
Brain Implants.
• Artificial Retina:
• Connected to (i)
the retina, (ii) the
optic nerve, or (iii)
the cortex.
• Dr. Dobelle.
• Portugal.
Vision to Tactile.
• Dr. Bach y Rita. (Ex: Smith-
Kettlewell).
• 1970. Project an image
onto the back of a blind
person. Claim: could
recognize faces.
• Few tactile receptors on
back. Better to use
fingertips, lips, or tongue.
• Erik Weihenmayer. Climber.
Mt. Everest.
Neural Prostheses:
• Control by
Thought.
• Movement
Planning Neurons.
• Clint Eastwood
film. Firefox.
Summary.
• The course will describe these artificial
intelligence and biological techniques.
• Can describe other topics: e.g. Cochlear
implants.
• Mike Mays’s handout. Web journal:
• www.sendergroup.com/mike.htm
• Radio Interview: http://psy.ucsd.edu/~fine
• Contact information: [email protected]