Transcript PPT
Physiology of Vision: a swift overview LGN Thalamus Parietal visual cortex Dorsal Stream Striate cortex (V1) Some figures from Steve Palmer Eye Optic nerve Temporal visual cortex Extrastriate cortex Ventral Stream Pixels to Percepts A. Efros, CMU, Spring 2011
Understanding the Brain
Anatomy versus Physiology Anatomy: The biological study of the physical structure of organisms.
Physiology: The biological study of the functional structure of organisms.
© Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
The Brain is tricky business • Aristotle thought it’s for cooling the blood • Localized or distributed?
Phrenology How bad Machine Learning got started…
Localized or Distributed?
Evidence from patients with partial brain damage • Lots of useful data from soldiers in the Russo-Japanese war But also evidence for distributed nature of processing • E.g. [Lashley] showed “graceful degradation” of memory performance in rats
The Visual System
Both eye and brain are required for functional vision Two kinds of blindness: Normal blindness (eye dysfunction) Cortical blindness (brain dysfunction) © Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
The Visual System
Eyes register optical information Pathways to occipital cortex Two pathways from V1 “What” pathway to temporal cortex “Where” pathway to parietal cortex Convergence on frontal cortex © Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
Pathways to the Brain
Anatomy of Pathway to Visual Cortex © Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
Pathways to the Brain
The Lateral Geniculate Nucleus (LGN) Waystation in Thalamus Projections from both eyes Six layers Projects to cortical area V1 © Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
Visual Cortex
Map of Visual Areas in Cortex “Unfolded” view of visual areas in the macaque cortex (sizes not to scale).
© Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
Visual Cortex
What/Where Pathways Dorsal Pathway ("Where" System)
Parietal
Evidence from lesions of monkey cortex
Frontal
A
Temporal Occipital
Primary Visual Cortex Ventral Pathway ("What" System) Dorsal Lesion B Ventral Lesion C Object Discrimination Landmark Discrimination © Stephen E. Palmer, 2002
Visual Cortex
What/Where Pathways Evidence from Neuropsychology
Visual agnosia
: Inability to identify objects and/or people Caused by damage to inferior (lower) temporal lobe Disruption of the “what” pathway
Visual neglect
: Inability to see objects in the left visual field Caused by damage to right parietal lobe Disruption of the “where” pathway © Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
Visual Cortex
Feature-based Pathways Hypothesis
Visual Features
Color Shape Depth Motion
Color Form Depth
V2
Motion
MT
Color Form Depth Motion
V1
Featural Pathways
Separate neural pathways in which different features are processed.
Color Form Color Form Depth Motion
LGN
Depth Motion
RETINA © Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
The Gross Summary
The visual system is composed of many interactive functional parts: Eye (optics of image formation) Retina (light transduction) LGN (waystation?) Area V1 (hypercolumns) Higher cortical areas (features) Cortical pathways (what/where) © Stephen E. Palmer, 2002 © Stephen E. Palmer, 2002
Image Formation Film Digital Camera The Eye
Monocular Visual Field: 160 deg (w) X 135 deg (h) Binocular Visual Field: 200 deg (w) X 135 deg (h)
The Eye is a camera The human eye is a camera!
• •
Iris
colored annulus with radial muscles
Pupil
the hole (aperture) whose size is controlled by the iris • What’s the “film”?
– photoreceptor cells (rods and cones) in the
retina
The Retina Cross-section of eye Cross section of retina Pigmented epithelium Ganglion axons Ganglion cell layer Bipolar cell layer Receptor layer
Retina up-close Light
Two types of light-sensitive receptors
C on es
cone-shaped less sensitive operate in high light color vision
Rods
rod-shaped highly sensitive operate at night gray-scale vision © Stephen E. Palmer, 2002
Rod / Cone sensitivity The famous sock matching problem…
Distribution of Rods and Cones Fovea Blind Spot 150,000 100,000 50,000 Rods Rods Cones Cones 0 80 60 40 20 0 20 40 60 80 Visual Angle (degrees from fovea) Night Sky: why are there more stars off-center? © Stephen E. Palmer, 2002
Electromagnetic Spectrum Human Luminance Sensitivity Function http://www.yorku.ca/eye/photopik.htm
Visible Light Why do we see light of these wavelengths?
…because that’s where the Sun radiates EM energy © Stephen E. Palmer, 2002
The Physics of Light
Any patch of light can be completely described physically by its spectrum: the number of photons (per time unit) at each wavelength 400 - 700 nm.
# Photons (per ms.) 400 500 600 700 Wavelength (nm.) © Stephen E. Palmer, 2002
The Physics of Light
Some examples of the spectra of light sources A. Ruby Laser B. Gallium Phosphide Crystal 400 500 600 700 Wavelength (nm.) C. Tungsten Lightbulb 400 500 600 700 Wavelength (nm.) D. Normal Daylight 400 500 600 700 400 500 600 700 © Stephen E. Palmer, 2002
The Physics of Light
Some examples of the reflectance spectra of surfaces Red Yellow Blue Purple 400 700 400 700 400 700 400 700 Wavelength (nm) © Stephen E. Palmer, 2002
The Psychophysical Correspondence
There is no simple functional description for the perceived color of all lights under all viewing conditions, but …...
A helpful constraint: Consider only physical spectra with normal distributions mean # Photons 400 area variance 500 600 Wavelength (nm.) 700 © Stephen E. Palmer, 2002
The Psychophysical Correspondence Mean Hue
blue green yellow Wavelength © Stephen E. Palmer, 2002
The Psychophysical Correspondence Variance Saturation
hi.
high med.
medium low low Wavelength © Stephen E. Palmer, 2002
The Psychophysical Correspondence Area Brightness
B. Area Lightness bright dark Wavelength © Stephen E. Palmer, 2002
Physiology of Color Vision
Three kinds of cones: 440 530 560 nm.
100 S M L 50 400 450 500 550 600 650 WAVELENGTH (nm.) • Why are M and L cones so close?
© Stephen E. Palmer, 2002
Retinal Processing
© Stephen E. Palmer, 2002
Single Cell Recording
Microelectrode Amplifier Electrical response (action potentials) mV Time © Stephen E. Palmer, 2002
Single Cell Recording
© Stephen E. Palmer, 2002
Retinal Receptive Fields
Receptive field structure in ganglion cells : On-center Off-surround Response Time Stimulus condition Electrical response © Stephen E. Palmer, 2002
Retinal Receptive Fields
Receptive field structure in ganglion cells : On-center Off-surround Response Time Stimulus condition Electrical response © Stephen E. Palmer, 2002
Retinal Receptive Fields
Receptive field structure in ganglion cells : On-center Off-surround Response Time Stimulus condition Electrical response © Stephen E. Palmer, 2002
Retinal Receptive Fields
Receptive field structure in ganglion cells : On-center Off-surround Response Time Stimulus condition Electrical response © Stephen E. Palmer, 2002
Retinal Receptive Fields
Receptive field structure in ganglion cells : On-center Off-surround Response Time Stimulus condition Electrical response © Stephen E. Palmer, 2002
Retinal Receptive Fields
Receptive field structure in ganglion cells : On-center Off-surround Response Time Stimulus condition Electrical response © Stephen E. Palmer, 2002
Retinal Receptive Fields
RF of On-center Off-surround cells Neural Response Center Receptive Field Firing Rate Response Profile on-center Surround off-surround Horizontal Position On Off © Stephen E. Palmer, 2002
Retinal Receptive Fields
RF of Off-center On-surround cells Neural Response Receptive Field Response Profile Firing Rate on-surround On Off off-center Horizontal Position © Stephen E. Palmer, 2002
Retinal Receptive Fields
Retinal Receptive Fields
Receptive field structure in bipolar cells Light © Stephen E. Palmer, 2002
Retinal Receptive Fields
Receptive field structure in bipolar cells LIGHT Receptors Direct excitatory component (D) Indirect inhibitory component (I) Horizontal Cells Direct Path Bipolar Cell Indirect Path A. WIRING DIAGRAM D + I B. RECEPTIVE FIELD PROFILES © Stephen E. Palmer, 2002
Visual Cortex
Cortical Area V1 aka: Primary visual cortex Striate cortex Brodman’s area 17 LGN Thalamus Parietal visual cortex Dorsal Stream Striate cortex (V1) Eye Optic nerve Temporal visual cortex Ventral Stream Extrastriate cortex © Stephen E. Palmer, 2002
Cortical Receptive Fields
Single-cell recording from visual cortex David Hubel & Thorston Wiesel © Stephen E. Palmer, 2002
Cortical Receptive Fields
Single-cell recording from visual cortex Time © Stephen E. Palmer, 2002
Cortical Receptive Fields
Three classes of cells in V1
Simple cells Complex cells Hypercomplex cells © Stephen E. Palmer, 2002
Cortical Receptive Fields
Simple Cells: “Line Detectors” B. Dark Line Detector Firing Rate Horizontal Position © Stephen E. Palmer, 2002
Cortical Receptive Fields
Simple Cells: “Edge Detectors” C. Dark-to-light Edge Detector D. Light-to-dark Edge Detector Firing Rate Horizontal Position Firing Rate Horizontal Position © Stephen E. Palmer, 2002
Cortical Receptive Fields
Constructing a line detector Retina LGN Receptive Fields Center Surround Cells © Stephen E. Palmer, 2002
Cortical Receptive Fields
Complex Cells STIMULUS 0 0 o NEURAL RESPONSE Time © Stephen E. Palmer, 2002
Cortical Receptive Fields
Complex Cells STIMULUS 60 o NEURAL RESPONSE Time © Stephen E. Palmer, 2002
Cortical Receptive Fields
Complex Cells STIMULUS 90 o NEURAL RESPONSE Time © Stephen E. Palmer, 2002
Cortical Receptive Fields
Complex Cells STIMULUS 120 o NEURAL RESPONSE Time © Stephen E. Palmer, 2002
Cortical Receptive Fields
Constructing a Complex Cell Retina Cortical Area V1 Receptive Fields Simple Cells © Stephen E. Palmer, 2002
Cortical Receptive Fields
Hypercomplex Cells © Stephen E. Palmer, 2002
Cortical Receptive Fields
Hypercomplex Cells © Stephen E. Palmer, 2002
Cortical Receptive Fields
Hypercomplex Cells © Stephen E. Palmer, 2002
Cortical Receptive Fields
Hypercomplex Cells “End-stopped” Cells © Stephen E. Palmer, 2002
Cortical Receptive Fields
“End-stopped” Simple Cells © Stephen E. Palmer, 2002
Cortical Receptive Fields
Constructing a Hypercomplex Cell RETINA CORTICAL AREA V1 Receptive Fields Complex Cell End-stopped Cell © Stephen E. Palmer, 2002
Mapping from Retina to V1
Why edges?