Thursday, July 19, 2007

Miniature Eye Movements

Your brain doesn't care about brightness, it likes contrast. In fact, by the time signals generated by light impinging on your retina propagate through its 10 layers of cells, brightness information has largely been discarded in favor of contrast, both spatial and temporal (see paragraph two for a description). A very simple example of this is demonstrated below. Initially the contrast (in time) of the two dots is the same because they are surrounded by the same brightness. When you click on the thin or thick surrounds button, the contrasts are now inverted between the two as evidenced by the change in percept. I guarantee that nothing about the dots themselves change, only the surrounding area.









(Shapiro, A. G., D’Antona, A. D., Charles, J. P., Belano, L. A., Smith, J. B., & Shear-Heyman, M. (2004). Induced contrast asynchronies. Journal of Vision, 4(6):5, 459-468, http://journalofvision.org/4/6/5/ica.html)

Now let me disambiguate a bit what is meant by temporal and spatial contrast. A painting, say Seurat's Sunday Afternoon on the Island of La Grande Jatte, has plenty of spatial contrast, but because nothing changes in time, there is no temporal contrast. A movie screen filled with white which fades to black and back to white, oscillating, has plenty of temporal contrast and no spatial contrast. Now, if there is no temporal contrast at all in your visual field, the world will fade away. Your visual system needs temporal contrast. This is one of the purposes of so called fixational eye movements. These are small involuntary eye movements which you make between the large point to point movements called saccades that we use to change the direction of our gaze. So even if you were standing in front of a painting such that it filled your vision completely and only stared at one point, your eyes would move slightly, around your fixation target, to prevent the image from fading away. If somebody drugged your eye muscles so that there was no way to execute these small movements and filled your vision with an image that had no temporal contrast, the world would fade away.

The idea that brains only encode change and not static values of sensory data is pretty ubiquitous, and there are a wealth of examples. What I'd like to continue with, however, is another function of fixational eye movements that has been speculated about but only demonstrated of late. In a recent paper in Nature*, researchers have discovered that these small eye movements serve to enhance our fine scale spatial resolution. That is to say that without small eye movements, we are less able to detect the presence of and report the properties of fine spatial scale visual stimuli.

One very useful analogy is the way we run our fingers over something textured to better comprehend the shape of it. For example, suppose you were blindfolded and I put a piece of wood in your lap. I tell you that this piece of wood has some number of very small adjacent grooves cut into it at some particular position. If I asked you to find them and count them, I suspect that you would run your fingers across the wood until you found them and then rub your index finger over them a couple of times to determine the number. It seems a very natural way to do it, and this is exactly akin to making small eye movements to improve spatial resolution. Not making small eye movements like that would be akin to simply pressing your finger down straight on the grooves in an attempt to count them. Perhaps you could do alright at this if there were only one or two, or if they were very big, but as the task got more and more difficult you'd need to use the sliding technique in order to discriminate. The commonality here is that both your sense of touch and sense of sight are mediated by an array of detectors of fixed size and position, and some stimuli are simply too small and/or finely spaced to be accurately detected by the particular array of detectors you've got.

Here's another example: suppose you were using a number of long same-diameter, same length rods to determine the topographical features of a small area of the bottom a pool of water. One way to do this would be to take many rods in a bundle and push them each down (still in a bundle) until they stopped, recording each of their heights individually. The problem with this method is that the resolution of your image of the bottom is limited to the diameter of the sticks. Assuming you can't use ever thinner sticks (we can't make the receptor size in our eyes or hands arbitrarily small), you can get a better resolution image by running a single rod (or many rods) over the area to be mapped, continuously recording the height. In this way you have more information than if you simply assign each rod to a single point on the bottom, increasing your resolution.

*Rucci, M., Iovin1, R., Poletti1, M. & Santini, F. Miniature eye movements enhance fine spatial detail Nature 447, 852-855 (14 June 2007)

1 comment:

Jeannie said...

i like that thought - without seeing what surrounds a point, your world will fade away.