A team of international researchers is developing software that
could let you control your smartphone through eye movements to play games, open apps and do other stuff.
The team from the Massachusetts Institute of Technology (MIT), University of Georgia and Germany’s Max Planck
Institute for Informatics has so far been able to train software to identify where a person is looking with an
accuracy of about a cm on a mobile phone and 1.7 cm on a tablet, MIT Technology Review reported.
According to study co-author Aditya Khosla from MIT, the system’s accuracy will improve with more data.
To achieve this, the researchers created an app called GazeCapture that gathered data about how people look at
their phones in different environments outside the confines of a lab.
Users’ gaze was recorded with the phone’s front camera as they were shown pulsating dots on a smartphone screen.
To make sure they were paying attention, they were then shown a dot with an “L” or “R” inside it, and they had to tap
the left or ride side of the screen in response.
GazeCapture information was then used to train software called iTracker, which can also run on an iPhone. The handset’s
camera captures your face, and the software considers factors like the position and direction of your head and eyes to
figure out where your gaze is focused on the screen.
About 1,500 people have used the GazeCapture app so far, Khosla said, adding if the researchers can get data from 10,000
people they’ll be able to reduce iTracker’s error rate to half a centimetre, which should be good enough for a range of