Controlling Your Computer With Your Eyes
Millions of people suffering from Multiple Sclerosis, Parkinson’s, muscular dystrophy, spinal cord injuries or amputees could soon interact with their computers and surroundings using just their eyes, thanks to a new device that costs less than £40.
Composed from off-the-shelf materials, the new device can work out exactly where a person is looking by tracking their eye movements, allowing them to control a cursor on a screen just like a normal computer mouse.
The technology comprises an eye-tracking device and “smart” software that have been presented today, Friday 13 July, in IOP Publishing’s Journal of Neural Engineering. Researchers from Imperial College London demonstrated its functionality by getting a group of people to play the classic computer game Pong without any kind of handset. In addition users were able to browse the web and write emails “hands-off”.
A video of somebody using the device to play Pong can be viewed here (https://www.youtube.com/watch?v=zapK5wvYU84)
The GT3D device is made up of two fast video game console cameras, costing less than £20 each, that are attached, outside of the line of vision, to a pair of glasses that cost just £3. The cameras constantly take pictures of the eye, working out where the pupil is pointing, and from this the researchers can use a set of calibrations to work out exactly where a person is looking on the screen.
Even more impressively, the researchers are also able to use more detailed calibrations to work out the 3D gaze of the subjects – in other words, how far into the distance they were looking. It is believed that this could allow people to control an electronic wheelchair simply by looking where they want to go or control a robotic prosthetic arm.
To demonstrate the effectiveness of the eye-tracker, the researchers got subjects to play the video game Pong. In this game, the subject used his or her eyes to move a bat to hit a ball that was bouncing around the screen – a feat that is difficult to accomplish with other read-out mechanisms such as brain waves (EEG).
Dr Aldo Faisal, Lecturer in Neurotechnology at Imperial's Department of Bioengineering and the Department of Computing, is confident in the ability to utilise eye movements given that six of the subjects, who had never used their eyes as a control input before, could still register a respectable score within 20 per cent of the able bodied users after just 10 minutes of using the device for the first time.
The commercially viable device uses just one watt of power and can transmit data wirelessly over Wi-Fi or via USB into any Windows or Linux computer.
The GT3D system has also solved the ‘Midas touch problem’, allowing users to click on an item on the screen using their eyes, instead of a mouse button.
This problem has previously been resolved by staring at an icon for a prolonged period or blinking; however, the latter is part of our natural behaviour and happens unintentionally. Instead, the researchers calibrated the system so that a simple wink would represent a mouse click, which only occurs voluntarily unlike the blink.
Dr Faisal said: "Crucially, we have achieved two things: we have built a 3D eye tracking system hundreds of times cheaper than commercial systems and used it to build a real-time brain machine interface that allows patients to interact more smoothly and more quickly than existing invasive technologies that are tens of thousands of times more expensive.
“This is frugal innovation; developing smarter software and piggy-backing existing hardware to create devices that can help people worldwide independent of their healthcare circumstances."
From Friday 13 July, the full journal paper can be downloaded from http://iopscience.iop.org/1741-2552/9/4/046016
For further information, a full draft of the journal paper or contact with one of the researchers, contact IOP Press Officer, Michael Bishop: Tel: 0117 930 1032
E-mail: Michael.bishop@iop.org
Ultra low-cost 3D gaze estimation: an intuitive high information throughput complement to direct brain–machine interfaces
The published version of the paper "Ultra low-cost 3D gaze estimation: an intuitive high information throughput complement to direct brain–machine interfaces" Abbott W W and Faisal A A 2012 J. Neural Eng. 9 046016 will be freely available online from Friday 13 July. It will be available from http://iopscience.iop.org/1741-2552/9/4/046016
Journal of Neural Engineering
Journal of Neural Engineering was created to help scientists, clinicians and engineers to understand, replace, repair and enhance the nervous system.
IOP Publishing
IOP Publishing provides publications through which leading-edge scientific research is distributed worldwide. IOP Publishing is central to the Institute of Physics (IOP), a not-for-profit society. Any financial surplus earned by IOP Publishing goes to support science through the activities of IOP. Beyond our traditional journals programme, we make high-value scientific information easily accessible through an ever-evolving portfolio of community websites, magazines, conference proceedings and a multitude of electronic services. Focused on making the most of new technologies, we’re continually improving our electronic interfaces to make it easier for researchers to find exactly what they need, when they need it, in the format that suits them best. For more information, visit http://ioppublishing.org/.
About The Institute of Physics
The Institute of Physics is a leading scientific society promoting physics and bringing physicists together for the benefit of all.
It has a worldwide membership of around 40 000 comprising physicists from all sectors, as well as those with an interest in physics. It works to advance physics research, application and education; and engages with policymakers and the public to develop awareness and understanding of physics. Its publishing company, IOP Publishing, is a world leader in professional scientific. For more information, visit www.iop.org
Imperial College London
Consistently rated amongst the world's best universities, Imperial College London is a science-based institution with a reputation for excellence in teaching and research that attracts 14,000 students and 6,000 staff of the highest international quality. Innovative research at the College explores the interface between science, medicine, engineering and business, delivering practical solutions that improve quality of life and the environment - underpinned by a dynamic enterprise culture.
Since its foundation in 1907, Imperial's contributions to society have included the discovery of penicillin, the development of holography and the foundations of fibre optics. This commitment to the application of research for the benefit of all continues today, with current focuses including interdisciplinary collaborations to improve global health, tackle climate change, develop sustainable sources of energy and address security challenges.
In 2007, Imperial College London and Imperial College Healthcare NHS Trust formed the UK's first Academic Health Science Centre. This unique partnership aims to improve the quality of life of patients and populations by taking new discoveries and translating them into new therapies as quickly as possible.
Website: www.imperial.ac.uk
Twitter: www.twitter.com/imperialspark
Podcast: www.imperial.ac.uk/media/podcasts
SOURCE: Institute of Physics (IOP)