State-of the-art eye tracking utilizes high performance industry cameras that detect near-infrared spectrum light, and also benefit from active illumination in that spectrum. These features work together to create a highly accurate system for eye tracking. However other options have begun to emerge and we believe in always providing the full image. In this post we will dig into the world of dedicated eye tracking hardware and webcam-based eye tracking and potentially what the future holds.
The power of infrared
The typical eye tracker is a dedicated piece of camera hardware designed and optimized for capturing eye movement in any lighting condition, and can compensate for head movement, and a wide range physiological variation of the eye region.
Webcam eye tracking has none of these benefits.
To begin with, webcam eye tracking essentially means getting eye tracking data from a “normal” camera – a camera that only detects light in the visible spectrum. This is because we only really need or want a webcam that operates with visible spectrum light – video conferencing in near-infrared spectrum light would be a peculiar experience.
Visual spectrum, resolution, and contrast
Webcams, or consumer application cameras are tuned for the visual spectrum and that poses some limits:
- Visual spectrum only: no benefit from near-infrared spectrum light (which allows the algorithm to accurately detect the pupil against the surrounding iris). The eye will therefore likely appear as one big blur consisting of both pupil and iris.
- Resolution: A typical webcam can record up to HD, but often with a trade-off in latency and frame rate. Lower resolution can resolve that, however the trade-off here is fewer pixels to describe the eye region. Fewer pixels means less information to extract the eye gaze from, and ultimately less accuracy and reliability.
- Contrast: because the webcam entirely depends on the ambient light condition, low lighting can result in even less accuracy, as there is less contrast to detect eye movements against the background of the face.
Mapping eye movement with a webcam
Assuming one is willing to accept these limitations, then how might the algorithm detect eye movements and map them onto a medium such as a computer monitor or mobile device display?
The high-level process:
- Detect location of face
- Detect location of eyes within the face
- Detect orientation of left and right eye
- Map the orientation of the eyes onto the screen coordinate system
Most methods rely on a calibration to make the mapping in Step 4. Calibration is typically done in the same way as standard eye tracking: expose a number of calibration points on the screen and ask the participant to look at those points in order to build a model.
Pros and cons of webcam-based eye tracking
As such the pros provide the promise of making eye tracking a ubiquitous technology. Essentially a technology which all devices with embedded cameras could support – which today is of course virtually all personal computers and mobile devices.
For academic and commercial research there is a potential to collect visual attention data on any population, cheap and fast – just like sending out a typical online survey.
However, the downsides show that the type – and quality – of research is severely limited by the use of webcams. Further to this, the possibility of publishing research reflects the quality of the tools used, meaning that webcam-based methods are unlikely to pass review.
Existing webcam software solutions
A few options already exist if you’re interested in investigating them further.
GazeRecorder – Desktop
GazeRecorder is a freeware developed by independent researcher Szymon Deja.
It works as a desktop application that handles calibration and recording of eye tracking data and screen content. Video exports and raw data are available after recording.
Webgazer – Web Browser
This is a cloud-based solution offered by Tobii, that uses webcam-based eye tracking alongside surveys for large-scale studies. Ali Farokhian, Head of Tobii Pro Insight, states how “Webcams enable large-scale studies and fast turnaround ideal for high-level, aggregate level analysis while the eye trackers developed specifically for research allows for high accuracy, lengthy sessions ideal for detailed data analysis. Both technologies meet different needs and answer different questions.”
EyeSee is a Belgian market research company that offers online solutions that incorporate facial expression analysis.
Technology of the future
Simplified components – but with near-infrared light
Before The Eye Tribe was bought by Facebook their mission was to develop robust eye tracking algorithms that can work through cheap hardware components. Their plan was not to solely rely on standard embedded cameras in devices, rather their mission was to prove that by adding only a few extra hardware components, robust eye tracking could become ubiquitous.
This ultimately meant that in addition to the already existing camera in a laptop or mobile phone, a diode providing active illumination in the near-infrared spectrum would be enough to gain the robustness needed for accurate eye tracking.
Microsoft Kinect and Intel Realsense are cheap hardware platforms that can be purchased for a few hundred dollars and provide options to record in the non-visible spectrum as well providing a distance map for the images.
Eyeware is an eye tracking startup that has developed eye tracking algorithms for these platforms.
Embedded into technology
Tobii has an ambition to integrate current state of the art eye tracking into consumer products.
Tobii Tech is the division that develops consumer-oriented eye tracking hardware and have already partnered with some laptop and monitor manufacturers in order to embed their high-performing low-cost eye tracking hardware into consumer electronics.
This is clearly a different approach where proper eye tracking hardware is introduced into the devices, rather than expanding the capability of the existing web cameras that virtually all devices come with today.
Accuracy – through different methods
Adhawk is presenting an entirely new way to detect eye movements. Instead of using a normal camera their system relies on a MEMS scanner. The benefit is the hardware cost can be drastically reduced, and it could potentially provide very accurate measurements of the eye position.
Currently the technology mostly allows for integration into a glasses-like device, meaning that remote eye tracking with the ubiquity of webcam-based systems are not going to be immediately available.
Ultimately, the usefulness of eye tracking types depends on how it will be used. If the intention is simply to determine whether or not a respondent has looked at a particular quadrant of a screen, then webcam-based methods may well fulfill that. However, if greater spatial or temporal resolution is required, then infrared eye trackers will be essential.
Ali Farokhian, Head of Tobii Pro Insight, puts it similarly “In the end it all depends on where they are in the innovation process. Choosing between a webcam, or say, a Tobii Pro X3-120, or a wearable eye tracker requires the assessment of a researcher’s stage of that process and their use case.”
As with all technology, the best is yet to come. Future hardware and software integrations will get even more sophisticated and will begin to compete with eye trackers. For the time being and in the foreseeable future, we strongly recommend dedicated eye tracking hardware to answer your research questions. We will actively keep monitoring the development of new solutions to deliver the best value to our clients to fulfill their research needs.
We hope that you’ve found this breakdown of webcam-based eye tracking to be helpful. If you’d like to learn more about the details of eye tracking then download our free, comprehensive guide below or contact us if you would like to know more about iMotions and our eye tracking solutions.