used for sports events, and HHI is planning to extend it to augmented reality and medical applications.

Another technology developed in combination with high-resolution video and augmented reality is “touchless pixel-precise 2D or 3D real-time tracking.” Almost like a shadow puppeteer, the user’s stretched-out fingers can control and even manipulate various images without touching them. A surgeon would be able to directly control the content of a display by simply pointing in a sterile environment. HHI worked with a medical equipment company to market its technology to clinics and hospitals.

Another example where video processing plays a large role is 3D image processing for biometrics. Usually 3D video has to go through a period of postprocessing, which makes it difficult to use in real-time medical applications. From its long experience creating 3D information from 2D video, HHI is able to use multiple cameras to create perfect stereo impressions in real time, which is useful in many medical applications.

The same HHI department, using the same algorithms, has produced a “virtual mirror.” He described a young woman wearing a green shirt, looking into the mirror; as she looks, the color of the shirt changes; then the colors of nearby art-work change as well. For medical application, such a technology could be used to display a surface such as the outside of the liver; a change in liver health can then be displayed as a different color to aid diagnosis or research.

A Technology to Detect Both Plagiarism and Cancer Cells

The HHI has been working for many years on a technology that detects plagiarism, either on the Internet, with IP, or elsewhere. They are able to detect similar pictures, or sift through a huge set of pictures to find the same cars, people, or other defining “fingerprint.” Such a technology might be applied to cancer detection, said Dr. Giesekus, if the algorithm can be used to identify telltale cancer indicators in a patient’s cells.

The HHI is also working on a medical application of a technology that stabilizes video processing. Researchers have developed a core technology of high dynamic range (HDR) video that, like Photoshop, can recalculate the light or dark qualities of a picture. A problem in applying the same technology to video, he said, is that the dark and the light pictures are not taken at precisely the same time, so motion distorts the image. HHI engineers have learned to eliminate the motion, a technique that could be used to stabilize the images of an endoscopic procedure or other operation in the body.

Dr. Giesekus mentioned several other technologies with possible medical applications, including optical sensing at the nanoscale to identify dangerous bacteria or explosives; tiny fiber sensors, now used to measure stress and strain in a building, to control the position of a colonoscope or other instrument; cheap, handheld terahertz imaging devices to detect cancers, cavities in teeth, explosives, or other abnormalities.

The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement