UAB does virtual surgery with VIPAAR and Google Glass

A University of Alabama at Birmingham surgical team has performed one of the first surgeries using a virtual augmented reality technology from VIPAAR in conjunction with Google Glass, a wearable computer with an optical head-mounted display. The combination of the two technologies could be an important step toward the development of useful, practical telemedicine.

VIPAAR, which stands for Virtual Interactive Presence in Augmented Reality, is commercializing a UAB-developed technology that provides real-time, two-way, interactive video conferencing.

UAB orthopedic surgeon Brent Ponce, M.D., performed a shoulder replacement surgery Sept. 12 at UAB Highlands Hospital in Birmingham. Watching and interacting with Ponce via the VIPAAR technology was Phani Dantuluri, M.D., from his office in Atlanta.

Ponce wore Google Glass during the operation. The built-in camera transmitted the image of the surgical field to Dantuluri. The VIPAAR technology allowed Dantuluri to see exactly what Ponce saw in the operating room and introduce his hands or instruments into the virtual surgical field. At the same time, Ponce saw Dantuluri’s hands and instruments in his heads-up display, along with his own field of view, as a merged-reality environment.

“It’s not unlike the line marking a first down that a television broadcast adds to the screen while televising a football game,” said Ponce, associate professor in the Division of Orthopaedic Surgery . “You see the line, although it’s not really on the field. Using VIPAAR, a remote surgeon is able to put his or her hands into the surgical field and provide collaboration and assistance.”

The two surgeons were able to discuss the case in a truly interactive fashion since Dantuluri could watch Ponce perform the surgery and simultaneously introduce his hands or instruments into Ponce’s view as if they were standing next to each other during the case.

“It’s real-time, real-life, right there, as opposed to a Skype or video conference call, which allows for dialogue back and forth but is not really interactive,” said Ponce.

UAB physicians say this kind of technology could greatly enhance patient care by allowing a veteran surgeon to remotely provide valuable expertise to less experienced surgeons. VIPAAR owes its origins to UAB neurosurgeon Barton Guthrie, M.D., who some 10 years ago grew dissatisfied with the current state of telemedicine.

“It’s not unlike the line marking a first down that a television broadcast adds to the screen while televising a football game. You see the line, although it’s not really on the field. Using VIPAAR, a remote surgeon is able to put his or her hands into the surgical field and provide collaboration and assistance.”

“So-called ‘telemedicine’ was little more than a telephone call between two physicians,” said Guthrie, a professor in the Department of Neurosurgery. “A surgeon in a small, regional hospital might call looking for guidance on a difficult procedure — one that perhaps I’d done a hundred times but he’d done only once or twice. How advantageous to the patient would it be if we could get our hands and instruments virtually into the field of view of a surgeon who has skills and training and lacks only experience?”

“The paradigm of the telephone consultation is, ‘Do the best you can and send the patient to me when stable,’ while the paradigm with VIPAAR’s technology is ‘Get me to the patient. Let’s get my expertise and experience to the physician on the front line,’ and I think we can implement that concept with these technologies,” Guthrie said.

Ponce says VIPAAR’s capabilities allow the remote physician to point out anatomy, provide guidance or even demonstrate the proper positioning of instruments. He says it could be an invaluable tool for teaching residents or helping surgeons first learning a new procedure.

“This system is able to provide that help from an expert who is not on-site, guiding and teaching new skills while enhancing patient safety and outcomes,” he said. “It provides a safety net to improve patient care by having that assistance from an expert who is not in the room.”

In 2003, Guthrie approached the Enabling Technology Laboratory in UAB’s Mechanical Engineering Department, which was already at work on virtual, interactive technologies, with the idea of using two-way video to enhance surgery. VIPAAR licensed the resulting technology and launched operations at Innovation Depot, a technology business incubator partnered with UAB.

“VIPAAR brings experts or collaborators to the site of need, in any field where a visual collaboration would be beneficial,” said Drew Deaton, CEO of VIPAAR. “VIPAAR uses video on mobile devices to allow experts or collaborators to connect in real time and not only see what might need to be fixed, corrected or solved, but also be able to reach in, using tools or just their hands, and demonstrate. It’s like being there, side by side with someone when you might be a thousand miles, or 10 thousand miles away.”

Deaton says the increase in availability and speed of high-speed Internet and cellular networks globally and in rural areas will only increase the use of this technology. He says potential applications for VIPAAR go beyond medicine and surgery. Field service is a burgeoning area, from a service call to fix a heating system to keeping an industrial manufacturing process online and running.

“When there is a need, the time to respond and resolve an issue is critical in the field service world,” Deaton said. “VIPAAR is helping field service engineers solve problems as fast as possible and get their customers up to speed as fast as possible.”

VIPAAR’s mobile video platform is available today, while Google Glass is in beta testing. Ponce and Dantuluri were pleased with the results of their interactive collaboration. Adjustments will be needed to fine-tune the marriage between VIPAAR’s video platform and Google Glass; but the promise of useful, interactive collaboration is drawing ever closer. Deaton calls it one more step on the technology evolutionary ladder.

“Today, we can’t imagine having a smartphone without the capability to take picture or record a video,” he said. “Five years from now, I can’t imagine anyone trying to solve a visual problem without having a knowledgeable, live expert reach in and help just as if he or she were there in person.”