There are surgeons operating on patients right now who can't feel their instruments. Similarly, there are workers in nuclear facilities around the world using remote manipulator arms to handle radioactive materials without a sense of what they're touching. It's an epidemic of numbness that afflicts virtually everyone who performs a manual job with robotic assistance—from bomb disposal experts in Afghanistan to astronauts aboard the International Space Station.
The problem isn't physiological; but rather, mechanical. As robots become increasingly common, particularly in high-stakes and high-risk situations, the benefit of deploying remotely operated surrogates is hitting a functional wall. For the most part, robots can't feel what they touch, forcing their users to rewire their own instincts and replace simple tactile cues—the contours of a wire between two fingertips, for example—with constant visual confirmation. The result is what researchers call “increased cognitive load,” where the operator must actively think about countless minor tasks that should all be effortless. When the clock is ticking on those tasks, such as when a patient is losing blood, or a roadside bomb is about to detonate, the weight of that additional responsibility can become nearly unbearable.
Now, researchers are hoping to lighten that cognitive burden, and possibly make an entire generation of robots more effective, by creating machines that can feel. It's called haptic technology, and it represents one of the most challenging research fields in robotics. But with new sensors and feedback systems finally making it out of the lab, it also happens to be one of the most promising.
Sensory feedback: the thin line between good vibrations and aggravating distractions
At its core, haptics is about machines communicating through touch, whether that means a joystick that grinds to a halt when the manipulator it’s commanding hits an obstacle, or a touch screen that buzzes with each tap on its virtual keyboard. Vibration is the most common form of haptic feedback, and the rattle of an incoming call on a silenced cell phone is its most common application.
Extending that concept to robotics seems straightforward. When a surgical robot, like Intuitive Surgical's da Vinci system, touches a patient's tissue with its manipulator, why not signal the operator with a mild buzz? “You don't want to put vibration on a surgeon's hand,” says Ken Steinberg, CEO of Massachusetts-based Cambridge Research & Development, which has tested its own haptic device for use with surgical robots. Since their hands already pinch and torque the machine's controls to direct the manipulators inside a patient's body, surgeons have told Steinberg that near-constant vibrations would, at best, be a nuisance; and at worst, a confusing, finger-numbing distraction. “Vibration absolutely does not work with the human body,” says Steinberg. “The nerves lose track of which vibration is stronger and which one is weaker. All it does, over time, is aggravate you.”
Cambridge R&D's solution is less buzz, more nudge. The company recently demonstrated the Neo, a prototype of a linear actuator—a headband-mounted mechanism that moves up and down, rather than with the circular motion typical of most motors. When the da Vinci system's instruments or manipulators make contact with anything, the Neo’s small tactor (a tiny transducer that conveys pressure and vibrations to the user’s skin) pushes against the surgeon's head. The use of the linear actuator allows for adjustments of tactile feedback by minute degrees—from a feathery tickle that reflects a manipulator brushing against tissue, to an unmistakable tap when a suture is pulled taut.
To test the feedback’s effectiveness, one surgeon outfitted with a Neo conducted a simulated operation that required him to grasp a vein—something surgeons typically avoid doing with minimally invasive surgical robots due to the high risk of puncture or damage. “We decided to show how delicately we could grab a simulated vein to demonstrate the minimized level of deflection, or crushing,” says Steinberg. “We blindfolded the surgeon and had him use the robot to grab the vein, which was a straw in this case, and told him to stop the moment he could feel the straw.” When the surgeon felt the straw, the robot stopped almost immediately, providing Steinberg with confirmation that there would not have been any tissue damage or punctures. Considering that the da Vinci's standard feedback is visual-only by way of a 3D high-resolution monitor, it's an impressive glimpse of what transmitted touch has to offer. “This capability costs hundreds of dollars to install, not hundreds of thousands. We think we have a solution for haptics for the next decade,” says Steinberg.
Although Cambridge R&D is hoping to license its technology to companies like Intuitive Surgical, a more traditional form of haptic feedback has already made it into the operating room. The RIO surgical robot, which is used exclusively for hip and knee procedures, is guided by an orthopedic surgeon, but RIO already has a plan in place before the procedure begins—it draws on its own knowledge of the patient based on CT scans conducted ahead of time. So if the human surgeon veers off-target, or applies too much pressure, the RIO applies what Florida-based Mako Surgical calls “tactile feedback.” It's another term for “force feedback,” where the controls actively push back against the user.
Haptics may be more effective if robots are designed to react to tactile feedback autonomously