Real-time Geometry-Aware Augmented Reality in Minimally Invasive Surgery.

Chen, L., Tang, W. and John, N.W., 2017. Real-time Geometry-Aware Augmented Reality in Minimally Invasive Surgery. Healthcare Technology Letters. (In Press)

Full text available as:

[img] PDF
AECAI -Long Chen.pdf - Accepted Version
Restricted to Repository staff only
Available under License Creative Commons Attribution Non-commercial No Derivatives.


Official URL:


The potential of Augmented Reality (AR) technology to assist minimally invasive surgeries (MIS) lies in its computational performanceand accuracy in dealing with challenging MIS scenes. Even with the latest hardware and software technologies, achieving both real-timeand accurate augmented information overlay in MIS is still a formidable task. In this paper, we present a novel real-time AR frameworkfor MIS that achieves interactive geometric aware augmented reality in endoscopic surgery with stereo views. Our framework tracks themovement of the endoscopic camera and simultaneously reconstructs a dense geometric mesh of the MIS scene. The movement of the camerais predicted by minimising the re-projection error to achieve a fast tracking performance, while the 3D mesh is incrementally built by a densezero mean normalised cross correlation stereo matching method to improve the accuracy of the surface reconstruction. Our proposed systemdoes not require any prior template or pre-operative scan and can infer the geometric information intra-operatively in real-time. With thegeometric information available, our proposed AR framework is able to interactively add annotations, localisation of tumors and vessels,and measurement labeling with greater precision and accuracy compared with the state of the art approaches.

Item Type:Article
Uncontrolled Keywords:Augmented Reality ; Minimally Invasive Surgery
Group:Faculty of Science & Technology
ID Code:29496
Deposited By: Unnamed user with email symplectic@symplectic
Deposited On:24 Jul 2017 11:31
Last Modified:24 Jul 2017 11:31


Downloads per month over past year

More statistics for this item...
Repository Staff Only -