Ada-Tracker: Soft Tissue Tracking via Inter-Frame and Adaptive-Template
  Matching
Jiaxin Guo Jiangliu Wang Zhaoshuo Li Tongyu Jia Qi Dou Yun-Hui Liu
Soft tissue tracking is crucial for computer-assisted interventions. Existing
approaches mainly rely on extracting discriminative features from the template
and videos to recover corresponding matches. However, it is difficult to adopt
these techniques in surgical scenes, where tissues are changing in shape and
appearance throughout the surgery. To address this problem, we exploit optical
flow to naturally capture the pixel-wise tissue deformations and adaptively
correct the tracked template. Specifically, we first implement an inter-frame
matching mechanism to extract a coarse region of interest based on optical flow
from consecutive frames. To accommodate appearance change and alleviate drift,
we then propose an adaptive-template matching method, which updates the tracked
template based on the reliability of the estimates. Our approach, Ada-Tracker,
enjoys both short-term dynamics modeling by capturing local deformations and
long-term dynamics modeling by introducing global temporal compensation. We
evaluate our approach on the public SurgT benchmark, which is generated from
Hamlyn, SCARED, and Kidney boundary datasets. The experimental results show
that Ada-Tracker achieves superior accuracy and performs more robustly against
prior works. Code is available at https://github.com/wrld/Ada-Tracker.