Medical Video Processing (Tutorial)

Processing and analysis of medical videos is becoming more and more important, because an increasing number of videos and images are integrated in the daily routine of surgical and diagnostic work. While the collection of medical multimedia data is not an issue, appropriate tools for efficient use of this data are missing. This includes management and inspection of data, optimized storage, visual analytics, as well as learning relevant semantics and using recognition results for optimizing surgical and diagnostic processes. The characteristics and requirements in this interesting but challenging field are different than the ones in classic multimedia domains. Therefore, this tutorial gives a general introduction to the field, provides a broad overview of specific requirements and challenges, discusses existing work and open challenges, and elaborates in detail how video and image processing and analysis can support surgeon training and retrospective analysis, among several other use cases. In particular, it covers domain-specific compression of medical videos in laparoscopy and cataract surgery, relevance filtering, tool and action classification, irregularity detection, as well as an overview of existing datasets.