CAVASS-DL: An Enhanced Computer-Assisted Visualization and Analysis Software System by Integrating Deep Learning Segmentation Models.
Authors
Affiliations (3)
Affiliations (3)
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, Philadelphia, PA, 19104, United States.
- School of Cyber Science and Engineering, Zhengzhou University, Zhengzhou, Henan, China.
- Saint Joseph's University, Philadelphia, United States.
Abstract
Segmentation in medical images plays a crucial first step for the quantitative analysis of organs of interest and disease conditions that may affect them. In the 2000s, we released an open-source medical image processing and analysis software system called CAVASS (Computer-Assisted Visualization and Analysis Software System), whose lineage goes back to 1980 as the first software for medical image processing. CAVASS supports multiple types of medical images and numerous usage scenarios/use cases. To allow ready access to advanced deep learning models within the easy-to-use graphical user interface (GUI) of CAVASS to greatly facilitate ground truth segmentation generation and production mode image segmentation, we created an enhanced version of CAVASS, called CAVASS-DL, by integrating the Segment Anything Model (SAM) within our software, which can extract and fuse the features from images and interactive prompts to enhance the segmentation performance. Firstly, we modified the GUI to enable intuitive region-of-interest (ROI) prompting via bounding boxes. Secondly, we implemented and trained the SAM network using PyTorch platform. Lastly, we bundled the SAM network as a standalone executable interface for CAVASS. The illustrative and quantitative results on 20 dynamic MRI scans of neck and thorax demonstrate that our approach achieves high accuracy and efficiency for semi-automatic anatomy object segmentation via CAVASS-DL in a convenient manner.