Segmentation in X-ray Fluoroscopy Utilizing Virtual Simulations of Cardiovascular Procedures

dc.contributor.authorAndersson, Rasmus
dc.contributor.authorEkerstedt, Martin
dc.contributor.departmentChalmers tekniska högskola / Institutionen för elektrotekniksv
dc.contributor.examinerHäggström, Ida
dc.contributor.supervisorStorm, Henrik
dc.date.accessioned2024-06-12T13:44:33Z
dc.date.available2024-06-12T13:44:33Z
dc.date.issued2024
dc.date.submitted
dc.description.abstractAbstract This project aims to assess the quality of simulated fluoroscopy images from the company Mentice and their surgical simulator as training data for neural networks. To do this, a simulated dataset was collected by extracting images and corresponding information from the simulation to create labels for different objects in the image automatically. The objects segmented in the images are catheters. The evaluation uses a dataset from diagnostic and Trans-catheter Aortic Valve Implantation (TAVI) in vivo procedures. A model called Neural Neighbor Style Transfer was used to adapt the domain of the images to make them look more like real images to improve the performance. To perform segmentation two models U-Net and YOLOv8 were used. The major finding was that a Dice score of 0.8803 was achieved using pretraining on style-transfer images using YOLOv8. It was also found that by pre-training using simulated images performance was on average increased by 0.3%/0.6% (Dice/IoU) for simulated images and 0.9%/1.2% for style-transfered images. A model trained purely on simulated images could achieve a Dice score of 0.5182. Overall it can be concluded that the simulated images help improve performance and style-transfer also shows promise for improving the metrics.
dc.identifier.coursecodeEENX30
dc.identifier.urihttp://hdl.handle.net/20.500.12380/307819
dc.language.isoeng
dc.setspec.uppsokTechnology
dc.subjectKeywords: Fluoroscopy, X-ray, Mentice, Style Transfer, Segmentation, U-Net, YOLO, TAVI, Simulation, Catheter
dc.titleSegmentation in X-ray Fluoroscopy Utilizing Virtual Simulations of Cardiovascular Procedures
dc.type.degreeExamensarbete för masterexamensv
dc.type.degreeMaster's Thesisen
dc.type.uppsokH
local.programmeBiomedical engineering (MPBME), MSc
Ladda ner
Original bundle
Visar 1 - 1 av 1
Hämtar...
Bild (thumbnail)
Namn:
Segmentation_in_X_ray_Fluoroscopy_Utilizing_Virtual_Simulations_of_Cardiovascular_Procedures_final.pdf
Storlek:
26.12 MB
Format:
Adobe Portable Document Format
Beskrivning:
License bundle
Visar 1 - 1 av 1
Hämtar...
Bild (thumbnail)
Namn:
license.txt
Storlek:
2.35 KB
Format:
Item-specific license agreed upon to submission
Beskrivning: