Projects
Image Guidance for Robot-Assisted Ankle Fracture Repair
This project concerns developing and validating an image guidance framework for
application to a robotic-assisted fibular reduction in ankle fracture surgery. The aim is to
produce and demonstrate proper functioning of software for automatic determination of
directions for fibular repositioning with the ultimate goal of application to a robotic reduction
procedure that can reduce the time and complexity of the procedure as well as provide the
benefits of reduced error in ideal final fibular position, improved syndesmosis restoration and
reduced incidence of post-traumatic osteoarthritis. The focus of this product will be developing
and testing the image guidance software, from the input of preoperative images through the
steps of automated segmentation and registration until the output of a final transformation that
can be used as instructions to a robot on how to reposition the fibula, but will not involve
developing or implementing the hardware of the robot itself.
Sketchup Slicer Ruby plugin for converting 3D model to image stack
3D models are frequently used in Computer Vision applications to simulate real world objects. For example in medical applications, 3D models of bones, organs, and other anatomical features are commonly constructed and used to study drugs, diseases, and procedures [1,4,7]. Furthermore, 3D models can be combined with machine learning, such as being fed as input into deep neural networks, for purposes such as diagnosis or surgical guidance [2,5]. It is often necessarily or at least useful to have the 3D model stored in the form of a sequence of 2-dimensional slices, otherwise known as an image stack [3]. Image stacks are often usually the output format of medical imaging devices, such as with DICOM and TIFF formats. Neural networks and other machine learning algorithms also usually require fixed grid input such as images [6]. However, 3D modeling software packages generally offer few if any methods to directly export 3D models, such as an .stl file, to an image stack. This work presents a novel method for instantly converting a 3D model to an image stack directly in the form of a Ruby script written for use in Sketchup, a 3D CAD program originally developed by Google. Sketchup is written in Ruby and provides an API allowing for development of custom plugins which made this possible. The plugin was tested using an example of a 3D lung model.