+ All Categories
Home > Documents > Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol,...

Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol,...

Date post: 22-Jan-2021
Category:
Upload: others
View: 37 times
Download: 0 times
Share this document with a friend
52
Basics of Data Loading and 3D Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology Brigham and Women’s Hospital Harvard Medical School
Transcript
Page 1: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Basics of Data Loading and 3D

Visualization in 3D Slicer

Sonia Pujol, Ph.D.

Director of 3D Slicer Training & Education

Assistant Professor of RadiologyBrigham and Women’s Hospital

Harvard Medical School

Page 2: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Overall Goal

This tutorial is an introduction to the basics of loading and viewing DICOM images and 3D models in 3D Slicer.

© Sonia Pujol, Ph.D. All Rights Reserved 2

Page 3: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Learning Objectives

Following this tutorial, you will be able • to load and visualize DICOM images in Slicer • to perform volume rendering of CT datas• to load and visualize 3D models reconstructed

from MRI data

© Sonia Pujol, Ph.D. All Rights Reserved 3

Page 4: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Tutorial materials

3D Slicer version 4.11.03DVisualizationDataset.zip

Page 5: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Tutorial dataset

• The file 3DVisualizationDataset.zip contains two directories: – dataset1_Thorax_Abdomen– dataset2_Head

• Unzip the file 3DVisualizationDataset.zip on your computer to access the datasets

© Sonia Pujol, Ph.D. All Rights Reserved 5

Page 6: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Disclaimer• 3D Slicer is a free open source software

application distributed under a BSD style license.

• The software is not FDA approved or CE-Marked, and is for research use only.

Page 7: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Tutorial Outline

Part 1: Loading and Viewing DICOM data

Part 2: Volume Rendering

Part 3: Loading and Viewing 3D models

Page 8: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Part 1DICOM Data Loading

Page 9: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved 9

Drag and drop the directory dataset1_Thorax_Abdomen into Slicer

Page 10: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved 10

Click on OK to load the directory in the DICOM database

Page 11: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved11

Slicer displays the user interface of the DICOM module

The patient1 study contains a CT Thorax Abdomen dataset

Page 12: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved12

Select patient1 and click on Load to load the dataset in Slicer

Page 13: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved 13

Select the CT_Thorax_Abdomen dataset

Slicer displays the axial, coronal and sagittal images of the CT Thorax Abdomen dataset

Page 14: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved 14

Select the CT_Thorax_Abdomen dataset

Slicer displays the axial, coronal and sagittal images of the CT Thorax Abdomen dataset

Page 15: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved 15

Select the module Volumes

Left click on DICOM to display the list of modules of Slicer

Page 16: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved 16

Click on the CT-abdomen preset to automatically adjust the window/level display of the CT dataset

Page 17: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a DICOM volume

© Sonia Pujol, Ph.D. All Rights Reserved 17

Position the mouse cursor over the red banner in the Red Viewer to display the slice menu.

Click on the Links icon to link the slice controls across all Slice Viewers.

Click on the Eye icon todisplay the three anatomical slices in the 3D Viewer

Page 18: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Visualizing DICOM images

© Sonia Pujol, Ph.D. All Rights Reserved 18

The three anatomical slices appear in the 3D viewer.

Page 19: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Visualizing DICOM images

© Sonia Pujol, Ph.D. All Rights Reserved 19

Click on the Slicer layout menu icon, and select the Conventional Widescreen layout

Page 20: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Visualizing DICOM images

© Sonia Pujol, Ph.D. All Rights Reserved 20

Click on the Slicer layout menu icon, and select the Conventional Widescreen layout

Page 21: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Visualizing DICOM images

© Sonia Pujol, Ph.D. All Rights Reserved 21

Slicer switches the layout to Conventional Widescreen layout

Page 22: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Visualizing DICOM images

© Sonia Pujol, Ph.D. All Rights Reserved 22

Use the right mouse button in the 3D Viewer to zoom in and out

Page 23: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Visualizing DICOM images

© Sonia Pujol, Ph.D. All Rights Reserved 23

Use the left mouse button in the 3D Viewer to rotate the images

Page 24: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

3D Viewer Controller

© Sonia Pujol, Ph.D. All Rights Reserved 24

Position the mouse cursor over the pin icon in the blue banner of the 3D viewer window to display the 3DView controller

Click on the second icon on the top row of the 3DView controller to center the 3D view on the scene

Page 25: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

3D Viewer Controller

© Sonia Pujol, Ph.D. All Rights Reserved 25

Select the Volume Rendering module in the list of modules

Page 26: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Part 2Volume Rendering

Page 27: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

• Volume rendering techniques enable 3D visualization of 3D datasets

• The Volume Rendering module in Slicer enables interactive 3D visualization of DICOM images

© Sonia Pujol, Ph.D. All Rights Reserved 27

Page 28: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 28

Click on Preset in the Display tab and select the preset CT-Cardiac3

Page 29: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 29

Select VTK GPU Ray Casting RenderingClick on the eye icon in the Volume tab to display the volume rendered image in the 3D viewer

Page 30: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 30

Use the shift slider to change the transfer function and display the aorta

Page 31: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 31

Click on Display ROI to display a region of interest (ROI) in the 3D viewer and check the option Enable

Page 32: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 32

Turn off the visibility of the axial, sagittal and coronal slices in the 2D viewer

Position the ROI around the left kidney using the color handles

Page 33: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 33

Click on the eye icon to display the volume rendered image

Page 34: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 34

Slicer displays the volume rendered image of the left kidney

Page 35: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 35

Extend the ROI to generate a volume rendered image of the right kidney

Page 36: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Volume Rendering

© Sonia Pujol, Ph.D. All Rights Reserved 36

Click on Fileà Close Scene in the main menu

Page 37: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Part 3Loading and

viewing 3D models

Page 38: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Tutorial dataset

• The directory dataset2_Head contains the Slicer scene called Head_scene.mrb

• The scene contains 3D models from the SPL brain atlas developed by the department of Radiology at Brigham and Women’s Hospital, Harvard Medical School (NIH P41 RR013218, NIH R01 MH05074)

© Sonia Pujol, Ph.D. All Rights Reserved 38

Page 39: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Slicer Scene

© Sonia Pujol, Ph.D. All Rights Reserved 39

Slicer stores all loaded data in a repository called a scene

Each data set, such as an image volume, surface model, or point set, is represented as a node in a Slicer scene.

All Slicer modules operate on the data stored in a Slicer scene.

Page 40: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a Scene

© Sonia Pujol, Ph.D. All Rights Reserved 40

Drag and drop the file Head_Scene.mrb located in the dataset2_Head directory into Slicer

Page 41: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Loading a Scene

© Sonia Pujol, Ph.D. All Rights Reserved 41

Slicer displays a 3D surface model of the head and 2D MRI slices

Page 42: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Viewing 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 42

Position the cursor over the pin icon to reveal the slice menu and click on the eye icon to display the axial slice in the 3D viewer

Page 43: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Viewing 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 43

Select the Models module in the list of models

Page 44: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Viewing 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 44

Slicer displays the list of 3D models loaded in the scene

Select the model Skin.vtk

Page 45: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Viewing 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 45

Lower the opacity of the Skin model using the visibility slider

The skull bone and eyeballs models appear through the skin

Page 46: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Viewing 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 46

Select the skull bone model and click on the eye icon to turn off its visibility

The white matter and optic nerve models appear through the skin

Page 47: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Interacting with 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 47

Click on the eye icon to display the coronal slice in the 3D viewer

Page 48: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Interacting with 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 48

Select the hemispheric white matter model and select the option Clipping

Page 49: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Interacting with 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 49

Move the coronal slice posteriorily to display the optic chiasm

Page 50: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Interacting with 3D models

© Sonia Pujol, Ph.D. All Rights Reserved 50

Slicer displays a 3D view of the optic chiasm

Page 51: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Conclusion

• 3D Slicer provides advanced functionalities for loading and viewing 3D medical imaging data

• The tutorial demonstrates how to use volume rendering and 3D surface modeling for interactive visualization of CT and MRI data

Contact: [email protected]

© Sonia Pujol, Ph.D. All Rights Reserved 51

Page 52: Basics of Data Loading and 3D Visualization in 3D Slicer...Visualization in 3D Slicer Sonia Pujol, Ph.D. Director of 3D Slicer Training & Education Assistant Professor of Radiology

Acknowledgments

© Sonia Pujol, Ph.D. All Rights Reserved 52

Neuroimage Analysis Center (NIBIB P41 EB015902)


Recommended