+ All Categories
Home > Documents > Direct Contrast Synthesis for Magnetic Resonance Fingerprintingstellayu/publication/doc/2018... ·...

Direct Contrast Synthesis for Magnetic Resonance Fingerprintingstellayu/publication/doc/2018... ·...

Date post: 16-Sep-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
1
Direct Contrast Synthesis for Magnetic Resonance Fingerprinting Patrick Virtue 1,2 , Jonathan I. Tamir 1 , Mariya Doneva 3 , Stella X. Yu 1,2 , and Michael Lustig 1 1 Electrical Engineering and Computer Sciences, University of California, Berkeley; 2 International Computer Science Institute, Berkeley; 3 Philips Research Europe, Hamburg Target Audience. Researchers and developers working to improve acquisition and reconstruction for fast and quantitative MRI. Introduction. Magnetic resonance fingerprinting (MRF) can generate quantitative maps of tissue and system parameters (PD,T1,T2,B0,B1) from a single acquisition [1]. MRF also has the potential to replace standard radiological sequences by using the parameter maps to indirectly synthesize contrast images, such as T1- and T2- weighted images, Fig. 1, dotted-blue lines. The concept of MRI synthesis dates back to 1985 [2] and techniques such as QRAPMASTER [3] have recently been shown to produce clinically viable images [4]. MR fingerprinting data contains rich parametric information and can be used for contrast synthesis. However, MRI synthesis techniques from parameters are significantly limited by biases, due to effects that are difficult to simulate, such as time varying signals, partial voluming, flow, diffusion, magnetization transfer, and others. We propose training neural networks to directly synthesize contrast-weighted images from MRF data, bypassing insufficient parameter modeling, Fig. 1, solid-red line. Methods. Fingerprinting acquisition and training data. We scanned 13 volunteers with a 1.5T Philips Ingenia scanner using 13 receive channels. We acquired four consecutive axial head sequences: T1-weighted spin echo, TE=15 ms, TR=450 ms; T2-weighted turbo spin echo, TE=110, TR=2212; fingerprinting balanced fast field echo (bFFE) sequence with 500 repetitions, constant TE=3.3 and TR=20, and smoothly varying flip angles between 0-60 degrees. The spiral MRF acquisition was reconstructed to image space after gridding and coil combination with Philips CLEAR. We used the data from 11 volunteers for training and validation and used the data from two volunteers only for the final test results. Indirect Contrast Synthesis. We simulated MRF signals with the extended phase graph (EPG) algorithm [5][6], and used cosine similarity to match nearest neighbor as in [1]. The nearest neighbor maps were converted to T1-weighted and T2-weighted contrast images by simulating spin echo sequences: !" 1− % & '()'* '+ % & '* ', , where !" is the proton density. Direct Contrast Synthesis. The neural network for direct contrast synthesis was trained on three million 3x3 patches from the in vivo MRF data using an architecture similar to the two-channel real/imaginary network from [7], Fig. 2. Results. Direct contrast synthesis consistently produced higher quality results than the indirect contrast method, where T1-weighted and T2-weighted both contain significant artifacts, especially in the vasculature and cerebrospinal fluid (CSF), Fig. 3. Discussion & Conclusion. We show that our deep learning model for direct contrast synthesis can bypass incomplete simulation models and their associated artifacts. We look forward to expanding our experiments to include additional training data as well as additional contrast images, such as FLAIR. Figure 1. Contrast synthesis from MRF: indirect (blue-dotted lines) versus direct (solid-red line). Figure 2. Neural network architecture for direct contrast synthesis. 3x3 spatial patches are flattened and passed through three convolutional layers and then three fully connected layers, resulting in a contrast value prediction for the center of the input patch. Between each layer is a ReLU non-linear filter. The number of feature channels are shown above each block, while the size of the temporal dimensions are shown below. An L2 loss function is used to penalize predicted values that do not match the acquired contrast value. Figure 3. Results from indirect contrast synthesis (a,d) and direct contrast synthesis (b,e). Note that both indirect synthesis methods present inconsistent vessel contrast (white arrows), most noticeably in the superior sagittal sinus. References. 1. D. Ma, V. Gulani, N. Seiberlich, K. Liu, J. L. Sunshine, J. L. Duerk, M. A. Griswold, “Magnetic Resonance Fingerprinting,” Nature, vol. 495, no. 7440, pp. 187–192, 2013. 2. S. A. Bobman, S. J. Riederer, J. N. Lee, S. A. Suddarth, H. Z. Wang, B. P. Drayer, J. R. MacFall, “Cerebral Magnetic Resonance Image Synthesis,” AJN, vol. 6, no. 2, pp. 265–269, 1985. 3. J. B. M. Warntjes, O. D. Leinhard, J. West, P. Lundberg, “Rapid Magnetic Resonance Quantification on the Brain: Optimization for Clinical Usage,” MRM, vol. 60, no. 2, pp. 320–329, 2008. 4. L. N. Tanenbaum, A. J. Tsiouris, A. N. Johnson, T. P. Naidich, M. C. DeLano, E. R. Melhem, P. Quarterman, S. X. Parameswaran, A. Shankaranarayanan, M. Goyen, A. S. Field, “Synthetic MRI for Clinical Neuroimaging: Results of the Magnetic Resonance Image Compilation (MAGiC) Prospective, Multicenter, Multireader Trial,” AJN, 2017. 5. J. Hennig, “Multiecho Imaging Sequences with Low Refocusing Flip Angles,” JMR (1969), vol. 78, no. 3, pp. 397–407, 1988. 6. M. Weigel, “Extended Phase Graphs: Dephasing, RF Pulses, and Echoes - Pure and Simple,” JMRI, vol. 41, no. 2, pp. 266–295, 2015. 7. P. Virtue, S. X. Yu, M. Lustig, “Better than Real: Complex-valued Neural Networks for MRI Fingerprinting,” ICIP, 2017 FLAIR MRF Signal T1w T2w Parameter Maps Sequence Simulator Neural Network Direct Contrast Synthesis EPG Simulator & Nearest Neighbor 8 16 32 512 256 1 Temporal Convolutions Patch data 3x3x2=18 250 125 62 1 1 1 Fully Connected 500 T2w T1w Indirect Synthesis Direct Synthesis True Acquisition a b c d e f g h i
Transcript
Page 1: Direct Contrast Synthesis for Magnetic Resonance Fingerprintingstellayu/publication/doc/2018... · 2018. 3. 22. · Magnetic resonance fingerprinting (MRF) can generate quantitative

DirectContrastSynthesisforMagneticResonanceFingerprintingPatrickVirtue1,2,JonathanI.Tamir1,MariyaDoneva3,StellaX.Yu1,2,andMichaelLustig1

1ElectricalEngineeringandComputerSciences,UniversityofCalifornia,Berkeley;2InternationalComputerScienceInstitute,Berkeley;3PhilipsResearchEurope,Hamburg

Target Audience. Researchers and developers working to improve acquisitionandreconstructionforfastandquantitativeMRI.Introduction.Magneticresonancefingerprinting(MRF)cangeneratequantitativemapsoftissueandsystemparameters(PD,T1,T2,B0,B1)fromasingleacquisition[1].MRFalsohasthepotentialtoreplacestandardradiologicalsequencesbyusingtheparametermapstoindirectlysynthesizecontrastimages,suchasT1-andT2-weightedimages,Fig.1,dotted-bluelines.TheconceptofMRIsynthesisdatesbackto1985[2]andtechniquessuchasQRAPMASTER[3]haverecentlybeenshowntoproduce clinically viable images [4]. MR fingerprinting data contains richparametric information and can be used for contrast synthesis. However, MRIsynthesis techniques fromparameters are significantly limited by biases, due toeffectsthataredifficulttosimulate,suchastimevaryingsignals,partialvoluming,flow, diffusion, magnetization transfer, and others. We propose training neuralnetworks to directly synthesize contrast-weighted images from MRF data,bypassinginsufficientparametermodeling,Fig.1,solid-redline.Methods.Fingerprintingacquisitionandtrainingdata.Wescanned13volunteerswitha1.5TPhilips Ingenia scannerusing13receivechannels.Weacquired fourconsecutiveaxialheadsequences:T1-weightedspinecho,TE=15ms,TR=450ms;T2-weightedturbospinecho,TE=110,TR=2212;fingerprintingbalancedfastfieldecho (bFFE) sequence with 500 repetitions, constant TE=3.3 and TR=20, andsmoothly varying flip angles between 0-60 degrees. The spiral MRF acquisitionwasreconstructedtoimagespaceaftergriddingandcoilcombinationwithPhilipsCLEAR.Weusedthedatafrom11volunteersfortrainingandvalidationandusedthedatafromtwovolunteersonlyforthefinaltestresults.Indirect Contrast Synthesis. We simulated MRF signals with the extended phasegraph (EPG) algorithm [5][6], and used cosine similarity to match nearestneighborasin[1].ThenearestneighbormapswereconvertedtoT1-weightedandT2-weighted contrast images by simulating spin echo sequences: !" 1 −

%&'()'*'+ %&

'*', ,where!"istheprotondensity.

Direct Contrast Synthesis. The neural network for direct contrast synthesis wastrained on three million 3x3 patches from the in vivo MRF data using anarchitecturesimilartothetwo-channelreal/imaginarynetworkfrom[7],Fig.2.Results. Direct contrast synthesis consistently produced higher quality resultsthan the indirect contrast method, where T1-weighted and T2-weighted bothcontain significant artifacts, especially in thevasculature and cerebrospinal fluid(CSF),Fig.3.Discussion & Conclusion.We show that our deep learning model for directcontrastsynthesiscanbypassincompletesimulationmodelsandtheirassociatedartifacts. We look forward to expanding our experiments to include additionaltrainingdataaswellasadditionalcontrastimages,suchasFLAIR.

Figure 1. Contrast synthesis from MRF: indirect(blue-dottedlines)versusdirect(solid-redline).

Figure 2. Neural network architecture for directcontrastsynthesis.3x3spatialpatchesareflattenedand passed through three convolutional layers andthen three fully connected layers, resulting in acontrastvaluepredictionforthecenteroftheinputpatch.BetweeneachlayerisaReLUnon-linearfilter.The number of feature channels are shown aboveeach block, while the size of the temporaldimensionsareshownbelow.AnL2lossfunctionisusedtopenalizepredictedvaluesthatdonotmatchtheacquiredcontrastvalue.

Figure 3. Results from indirect contrast synthesis(a,d) and direct contrast synthesis (b,e). Note thatboth indirect synthesis methods presentinconsistent vessel contrast (white arrows), mostnoticeably in the superior sagittal sinus.

References.1.D.Ma,V.Gulani,N.Seiberlich,K.Liu,J.L.Sunshine,J.L.Duerk,M.A.Griswold,“MagneticResonanceFingerprinting,”Nature,vol.495,no.7440,pp.187–192,2013.2.S.A.Bobman,S.J.Riederer,J.N.Lee,S.A.Suddarth,H.Z.Wang,B.P.Drayer,J.R.MacFall,“CerebralMagneticResonanceImageSynthesis,”AJN,vol.6,no.2,pp.265–269,1985.3.J.B.M.Warntjes,O.D.Leinhard,J.West,P.Lundberg,“RapidMagneticResonanceQuantificationontheBrain:OptimizationforClinicalUsage,”MRM,vol.60,no.2,pp.320–329,2008.4.L.N.Tanenbaum,A.J.Tsiouris,A.N.Johnson,T.P.Naidich,M.C.DeLano,E.R.Melhem,P.Quarterman,S.X.Parameswaran,A.Shankaranarayanan,M.Goyen,A.S.Field,“SyntheticMRIforClinicalNeuroimaging:ResultsoftheMagneticResonanceImageCompilation(MAGiC)Prospective,Multicenter,MultireaderTrial,”AJN,2017.5.J.Hennig,“MultiechoImagingSequenceswithLowRefocusingFlipAngles,”JMR(1969),vol.78,no.3,pp.397–407,1988.6.M.Weigel,“ExtendedPhaseGraphs:Dephasing,RFPulses,andEchoes-PureandSimple,”JMRI,vol.41,no.2,pp.266–295,2015.7.P.Virtue,S.X.Yu,M.Lustig,“BetterthanReal:Complex-valuedNeuralNetworksforMRIFingerprinting,”ICIP,2017

FLAIR

MRFSignal

T1w T2w

ParameterMaps

SequenceSimulator

NeuralNetworkDirectContrast

Synthesis

EPGSimulator&NearestNeighbor

ISMRMAbstractFigure4: Networkarchitecture

816 32 512 256 1

TemporalConvolutions

Patchdata3x3x2=18

250125 62 1 1 1

FullyConnected

500

T2w

T1w

IndirectSynthesis DirectSynthesis TrueAcquisition

FLAIR

a b c

d e f

g h i

Recommended