+ All Categories
Home > Documents > SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI...

SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI...

Date post: 20-May-2020
Category:
Upload: others
View: 9 times
Download: 0 times
Share this document with a friend
22
SURGICAL: AI AI Democratise Computer Aided Surgery
Transcript
Page 1: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

SURGICAL:AIAI Democratise Computer Aided Surgery

Page 2: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

WHY NOT GOOGLE MAPAMAZONUBERFACEBOOKALPHAGOFOR SURGERY

Page 3: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

SURGERY CRISIS

Healthcare Cost $30 Trillions

(US 23% GDP)

Surgery Cost 40%

($12 Trillion)

5 Billion have no Access to Surgery

OA Affects 1 in 5 (US),

1 in 6 (China)

OA cost 1%-2.5% GDP,

Second cause of disability

Surgery serves Only 5% patients (US), 0.5% (China)

Page 4: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

SURGICAL AUTONOMY

AI and Robotics 50% , worth $6 Trillion

Narrow AI

Highly Controlled Environment

Human Support

Cost Insensitive

Ethical , Risk and Regulation

Page 5: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

DO SURGEON REALLY NEEDS AUTONOMY

ProBot Full Autonomous, 1997

Da Vinci, No Autonomy, 2000

ACRobot/Mako/Stryker Cooperative, 2012

BrainLab, Navigation

Sedasys

Robotic Drill

Page 6: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

THE BARRIERS (T,C,S,A)

Time (prepare)

Time(OR)

Capability

Safety Affordability

Manual 10 minutes 2 hour 100experts

50% success

+0

Robot +1 Day 4 hour 1,000 experts

90% success

+$500,00-$2,00,000

Navigation +1 Day 3 hour 300 experts

75%success

+$100,000-300,00

PSI +1 Month 1 hour 1,000experts

90%success

+$1,000

SurgicalAI 10 minutes 1 hour 1000 experts

95% success

+$500SURGICAL:AI

Page 7: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

AUTONOMOUS PSI DESIGN BY AI

Design in Less in 10 seconds, Deliver in 4 hours

Web base Mixture Reality Interface

Deep Morphology Engine Planning And Design Engine

TensorLab: Big Data WarehouseAnd Autonomous Machine Learning System

Page 8: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

SHOULDER PSI EXAMPLE (CAOS 2016) (FULLY AUTONOMOUS)

Page 9: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

Deep Morphology Engine

1 Data Scarcity: 30 Volumes vs 2 Millions

2 Memory Consumption3D volume vs 1 D signal

3 No Explanation and No Confidence4 Flexible Workflow…..5 Not Cooperative

Traditional Deep Learning for Medical Images processingWishing A baby will becoming a greatdoctor by showing him lots of scans without going to school

= + +

Neural Poincare Engine

Deep Poincare Map (https://arxiv.org/pdf/1703.09200.pdf)

It works like Surgeon, It has memory, knows where to attend its focus

Speed: 0.2 Seconds for Segmentation one bone from a volumeData Efficiently: trained 5 volume we achieve accuracy close to humanMemory Efficient: Needs about 500MB memory, It can run on your mobile phoneFlexible:Parts scan or arbitrary posture.Error Estimation:We know when it fails.

Page 10: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR
Page 11: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

SURGICAL DB

Medical Image and Processed ImagesPSI ModelsImplantsThe Surgery Plan

NoSQL and Map Reduce Search Engine Solution

Find me all the pre and after surgery CT scans of all the patients using Company A implants on the third Spine Joint

The only Question Surgeons Care but No existing PACS or EHR system can Answer

Page 12: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

TensorLab for Autonomous Continuous Learning

Heart Failure

AccIoU

Time

Recruitment by Search Engine

The Principal: 1) Everything is Data. 2) Everything is Identified by Query. 3) Pulling based Stream Processing

Images and Sematic Labels

Model Versions and Performance Metrics

Left Volume

Model Architecture

Search Engine is usedas the Router for Data

Job1 Job 2 Job3 Job4 Job5 Job6

Builder Analyser Validator Builder Analyser Builder Analyser Validator

Job Queue

Job Query as Load Balancer

Build Job

Data:Heart with Tumour

Arch:Best Segmenation Model

Input Version:Most Accurate Version

Output Version:Heart Tumour Detection

Page 13: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

CLINICAL RESULTS:

Save 40 minutes in OR,1000GBP for 1 procedure

Page 14: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

PATIENT SPECIFIC OSTEOTOMY

Guide was designed, printed and sterilized

Guide was fixed to the unique position on the bone

Bone was resected following the guidance of the guide

15° wedge was resected and removed

Wedge was closed and bone was fixed

Page 15: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

OTHER PROCEDURES

Page 16: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

APPLICATIONS

1) Surgery Planning

2) Patient Specific Guide Device

4) Implants Registration and Management

3) Surgical Workflow Management

Page 17: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

A TEAM OF WORLD LEADING EXPERTS

Professor Anan Shetty

(Chief Medical Scientist)Dr Fangde Liu (CEO &CRO)

The best Surgeon in the UKShetty-Kim Technique InventorThe Surgeon of 2017 by Royal College of SurgeonProudest Award for UK, the Hunterian ProfessorAdvisor of NICE ( National Institute of Clinical Excellence)

Chief Architecture of Several Flagship Surgical Robots,Pharmacovigilance for multinationAutonomous CMR Analysis System and DiagnosisSenior Associate ofRoyal Society of Medicine

Dr Hao Dong (Engineering VP)

PhD at Imperial College, Data Science InstituteDeep Learning Engineering ExpertThe Creator of TensorLayerMost Popular DL Framework in China

Yinna Bu (Client and BD Manager in China)MSc from UCLCEO of two start-ups

Page 18: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

Prof Yike Guo (Advisor)

Prof Ferdinando Rodriguez y Baena (Advisor)

Dr Joshua Giles (Advisor)

Dr Jianmo Li (Advisor)

Full Professor of Medical Robots at IC, World First Orthopaedics Surgical RobotsSold For Stryker 1.67 Billion DollarsTeam Leader of Biggest Surgical Robots ProjectIn European UnionChair of World Computer Aided Orthopaedics

Full Professor of Data Science at Imperial CollegeChairman of TranSmart FoundationWorld Standard Platform for Translation and Clinical MedicineAdopted by all the major Pham Company in the worldIncluding J&J, Merkek, Roche, Sanophie.

PostDoc at Imperial CollegeInventor of Should PSI

PhD Prof Andrew AmisPostdoc at Imperial CollegeInventor of Knee PSI

Mr Saif AhmedConsultant SurgeonProfessor of AnatomyExpert on 3D Printing and Surgical RobotsExecutive Comminute of Computer Aided Orthopaedics' UK

Page 19: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

Kent Institute of Medicine & Surgery

• KIMS is the largest Independenthospital in SouthEast England andKent.

• No.1 patient satisfaction (92%)against other 92 independent hospitalin the UK

• The hospital is equipped with state-of-the-art technology and innovativediagnostic services

• Wide range of treatment – coveringall the orthopedic area and jointreplacement

Page 20: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

AI Democratise Computer Aided Surgery

Autonomous Surgery is FeasibleThe barrier is Human Machine CooperationFor Surgery, Not Just AI, Vehicle MattersProvides the tool, not solutionGPU plays crucial by breaking the time barrier

Page 21: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

CAOS 2016, Japan Osaka IDEALondon, 2016

Daily Mail, 2016

Re.Work Deep Learning in Healthcare Summit, 2017

GTC 2017

Page 22: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR

Surgical AI:Bring Big Data and AI into Operating Theatre

Thank You


Recommended