TECH TOC Conference
9 – 10 April 2019
Artificial Intelligence, Automation & DigitalizationGerhard Fischer, Siemens AG, Germany
siemens.com/cranesUnrestricted © Siemens AG 2019
Unrestricted © Siemens AG 2019
09.04.2019Page 2 TOC Asia Singapore 2019Information Classification: General
Agenda
Unrestricted © Siemens AG 2019
09.04.2019Page 3 TOC Asia Singapore 2019Information Classification: General
Automated Terminal
Requirements to Suppliers
• Increased and defined
safety level
• Increased productivity
Safety
Zero Harm
• Verify performance
• Virtual testing
• Training M&R
Simulation
Risk mitigation
Faster go live
• Predictive maintenance
• Reduction of down times
• Operation optimization
Digital Service
Higher Availability
Integration &
Standardization
Risk & OPEX
reduction
• Hardware minimization e.g.
sensors
• Interface clarity
• Faster go live
Artificial
Intelligence
Performance
• New automation
applications
• Higher performance
• Faster development cycles
1
Unrestricted © Siemens AG 2019
09.04.2019Page 4 TOC Asia Singapore 2019Information Classification: General
Automated Terminals
Artificial Intelligence
• Increased and defined
safety level
• Increased productivity
Safety
Zero Harm
• Early verification of
performance
• Virtual testing
• Training M&R
Simulation
Risk mitigation
Faster go live
• Predictive Maintenance
• Reduction of down times
• Operation optimization
Digital Service
Higher Availability
Integration &
Standardization
Risk & OPEX
reduction
• Hardware minimization e.g.
sensors
• Interface clarity
• Faster go live
Artificial
Intelligence
Performance
• New automation
applications
• Higher performance
• Faster development cycles
1
Unrestricted © Siemens AG 2019
09.04.2019Page 5 TOC Asia Singapore 2019Information Classification: General
Automated Terminals
Simocrane Modules
2
Unrestricted © Siemens AG 2019
09.04.2019Page 6 TOC Asia Singapore 2019Information Classification: General
Example
Complexity Targets for Truck Positioning System
Empty 42'
45'
20' Front
20' rear
2 x20' (tight)
40'
2 x20' (extend)
20' Pos 1(Front)
20' Front 20' Rear
20' Pos 3(Rear) 40' Pos 5(Middle)
40'
45'
45' Pos 5(Middle)
Empty 45'
20' Middle
Offloading order tier 1CAS Job order
Possible trailer
configuration
underneath the
ARMG
38
37
36
35
34
33
32
Ca
se
Nr.
39
31 Configuration not valid Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not validConfiguration valid
Configuration valid
Configuration validConfiguration valid
Configuration valid
Configuration not valid Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not validConfiguration not valid
Configuration not valid Configuration not valid
Configuration not valid
Configuration not valid
Configuration not valid
Configuration not valid
Configuration not valid
Configuration not valid
Configuration valid
Configuration valid
Configuration not valid
Configuration not valid
Configuration not valid
40'
20' Pos 2 (Front)
20' Front 20' Rear
20' Pos 4(Rear) 40' Pos 6(Middle)
45'
45' Pos 6(Middle)
Offloading order DST 40'/45' Trailer Tier 2CAS Job order
40'/45' Empty
40'
2 x20' + 1 x 20' front
2 x 20' + 1 x 20' rear
2 x40'
4 x20'
1 x20' middle
2 x20'
45'
2x45'
Possible trailer
configuration
underneath the
ARMG
48
47
46
45
44
43
42
40
49
41
Ca
se N
r.
Configuration valid
Configuration not valid Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not valid Configuration not valid
Configuration valid
Configuration valid
Configuration valid
Configuration validConfiguration valid
Configuration not valid Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not valid
Configuration not valid Configuration not valid
Configuration not valid Configuration not valid Configuration not valid Configuration not valid
2
Unrestricted © Siemens AG 2019
09.04.2019Page 7 TOC Asia Singapore 2019Information Classification: General
Truck Positioning System
Siemens 3D Sensor
3D Sensor unit
Siemens servo motor
Laser
connector
2D Laser
scanner2nd Encoder
Absolute
EncoderSwivel platform
Fine adjustment
2
Unrestricted © Siemens AG 2019
09.04.2019Page 8 TOC Asia Singapore 2019Information Classification: General
E.g. Road truck auto landing
via detection of twistlocks/pins
- Laser scanner dot cloud
- Data collection
- Object classification
- Parameter derivation
See also Charles R. Qi et. al.
„PointNet: Deep learning on point
sets for 3D classification and
segmentation“
Truck Positioning System
Pattern Recognition
2
Unrestricted © Siemens AG 2019
09.04.2019Page 9 TOC Asia Singapore 2019Information Classification: General
Truck Positioning System
Detection rates Conventional vs Machine Learning
0
0.2
0.4
0.6
0.8
1.0
Solution maturity
D0 initial detection rate
DS = 0.7..0.8
DS saturated detection rate
D0
Conventional algorithm
(programmed use cases)
Machine learning
(AI)
DS = ca. 1
Road truck (RT)
detection rate
2
Unrestricted © Siemens AG 2019
09.04.2019Page 10 TOC Asia Singapore 2019Information Classification: General
Automated Terminals Requirements
Faster Go Live through Simulation
• Increased and defined
safety level
• Increased productivity
Safety
Zero Harm
• Early verification of
performance
• Virtual testing
• Training M&R
Simulation
Risk mitigation
Faster go live
• Predictive Maintenance
• Reduction of down times
• Operation optimization
Digital Service
Higher Availability
Integration &
Standardization
Risk & OPEX
reduction
• Hardware minimization e.g.
sensors
• Interface clarity
• Faster go live
Artificial
Intelligence
Performance
• New automation
applications
• Higher performance
• Faster development cycles
3
Unrestricted © Siemens AG 2019
09.04.2019Page 11 TOC Asia Singapore 2019Information Classification: General
Virtual Model Virtual Commissioning
Mechanical & Sensor Simulation
Always available
Faster prototyping
Lower investment
Faster adaption to changes
Pre Commissioning Tool
Virtual Test Environment
Verification of
Design
Functionality
KPIs
Training platform
Simulation Horizontal Transport
▪ Identify bottlenecks
▪ Avoid over engineering
▪ Match contractual KPIs
Block Management System
▪ Peak smoothening
▪ Faster load & unload
▪ Energy saving
Virtual Logistics
Simulation & Emulation3
Unrestricted © Siemens AG 2019
09.04.2019Page 12 TOC Asia Singapore 2019Information Classification: General
Step-wise Deployment Simulation/Emulation
3
TOS
Block Management SystemBMS
ASC/ARMG/ARMG Advanced Automation AA
Load Collision Prevention LCPS
Final Landing System FLS
Crane Management System CMS
Remote OperationCameras RCOS
Optical CharacterRecognition OCR
Basic Crane Control CC- Drive system- Positioning H/T/G- Micromotion- Crane anti-collision- Anemometer- Load measurement
SIMIT
UNITY
Visualization of
crane motion in
UNITY
Remote Operation System RCOS
Overall System
configuration
Unrestricted © Siemens AG 2019
09.04.2019Page 13 TOC Asia Singapore 2019Information Classification: General
Step-wise Deployment Simulation/Emulation
3
TOS
Block Management SystemBMS
ASC/ARMG/ARMG Advanced Automation AA
Load Collision Prevention LCPS
Final Landing System FLS
Crane Management System CMS
Remote OperationCameras RCOS
Optical CharacterRecognition OCR
Basic Crane Control CC- Drive system- Positioning H/T/G- Micromotion- Crane anti-collision- Anemometer- Load measurement
SIMIT
UNITY
Visualization of
crane motion in
UNITY
Remote Operation System RCOS
Test interface
TOS to BMS
1
Unrestricted © Siemens AG 2019
09.04.2019Page 14 TOC Asia Singapore 2019Information Classification: General
UNITY
Step-wise Deployment Simulation/Emulation
3
TOS
Block Management SystemBMS
ASC/ARMG/ARMG Advanced Automation AA
Load Collision Prevention LCPS
Final Landing System FLS
Crane Management System CMS
Remote OperationCameras RCOS
Optical CharacterRecognition OCR
Basic Crane Control CC- Drive system- Positioning H/T/G- Micromotion- Crane anti-collision- Anemometer- Load measurement
SIMIT
Visualization of
crane motion in
UNITY
Remote Operation System RCOS
3D modelling in
Unity environment
Of crane using
crane builder‘s
CAD step file
2
Unrestricted © Siemens AG 2019
09.04.2019Page 15 TOC Asia Singapore 2019Information Classification: General
SIMIT
Step-wise Deployment Simulation/Emulation
3
TOS
Block Management SystemBMS
ASC/ARMG/ARMG Advanced Automation AA
Load Collision Prevention LCPS
Final Landing System FLS
Crane Management System CMS
Remote OperationCameras RCOS
Optical CharacterRecognition OCR
Basic Crane Control CC- Drive system- Positioning H/T/G- Micromotion- Crane anti-collision- Anemometer- Load measurement
UNITY
Visualization of
crane motion in
UNITY
Remote Operation System RCOS
Simatic SIMIT
environment
of crane
automation system
3
Unrestricted © Siemens AG 2019
09.04.2019Page 16 TOC Asia Singapore 2019Information Classification: General
Step-wise Deployment Simulation/Emulation
3
TOS
Block Management SystemBMS
ASC/ARMG/ARMG Advanced Automation AA
Load Collision Prevention LCPS
Final Landing System FLS
Crane Management System CMS
Remote OperationCameras RCOS
Optical CharacterRecognition OCR
Basic Crane Control CC- Drive system- Positioning H/T/G- Micromotion- Crane anti-collision- Anemometer- Load measurement
SIMIT
UNITY
Visualization of
crane motion in
UNITY
Remote Operation System RCOS
Interaction BMS
with crane
automation system
4
Unrestricted © Siemens AG 2019
09.04.2019Page 17 TOC Asia Singapore 2019Information Classification: General
Step-wise Deployment Simulation/Emulation
3
TOS
Block Management SystemBMS
ASC/ARMG/ARMG Advanced Automation AA
Load Collision Prevention LCPS
Final Landing System FLS
Crane Management System CMS
Remote OperationCameras RCOS
Optical CharacterRecognition OCR
Basic Crane Control CC- Drive system- Positioning H/T/G- Micromotion- Crane anti-collision- Anemometer- Load measurement
SIMIT
UNITY
Visualization of
crane motion in
UNITY
Remote Operation System RCOS
Interaction BMS
with crane
automation system
and remote
operating station
5
Unrestricted © Siemens AG 2019
09.04.2019Page 18 TOC Asia Singapore 2019Information Classification: General
Step-wise Deployment Simulation/Emulation
3
TOS
Block Management SystemBMS
ASC/ARMG/ARMG Advanced Automation AA
Load Collision Prevention LCPS
Final Landing System FLS
Crane Management System CMS
Remote OperationCameras RCOS
Optical CharacterRecognition OCR
Basic Crane Control CC- Drive system- Positioning H/T/G- Micromotion- Crane anti-collision- Anemometer- Load measurement
SIMIT
UNITY
Visualization of
crane motion in
UNITY
Remote Operation System RCOS
Interaction TOS ,
BMS, crane
automation system
and remote
operating station
6
Unrestricted © Siemens AG 2019
09.04.2019Page 19 TOC Asia Singapore 2019Information Classification: General
Transparency from the start
Early detection of problems
Early optimization of system
Easier design verification
Shorter project “go live”
Virtual Reality
InstallationConstruction Pre-COM COM SAT Design
Virtual SAT
Virtual Installation
Virtual Pre-Commissioning
Virtual Commissioning
Design Construction Installation Pre-COM COM SAT Operation
Operation
Shortened „Go Live“3
Unrestricted © Siemens AG 2019
09.04.2019Page 20 TOC Asia Singapore 2019Information Classification: General
Automated Terminals Requirements
Digitalization
• Increased and defined
safety level
• Increased productivity
Safety
Zero Harm
• Early verification of
performance
• Virtual testing
• Training M&R
Simulation
Risk mitigation
Faster go live
• Predictive Maintenance
• Reduction of down times
• Operation optimization
Digital Service
Higher Availability
Integration &
Standardization
Risk & OPEX
reduction
• Hardware minimization e.g.
sensors
• Interface clarity
• Faster go live
Artificial
Intelligence
Performance
• New automation
applications
• Higher performance
• Faster development cycles
4
Unrestricted © Siemens AG 2019
09.04.2019Page 21 TOC Asia Singapore 2019Information Classification: General
Simocrane CMS
Information Management
Alarm Logging Performance DataReplay
Functionality
Condition
Monitoring
Alarm message
system
Relevant
performance data
generation for further
KPI calculation;
Record all
performed
operations
Fast recording
- analog signals
- binary signals
Diagnosis
- fault diagnosis
- root cause analysis
Operational
excellence key
figures
Replay
- all data
- chronological order
Detect time-critical
switching states
4
Unrestricted © Siemens AG 2019
09.04.2019Page 22 TOC Asia Singapore 2019Information Classification: General
Crane Condition Monitoring
Digital Crane „Finger Print“‘
CMS
RCMS
- Monitoring of crane components in time / frequency domain
- Large amount of data over time (1 hour = 1 mil. measuring points)
- Digital “’fingerprint”’ of the crane
4
Unrestricted © Siemens AG 2019
09.04.2019Page 23 TOC Asia Singapore 2019Information Classification: General
SIMOCRANE CMS
Predictive Maintenance
Distribution of information
RCMS Clients
Data processing
Container
Terminal
WebClients
KPI
Ms. Excel
Reports
SIMOCRANE RCMS
Cloud for Industry
MindSphereCMS
CMS
CMS
CMS
CMS
KPI monitoring
Data Storage
Process Historian
RCMS V4.4
Microsoft
SQLMicrosoft
SQL
Structured Data
4
Predictive maintenance
KPI dashboard
Edge processing
(TM NPU)
Unrestricted © Siemens AG 2019
09.04.2019Page 24 TOC Asia Singapore 2019Information Classification: General
Data/image preprocessing by TM NPU module
and transfered to the neural network
3
Static, trained
neural network
Crane camera images1
2
Results of the inference are sent
from TM NPU to the PLC
Function blocks in
the PLC evaluate
the results4
Simatic AI Application
Basic Processing Module TM NPU
PLC sends sensor data to module1
Designed & trained in open
source machine learning
frameworks:
Tensorflow
Caffe
Other possible inputs:
Audio,
Vibrations,
Signals, …
4
Unrestricted © Siemens AG 2019
09.04.2019Page 25 TOC Asia Singapore 2019Information Classification: General
Thank you for your attention!
Gerhard Fischer
Head of Sales Harbour Cranes
Phone: +49 9131 98 4849
Mobile: +49 173 381 3850
E-Mail: [email protected]
siemens.com/answers