doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)Slide 1
Project: IEEE P802.15 Working Group for Wireless Personal Area Networks (WPANs)
Submission Title: [SG15.6a Application Matrix and Use cases for dependable social services based on BAN/5G/AI platform]Date Submitted: [15th September 2021]Source: [Ryuji Kohno] [1;Yokohama National University(YNU), 2;YRP International Alliance Institute(YRP-IAI)] Address [1; 79-5 Tokiwadai, Hodogaya-ku, Yokohama, 240-8501 Japan
2; YRP1 Blg., 3-4 HikarinoOka, Yokosuka-City, Kanagawa, 239-0847 Japan]Voice:[1; +81-90-5408-0611], FAX: [+81-45-383-5528], Email:[1: [email protected], 2: [email protected]] Re: []Re: []
Abstract: [This document contains application matrix and focused use case for dependable social services based on BAN-base cloud network and AI data server for SG15,6a]
Purpose: [information]Notice: This document has been prepared to assist the IEEE P802.15. It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein.Release: The contributor acknowledges and accepts that this contribution becomes the property of IEEE and may be made publicly available by P802.15.
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)Slide 2
IEEE 802.15 SG15.6a Application Matrix and Use cases for dependable social services based on
BAN/5G/AI platform
Virtual Interim MeetingSeptember 15th, 2021
Ryuji KohnoYokohama National University(YNU),
YRP International Alliance Institute(YRP-IAI)
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Proposed applications1. Remote healthcare monitoring2. Remote sensing and controlling3. Vehicle internal sensing and controlling4. Collision avoidance radar5. Inter-vehicle communications and ranging6. Wearable and implant wireless medical sensing and controlling7. Applications for ultra wideband radio8. Reliable and robust radio control9. Wearable healthcare sensing10. Secure remote healthcare and medicine11. Wireless sensing system for Factory with feedback control12. Dependable multi-hop inter-vehicle communications13. Inter-navigation and inter-vehicle information sharing in normal
and emergency conditions14. Single wireless communication network solution that functions
both in normal and in disaster environments15. Disaster prevention, emergency rescue and recovery
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Fitness, Massage& Sauna
Sports: Walking, Jogging,Bicycling, Hiking, Skiing etc
Public Safety
Inter-Vehicle M2M
Highly Life Critical Uses(High QoS)
Less Life Critical Uses(Low QoS)
Home & Consumer Uses
Industrial & Governmental Uses
Internal Car Dependable M2M
Inter-Vehicle M2M
Home Medical Therapy
Government Infrastructure
Visualizing Portfolio of Focused Applications
Remote Diagnosis for Factory Automation
Hospital Clinical Service
Remote Wellness& Well-being
Life Line(Water/Gas/Electricity Supply)
4
Remote Sensing & Controlling Mobile Robots
Disaster Analysis & Prevention
Remote Diagnoses of Infra(bridge/bldg./train)
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Three Classes of Focused Potential Applications
Slide 5
QoS 1 Class: Highest Priority Level for Demand of Dependability 1.1 Car Internal M2M1.3 Remote Diagnosis in Factory2.3 Professional Medicine3.2 Public Safety
QoS 2 Class: Meddle Priority Level for Demand of Dependability1,2 Inter-vehicle M2M2.2 Healthcare3.1 Life Line (Water/Gas/Electricity Supply)4.1 Remote Diagnosis of Infra(bridge/bldg./train)
QoS 3 Class: Low Priority Level for Demand of Dependability2.1 Wellness, Wellbeing3.3 Government System4.2 Remote Sensing and Controlling Mobile Robots 4.3 Disaster Analysis and Prevention
We have classified focused potential applications into three classes according to demands of dependability.
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
(Case 6) Would a good wireless solution benefit your application?
If yes, please describe the benefits you would like to realizeWireless sensing and controlling system for Factory
1. Equipment Diagnosis System in Real-time with real-time feedback
1. Real-time measuring 2. Judge immediately with a certain threshold level3. Feedback controlling
2. Equipment Diagnosis System in Real-time (1)1. Real-time measuring and sending data in real-time2. Judge based on the comparison with the past data3. Analysis of big data4. Feedback controlling machines in remote
3. Equipment Diagnosis System in Real-time (2)1. Real-time measuring and sending data intermittently2. Judge based on the comparison with the past data3. Database and data mining with cloud networking
Slide 6
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Possible Use Cases of Dependable M2M and BAN for Sensing and Controlling
Micor Machine Fablication
On Chip Antenna andWireless Network in chio
MMIC(Flip Chip)
Multi-layer BCBSilicon Base
Silicon BseeTele-metering vital dataWearable BAN Implant BAN
Tele-controlling implant devicesEEG.
ECG,Blad PressureTemperatuteMRI imagesEtc. Pacemaker
with IAD
Dependable Network among vitalsensors, actuators, robots Capsule
Endoscope
UWB can solvesuch a problemthat radio interferes
a human body and medical equipments
B車
Collision Avoidance and safe driving by inter-vehicle networks
A車
Collision Avoidance Using inter-vehicle and roadside networks
Road to car networks Inter-vehicle networks
Inter-module wireless Networks
Dependable Wireless Sensing & Controlling for Manufacturing (CIM)
Dependable Wireless System Clock in Micro Circuit & Network in DevicesDependable BAN for Medical Healthcare
Dependable Wireless Networks for TransportationFactory Automation (FA)Car Navigation & Collision Avoidance Radar
Car LAN & Wireless Harness
Slide 7
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Wireless Feedback Sensing and Controlling Loop for Diabetes Patients
With
controllerWirelesschannel
PumpClinician Patient
sensor
InsulinPump
Blood-sugar level(Glucose) HbA1c
KWirelesschannel
Bd 1/S
Ad
u[k]r[k]
u[k]
x[k] x[k]
y[k]
^
^
++
+-
Controller Human Model of Glucose vs Insulin
Automatic Remote Sensing Glucose and Controlling Insulin Pump for Diabetes Patients Using Wireless BAN
Wireless Feedback Controlling based on Cognitive Sensing with Dependable BAN must be necessary for life critical applications.
Feedback Delay Loop Model with Motion Equation
September 2021
Slide 8
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Dependable IoT/M2M for Advanced Driver Assistance Systems(1/2)••••••
4-6 Mono Cameras1-2 Stereo Cameras2-4 Mid-Range Radar2 Long Range Radar8-16 Ultrasonic Sensors, 4 Wheel Speed SensorsRedundant Data Center
– Number Crunchers for Data Fusion– ABS, ESP, …– Some ECUs we can’t tell you details today
• Interaction with Powertrain, Body Domain, Navigation,Airbag, CAR2CAR, CAR2Infrastructure
Does this look familiar to data centers?
Automated Driving is leaving the Research Labs. Soon it will be in mass production.
Surround vision with redundant sensors
For automotive, Inter-vehicle communications(IVC) and Machine-to-Machine(M2M) inside a car like auto braking and autonomous driving must be core applications of Dependable M2M and IoT.
September 2021
Slide 9
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Demands for Internet of Things increase but Machine-to-Machine (M2M) should be reliable and secure, so Dependable BAN for Medicine must be good matched with Dependable M2M and IoT.
Dependable IoT/M2M for Advanced Driver Assistance Systems(2/2)September 2021
Slide 10
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Wireless Feedback Sensing and Controlling Loop for Autonomous Driving
With
controllerWirelesschannel
Axel/BrakeDriver Own Car
Radar
For Autonomous Driving
For Collision Avoidance and Inter-Vehicle Communication
KWirelesschannel
Bd 1/S
Ad
u[k]r[k]
u[k]
x[k] x[k]
y[k]
^
^
++
+-
Controller Car Axel/Brake Model and Radar System
Collision Avoidance Radar and Automatic Braking Using Wireless Dependable M2M/BAN
Feedback Delay Loop Model with Motion Equation
Car Running Ahead
September 2021
Slide 11
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Response to CFI: Case 6Hiroshi Kobayashi, Nissan Automotive Co. Ltd.
Update in Development ofWireless Sensing System
for FactoryDoc.:IEEE802-15-15-0221-01-0dep
IEEE802-15-15-0711-00-0depIEEE802-15-15-0711-01-0depIEEE802-15-16-0077-00-0dep
Slide 12
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Use case 2; Detection of Twist and Cut of Cables
Prediction and Real-timeDetection of twist and cut in signal and power cables
Slide 13
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Use case 3; Real-time Monitoring or/and Controlling Robots
In order to improve QoS of controlling robots in factory lines, real-time sensing and controlling with permissible feedback control loop must be important requirement
Slide 14
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Use case 1; Detection of Cracks in Press Machine
Prediction of cracks and any damages in press machines is keen to keep stable operation of lines in factory automation.
Slide 15
September 2021
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Remote Medicine; Medical ICT & AI with BAN
16
BAN
切替
WINDS
Satellite Networks
Medical ICT Center Etisalat Wireless & Data Clued Services
Yokohama City Univ.Hospital and Remote Clinical Center
BANMobile Station
Medical support for over the world
BANVSAT
BAN
Satellite Link
Big Data
InternetCellular Network Data mining
5G/IoT Network Cloud
September 2021
Slide 16
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Coordinator
Node
Node
Elderly peopleTherapist, Nurses,Care givers
Big Data Server &
Repository
Hospital,Rehabilitation
Center orClinicians
Gateway
Network cloud
Body Area Network(BAN)
Data mining or Analysis with Deep Learning
like Watson
Node
physical assistant and surgery robots
Platform by Wireless BAN, Network Cloud, Big Data Server with Data Mining for Elderly People Care
September 2021
Slide 17
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Universal Platform with Integrated ICT, Robotics and AI by Remote Sensing and Mining of Vital Data for High Quality of Life with Medicine, Wellness, and Sport
Hospital,Day Care CenterGateway
Coordinator
5G/6G, Internet for Cloud
Network, Edge Computing
Efficient and Professional Diagnosis and Therapy
ProfessionalClinician
METI, FCC; Supervise of Medical Big Data Processing and ApplicationPMDA, FDA; Clinical Study and Validation of Medicine and Medical Devices
Rehabilitation RobotsWheelchair
AI Data mining of Medical Big Data with
Deep LearningEx. Watson
Walking Assist Robots (HAL, ReWalk)
Node
Node
Vital Data
Command
Node
Node Node
OfficialNetwork
University Hospitals
Telecom Carrier Operator
Rehabilitation Center
Official Network
Clinician, Nurse, Therapist
Node
International Standard of Medical Body Area Network (BAN) IEEE802.15.6
Medical Database, Repository
Body Area Network (BAN)
Diabetes & Metabolic High Society People
Remote Sensing Glucose level &
controlling wearable insulin pump by BAN
Prof. Ryuji Kohno’s Properties, Confidential
Sensing Physical and
Mental Condition
Sensing Mental & Physical Condition for Training
Elderly Patient, Sport Athlete
Node Node
Detect and Prevent Pandemic of COVID-19
September 2021
Slide 18
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
API
Network cloudGateway
API
API
CoordinatorAPI
API APIBluetooth node
APIWi-Fi node
BT/B
LE
SensorSensor
ActuatorActuator
SensorSensor
ActuatorActuator
SensorSensor
ActuatorActuator
APICoordinator
API
UWB node
API APIBluetooth
node
SensorSensor
Actuator
Actuator
SensorSensor
ActuatorActuator
Body Area Network; (BAN)
UWB node
Medical Healthcare Data Mining and Networking Based on Universal Platform by Wireless BAN, Network Cloud, Data Server with AI Data Mining
Ryuji Kohno's Properties, Confidential
Slide 19
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
High Quality of Life by Parasports Supported by Wireless BAN, Network Cloud, Assisting Robots, AI Data Science
1. Guarantee Safe and Enjoyable Training and Games for Parasports ex. Chair Basketball & Ski2. Fair Judgement of Sport Games with Wireless Sensing
20
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)
Integrated Platform among Wireless BAN, 5G/6G Cloud Network and AI Data Servers
21
Coordinator
4G, 5G, 6GCellularWi-FiWiMAX etc.
Individual Wireless Connection for each a sensor
Cloud NetworkUSB
Coordinator Windows
Android
iOS
※Coordinator in figure is just an image.
Data Mining
Cloud Server/Data Center System Operation
Network Operator
University HospitalsRemote Clinical Treatment & Testing
Regulatory Compliance Test, R&D, Standardization of Healthcare ICT
ECG Sensor
Glucose Sensor
Rehabilitation Robot& Wheel Chair
Surgery Robot
Multiple Sensor(SPo2 EEG, etc.)
ECG Sensor
BAN for User 1
BAN for User 60
….
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)22
22
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)Ryuji Kohno's Properties, Confidential23
doc.: IEEE 802.15-21-0484-00-06a
Submission Ryuji Kohno(YNU/YRP-IAI)Ryuji Kohno's Properties, Confidential24