Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Project: IEEE 802.15 Working Group for Wireless Personal Area Networks (WPANs)Project: IEEE 802.15 Working Group for Wireless Personal Area Networks (WPANs)

Submission Title: Invisible data embedded Display Tx schemes for OCC

Date Submitted: 10 January, 2016 Source: Jaesang Cha[SNUST], Junghoon Lee [ Dong Seoul Univ.] and Vinayagam Mariappan [SNUST]

Address : Seoul National University of Science & Technology [SNUST], Seoul, KoreaVoice: +82-2-970-6431, FAX: +82-2-970-6123, E-Mail: chajs@seoultech.ac.krRe: Response to Call For IEEE802.15.7r1 Proposal on November 2015

Abstract: Variable invisible data embedded Display Tx schemes for OCC are proposed. Variable modulation Scheme, Distance adaptive , Angle Free, Asynchronous, Rx Distance and Frame rate adaptive OCC communication schemes are proposed.

Purpose: To submit a Proposal IEEE 802.15.7r1

Notice: This document has been prepared to assist the IEEE 802.15. It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein.

Release:The contributor acknowledges and accepts that this contribution becomes the property of IEEE and may be made publicly available by IEEE 802.15

Jaesang Cha, Seoul National Univ. of Science &Tech

January 2016

Slide 1

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

January 2016

Jaesang Cha [SNUST] Vinayagam Mariappan [SNUST]

Junghoon Lee [ Dong Seoul University]

SNUST 802.15.7r1 Proposal for Invisible data embedded Display Tx schemes for OCC

Jaesang Cha, Seoul National Univ. of Science &TechSlide 2

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Contents

Introduction

Proposal Descriptions

Network Device Architecture

MAC Layer

PHY Layer

Device Management Entity

Simulation Analysis

Conclusion

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 3

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

January 2016

Introduction

Jaesang Cha, Seoul National Univ. of Science &TechSlide 4

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Introduction (1)• Information needed to transfer is encoded into a visual frame • Any camera equipped device can turn to the Display screen scene and

decode the information

January 2016

• Advantages- Operating on the Visible Light Spectrum Band- Electromagnetic Interference Free Communication- Promising out-of-band communication for Short Range information acquisition

Display Screens

Smart Device

Jaesang Cha, Seoul National Univ. of Science &TechSlide 5

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Introduction (2)• Display Screen – Smart Device Tx & Rx Data Flow

• Issues- Displays Visible Coded Images- Uses QR Code, 2D Barcode, Color

Code Patterns- Unpleasant View Experience - Camera receiver to be closer to the

screen- Low Data Rate- Need addition Synchronization Block

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 6

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Introduction (3)• Proposing Invisible Data Embedded on Display Screen – Smart Device

Communication Mode- Unobtrusive to the human eyes- Decodable by Camera Eyes

• Design Goal- Unobtrusive to Screen Viewer- Works on dynamic visual Scene- Angle and Distance Free Communication- Rx Distance Adaptive Communication by Screen with interactive Camera - Asynchronous Communication- Rx Frame Rate independent Transmission

January 2016

Tx

Rx

Data Received

Jaesang Cha, Seoul National Univ. of Science &TechSlide 7

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

January 2016

Proposal Descriptions

Jaesang Cha, Seoul National Univ. of Science &TechSlide 8

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Proposal Overview

• Key features- Invisible Data Embedding- Works on dynamic visual Scene- Angle Free and Distance Adaptive Communication- Rx Distance Adaptive Data Rate Control by Screen with interactive Camera - Asynchronous Communication- Rx Frame Rate independent Transmission- Uses Spread Spectrum based M-PSK, M-FSK, Hybrid-M-PSK-FSK, Sequential Scalable

2D Codes- Multi-Display Model for Transmission

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 9

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Display Tx Process Block

VIDEO FRAMING

OWC DATA FUSION

M-FSK / M-PSK/

2D CODE

Unipolar to

Bipolar A bpsB bpsC bps

Spread code

Generator

SS cps

Bipolar to

UnipolarSS cps

CODED PAYLOAD GRID

FRAMING

January 2016

• OWC Data Fusion- Uses Blending / Watermarking- Alpha Blending

OWCFusionDisplayFRAME = α . grid + (1- α ) Data2DWhere α 0 to 1 and α = 0 < 0. 1 100% Invisible

SS

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 10

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

SS Modulation Parameters

Data Rate(bps)Parameter 1000 2000 3000 Units Considerations

Tx data size 20 40 80 bits Payload sizeFrame duration 20 20 20 ms

SS chip rate 2 2 2 Mcps Spreading chip rateSpreading Factor 8 4 2Processing Gain 8 4 2

Number of chips per frame 32 128 512 chips

Grid Allocation 8*4 16*8 32*16The numbers of

rows and columns of screen

January 2016

• Study Case

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 11

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

M-PSK

January 2016

• 2-PSK

• 4-PSK

1) 0 2) 1

1) 00

3) 10

2) 01

4) 11

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 12

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

M-FSK

January 2016

• 2-FSK

• 4-FSK

1) 0 2) 1

f1 f2

1) 00 2) 01

f1 f2

3) 01 4) 10

f3f4

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 13

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Hybrid (M-PSK-FSK)

January 2016

• M-PSK and M-FSK - Data bits can be sent via frequency & phase combination

2) 01

1) 00

3) 10

4) 11

Phase Frequency

f1

f2

f1

f2

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 14

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Sequential Scalable 2D Codes

January 2016

• Use 2D Codes– QR Code– Color Code

• Use Invisible Watermarking Scheme for Embedding• Propose the Sequential Scalable 2D Code to support distance adaptive data

rate• Sequential Scalable QR Code

• Sequential Scalable Color Code

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 15

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Code set 1 : 0000000010010100100111101010110 (zero offset)

Code set 2 : 1001010010011110101011000000000 (8chip offset)

Code set 3 : 1001111010101100000000010010100 (16chip offset)

Code set 4 : 1010110000000001001010010011110 (24chip offset)

<Gold-sequence generator>

5 4 3 2 1

5 4 3 2 1

Gold-sequence

January 2016

SS Code Sequence – Study Case

• Spreading Code (Gold Sequence)- Gold sequence was chosen as a spreading code- Shifter register length is 5- Code length is 31 (=25-1)- 4 family code set was generated via offset 8*n chips of code set 1.

• Any Special Orthogonal Spreading Code Sequence with good process gain is adoptive for implementation

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 16

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Video Frame#1, SC#1(Spread code #1)

Video Frame#2, SC#2

Video Frame#3, SC#3

Video Frame#4, SC#4

Video Frame#5, SC#1

January 2016

SS Code Sequence Assignment

• Each code sets repeated for spreading data according to spreading factor

• Each spreading code set 1, 2, 3, 4 are assigned for successive 4 frames as below

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 17

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Rx Process Block

FFT M-FSK / M-PSKDetector

Unipolar to

Bipolar

Spread code Generator

SS cps

Bipolar to

UnipolarSS cps A bpsB bpsC bps

January 2016

QR CodeDetector

• Smart Device Camera Capture Visual Frame from Screen• Extract the ROI of Screen Visual Area• Apply the Sequential Scalable 2D Code or M-FSK or M-

QPSK detector based on Mapping Scheme Applied• Recover the Decoded data after applying SS

SS

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 18

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Asynchronous Communication MethodVideo Frame#1, SC#1(Spread code #1)

Video Frame#2, SC#2

Video Frame#3, SC#3

Video Frame#4, SC#4

Video Frame#5, SC#1

January 2016

• When transmitting data, different spreading code is used per video frame.• On Rx side spreading code already known.• If camera CMOS received same frame, for example #1 video frame receive

twice, then receiver will despread video frames using SC#1, SC#2. When processing using SC#2, dominant value will not appear so the video frame will be discarded.

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 19

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Variable Spreading Factor based on Client Distance from Display

Assigned with SS Short Code

Assigned with SS Long Code

January 2016

• Tx Camera Estimate the Rx’s Distance from Tx• If Rx is near SF Value is small so Short Sequence Code Assigned otherwise

SF values high so Long Sequence Code Assigned

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 20

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

January 2016

Scalable Bitrate Controller for Frame Rate Adaptive Transmission

• To achieve robust communication, the scalable data transmission mode is proposed

• Screen is divided into Multiple regions and each region has different frame rate controlled data transmission is enabled

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 21

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Positioning Service

• Invisible ID-Tag (2D code Tag) and Display Pattern transmit ID and Payload information to support the position based service or indoor positioning system

• Transferred data is assigned pointer of Big-data (URL link etc.)

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 22

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Authentication Service

• Authentication using Display with Camera for Authentication Service• Display Tx Camera will capture the user information from Smart

Device by Display Pattern or Flash and Provide user Authentication

January 2016

LED �ָ

ց ઝݛ�������ઝ Я ֆ( ΰݨ����� ઝ্� )

LED Light

Smart Device(LBS)

Smart Device

Gateway(Display - Camera)

Jaesang Cha, Seoul National Univ. of Science &TechSlide 23

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Network Device Architecture

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 24

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Network Device Architecture

• Layers

January 2016

- SNUST IEEE802.15.7r1 Layer Architecture proposes simplified model from IEEE802 Reference Model IEEE802.15.7-2011

- The Specifications are updated on respective section Layer Specification

- Device Management Entity (DME) uses Interactive Camera to provide Receiver distance dependent data rate control

• Used Topologies- Broadcast , Peer-to-Peer,

Point-to-Multipoint

Jaesang Cha, Seoul National Univ. of Science &TechSlide 25

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Network Device TopologiesJanuary 2016

• SNUST IEEE802.15.7r1 proposes to follow three topologies- Broadcast , Peer-to-Peer (P2P), Point-to-Multipoint(P2MP)

• Broadcast Topology- Tx a signal to other devices without forming a network- Uni-directional so the destination address is not required

• P2P Topology- Tx a signal to other devices with or without forming a network- Uni/Bi-directional and the destination address is need for Bi-directional case

• P2MP Topology- Tx a signal to other devices with forming a network so both need to built with Camera and

Display- Bi-directional and the destination address is required

Jaesang Cha, Seoul National Univ. of Science &TechSlide 26

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

MAC Layer

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 27

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

MAC Frame Format• The Proposed MAC Frame Format

• Broadcast and P2P (Uni-Directional) is does not use Source and Destination Address (Its Optional)• P2MP and P2P (Bi-Directional) uses Source and Destination Address• The Field Check Sequence (FCS) can be optional for future Extension. Not used now

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 28

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

MAC Protocol Setup Method

• The Beacon Message periodically transmitted to establish the communication between Display Screen Transmitter and Smart Media Device Receiver about Network Information. The Minimum periodicity is one sec. The periodicity configuration interval is [1 60] sec.

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 29

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Peer Indicator Negotiation MessageJanuary 2016

• The Peer Indicator Negotiation Message is Transmitter periodically after Beacon Message according to the Beacon Message Periodicity Configuration on Display Screen OCC transmitter

Jaesang Cha, Seoul National Univ. of Science &TechSlide 30

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Device Status Indicator Negotiation MessageJanuary 2016

• Transferred file size or remained file size with our eyes by using Device Information packet

Jaesang Cha, Seoul National Univ. of Science &TechSlide 31

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

MAC State Description for P2P / Broadcast Topology

January 2016

• To communicate device to device, device can transfer coarse link adaptation information to peer device by using Beacon Message and Indication Negotiation Message

• MAC States consist of IDLE State, Connection State, Data Exchange State

Jaesang Cha, Seoul National Univ. of Science &TechSlide 32

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

January 2016

MAC State Description for P2MP Topology• To communicate device to device, device can transfer coarse link

adaptation information to peer device by using Beacon Message, Device Information and Indication Negotiation Message.

• MAC States consist of IDLE state, Connection state, Data Exchange state.

Jaesang Cha, Seoul National Univ. of Science &TechSlide 33

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

PHY Layer

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 34

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

PHY Frame Structure

• IEEE 802.15.7r1 PHY is supports following activities:

- The preamble is replaced with a Start Frame Delimiter- Optional Fields define PHY Specific Information is Optional and defined in future - PSDU holds the data packet

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 35

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

PHY FRAME

• PHY frame includes Frame Generation SS, Modulation Scheme, Embedded Message on Image, Display driver and Display Screen

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 36

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Data Rate Performance

S.No SS Modulation Embedding Method Data Rate

(Kbps)

1 5 Step Gold Sequence

M-FSK Alpha Blend 9

2 5 Step Gold Sequence

M-PSK Alpha Blend  9

3 5 Step Gold Sequence

HYBRID Alpha Blend  18

4 5 Step Gold Sequence

QR CODE Watermark 21

January 2016

• For Display 1920x1080 (2-PSK/2-FSK/2-FSK-PSK)

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 37

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Device Management Entity

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 38

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

DME• Tx Camera Enable [1 Byte]

- [Bit 0] Represent Tx Camera Enable Bit - Check and Set the Status of Tx Enable Bit 1- 1/0 -> Tx Camera Connected / Tx Camera not connected

• Rx Distance [ 1 Byte]- Shows the Rx Distance from Tx

• Application Mode [ 3 Bit]- ID Mode [Bit 0]: 1/0 – Enable / Not Used- Authentication Mode [Bit 1]: 1/0 – Enable / Not Used- Data Mode [Bit 2]: 1/0 – Enable / Not Used

• Application Packet Length [2 Byte]- Used to specify the length of a data packet

• ID Length [1 Byte]- Used to specify the length of a ID

• Authentication Data Length [2 Byte]- Used to specify the length of a Authentication Data

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 39

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

DME (2)

• The DME information Shared to- Application Layer- MAC- PAHY

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 40

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Simulation Analysis

January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 41

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

System Simulation Block DiagramJanuary 2016January 2016

Jaesang Cha, Seoul National Univ. of Science &TechSlide 42

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Simulation Results - M-FSK

January 2016

• M-FSK– 2 /4 – FSK– 5 Step Gold Sequence

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 43

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Simulation Results - M-PSK

January 2016

• M-PSK– 2 /4 – PSK– 5 Step Gold Sequence

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 44

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Simulation Results - Hybrid (M-PSK-FSK)

January 2016

• M-PSK-FSK– 2 /4 – PSK– 5 Step Gold Sequence

Doc.: IEEE 802. 15-16-0025-00-007a

Jaesang Cha, Seoul National Univ. of Science &TechSlide 45

Submission

Doc.: IEEE 802. 15-16-0025-01-007a

Conclusion

• Variable Invisible data embedded Display Tx schemes for OCC are proposed and had many advantages- Data is Unobtrusive to User- Works on dynamic visual Scene- Angle Free and Distance Adaptive Communication- Rx Distance Adaptive Data Rate Control by Display with interactive Camera - Asynchronous Communication- Rx Frame Rate Support independent Transmission- Uses variable modulation and multiplexing methods. - Multi-Display Model for Transmission- Supports Indoor/outdoor Positioning, Authentication, Data Transmission

Jaesang Cha, Seoul National Univ. of Science &Tech46

January 2016