+ All Categories
Home > Documents > The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… ·...

The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… ·...

Date post: 16-Jun-2018
Category:
Upload: votram
View: 218 times
Download: 0 times
Share this document with a friend
42
The Nomad Digital Pen ENSC 440/305 © Copyright 2009 - TechStyles Inc. 1 School of Engineering Science Simon Fraser University 2009.05.15
Transcript
Page 1: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

The Nomad Digital PenENSC 440/305

© Copyright 2009 - TechStyles Inc. 1

School of Engineering Science

Simon Fraser University

2009.05.15

Page 2: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Outline� The TechStyles Team

� Roles in the Project

� Team Dynamic

� Motivation

� Technology

� Goal for ENSC 305/440� Goal for ENSC 305/440

� Theory and Background

� System Overview

� The Hardware and Software

� Business Case

� Project Specifics

� What we learned…

� Problems & Challenges

� Conclusion & Future work

2© Copyright 2009 - TechStyles Inc.

Page 3: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Team Members:

Simran Sarai ([email protected])

Zhen Gang Xiao ([email protected])

Behzad Jazizadeh ([email protected])

Unnati Sapre ([email protected])

3© Copyright 2009 - TechStyles Inc.

Page 4: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Roles in the project� Two teams of two:

� Hardware design: Zhen & Behzad

� HW/FW design & programming

� Electrical design

� Software development: Simran & Unnati� Software development: Simran & Unnati

� User interface

� HW/SW interface

�As a team:� Algorithm implementation

� HW & SW Integration

� Validation & testing

4© Copyright 2009 - TechStyles Inc.

Page 5: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Team Dynamics

� Weekly Meetings

� Communication over

internet

� Lab work at Burnaby � Lab work at Burnaby

Campus (Phase I)

� Lab work at Surrey

Campus (Phase II)

© Copyright 2009 - TechStyles Inc. 5

Page 6: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Motivation� Want pen that is more than

just a pen

� Archive / Digitalize

6© Copyright 2009 - TechStyles Inc.

� Archive / Digitalize

handwritten notes

� Portable

� Eco-friendly, “Go Paperless”

Page 7: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Existing Technology� Ultra Sound Technology

� Capture the motion by

detecting the reflective

signaturesignature

� E.g. EPOS Digital Pen

� Require a transmission base

© Copyright 2009 - TechStyles Inc. 7

Page 8: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Existing Technology� Optical Sensing Technology

� Image Capturing

� E.g. LiveScribe Pulse� E.g. LiveScribe Pulse

� A tiny camera is embedded in

the tip of the pen

� Require special paper

© Copyright 2009 - TechStyles Inc. 8

Page 9: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Techstyles’ Approach� New Approach:

� Capturing motion with

Accelerometer

� Main Advantage:� Main Advantage:

� All components can be integrated

inside an ordinary size pen

� Write on any surface

© Copyright 2009 - TechStyles Inc. 9

Page 10: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Goal for ENSC440/305

�Proof of concept

� Research

� Experiment

Analysis� Analysis

�Goal to achieve:

� To be able to

display/save writing on

the screen using

accelerometer

© Copyright 2009 - TechStyles Inc. 10

Page 11: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

NEXT…

…Technical© Copyright 2009 - TechStyles Inc. 11

Page 12: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Writing on the 2D Surface� Three main parameters:

� X, Y for translation

movement

� Θ for the rotational � Θ for the rotational

movement

© Copyright 2009 - TechStyles Inc. 12

Page 13: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Move the Pen in the 3D Space� 6 Degree of Freedom

� 6 Parameters

� X, Y, Z

λ,φ,Θ

Θ

� λ,φ,Θ

© Copyright 2009 - TechStyles Inc. 13

φ

λ

Page 14: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Sense the Motion� One Three-Axis

Accelerometer

� Sense the translational acceleration

� Receive the position data by � Receive the position data by double integration

� Three single axis angular rate sensors

� Sense the angular velocity

� Compute the angular movement by single integration

© Copyright 2009 - TechStyles Inc. 14

Page 15: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

System Overview

15© Copyright 2009 - TechStyles Inc.

Page 16: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

The Hardware Module

© Copyright 2009 - TechStyles Inc. 16

Page 17: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

The SoftwareFeatures:

� Real-time Writing Display

� Acceleration and Angular Velocity Indicator

© Copyright 2009 - TechStyles Inc. 17

Velocity Indicator

� Real-time Acceleration

Plot

� Motion Data Capturing

Tab

� Raw Data Import

Page 18: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

NEXT…

…Business© Copyright 2009 - TechStyles Inc. 18

Page 19: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Business Case� Market:

�Market Target:

� Students,

� Managers/Execs � Managers/Execs

� Professionals

�Marketing Plan:

� Canada & U.S.A. (ages vary from 18 to 55)

� Best Buy > Staples > London Drugs > Online

Purchase > SFU Book Store

19© Copyright 2009 - TechStyles Inc.

Page 20: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Business Case (Cont’d.)� Out of 103 cases…

� 75%: Yes, they would buy the Nomad pen

� 22.1%: No, they are not interested in it

� 2.9%: Neutral, they were indecisive

© Copyright 2009 - TechStyles Inc. 20

Page 21: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Business Case (Cont’d.)

© Copyright 2009 - TechStyles Inc. 21

Page 22: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Business Case (Cont’d.)� Suggested Price: $133.98 CAD

�Cost:�Cost:

� Proof of concept: so far $420.00 CAD

� Prototype: estimated to be above $500.00 CAD

� Mass production: average of $23.00 CAD (@

breakeven point)

© Copyright 2009 - TechStyles Inc. 22

Page 23: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Business Case (Cont’d.)� Financing

� Proof of concept:

� Group Members

� ESSEF

� Ken Spencer 2nd prize

� Prototype:

� ESSEF

� University Funding (Future proposal)

� Angel investors

© Copyright 2009 - TechStyles Inc. 23

Page 24: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Business Case (Cont’d.)�Competition

�Keep the vibe in the market

and promote the brand

�Protect the Nomad Pen via �Protect the Nomad Pen via

patents and licenses

� Improve the Nomad

constantly and add new

features and sides

© Copyright 2009 - TechStyles Inc. 24

Page 25: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Project Specifics

© Copyright 2009 - TechStyles Inc. 25

Page 26: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Project Specifics (Cont’d.)�Timeline

� Ordered some of the components before the semester start

� Self-studied project related

© Copyright 2009 - TechStyles Inc. 26

� Self-studied project related material

� Design from scratch

� Underestimated the levels of complexity

� Long shipment time periods

Page 27: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Project Specifics (Cont’d.)

�Budget

� Ken Spencer 2nd prize

� ESSEF (ESSS fund)� ESSEF (ESSS fund)

� Free Samples

© Copyright 2009 - TechStyles Inc. 27

Page 28: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Project Specifics (Cont’d.)

Required Material Estimated Cost

(in Canadian)

Actual Cost

(in Canadian)

Tri-Axis Accelerometer $50 $132

Tri-Axis Gyro-meter $100 $88

MCU $50 $0

© Copyright 2009 - TechStyles Inc. 28

MCU $50 $0

MCU Programmer $50 $100

Cables/Connectors $100 $30

Serial Interface chip $50 $5

PCB/Signal Processing components $200 $35

Other $500 $22

Total $1100 $412

Page 29: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

NEXT…

…What we learned

© Copyright 2009 - TechStyles Inc. 29

Page 30: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

What was learned……� Hardware coding two different models of MCUs from

Microchip:

PIC18F2550

PIC18F4685PIC18F4685

� Software coding:

RS232 Driver

GUI

� Sensor applications:

Accelerometer

Gyro-meter

© Copyright 2009 - TechStyles Inc. 30

Page 31: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

What was learned… (Cont’d.)� Hardware communication protocols:

SPI

I2C

RS232RS232

� Analog to Digital converter

� SD-Memory Card

� A variety of compilers:

MPLAB

MikroC

© Copyright 2009 - TechStyles Inc. 31

Page 32: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

What was learned… (Cont’d.)� Console programming:

TurboC

CXL

� Windows programming:� Windows programming:

API

Visual C++

� Windows form design

� Schematics design

� Testing and Validation

� Soldering skills

© Copyright 2009 - TechStyles Inc. 32

Page 33: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

What was learned… (Cont’d.)� Time management

� Task division / Multi-tasking

� Team division

� Documentation

� Technical writing

© Copyright 2009 - TechStyles Inc. 33

Page 34: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Current Challenges

� Poor sensitivity of accelerometer at low acceleration

� Proposed solution: replace acc. with higher sensitivity one

� Large change in acceleration when tilting, due to gravity

� Proposed solution: replace gyro with magnetic sensor to

detect the orientation with respect to the earth’s reference

� Nonlinear relation between acc. Data and writing speed

� Proposed solution: further investigate nonlinear characteristics

of acc.© Copyright 2009 - TechStyles Inc. 34

Page 35: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Future Work� Continuing research

� Implementation of the USB

or Bluetooth module

� Mechanical design for the � Mechanical design for the

compact NOMAD PEN

� Implementation of the first

prototype for field trial

© Copyright 2009 - TechStyles Inc. 35

Page 36: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Conclusion

� Background and motivation

� Project goal

� What we learned� What we learned

� Proved that concept is feasible

� Challenges

� Future work

© Copyright 2009 - TechStyles Inc. 36

Page 37: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Acknowledgement� Prof. Patrick Leung

� Prof. Steve Whitmore

� Jason Lee

� Jamie Westell� Jamie Westell

� Prof. Albert Leung

� Mr. Khosrow Mossannen

� Mr. Fred Heep

© Copyright 2009 - TechStyles Inc. 37

Page 38: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

© Copyright 2009 - TechStyles Inc. 38

Page 39: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Hardware Connection

© Copyright 2009 - TechStyles Inc. 39

Page 40: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Software Algorithm

40

Page 41: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Other Information� Sampling Rate for real-time mode: 24 sample/sec

� Sampling Rate for memory mode: 6 sample/sec

Operational velocity range: 0.13m/sec� Operational velocity range: 0.13m/sec

� Sensitivity of the accelerometer: +/- 3g

� Sensitivity of the angular rate sensor: 100 degrees/sec

� Optimal operating voltage 3.4 V – 3.6V

© Copyright 2009 - TechStyles Inc. 41

Page 42: The Nomad Digital Pen - Simon Fraser Universitywhitmore/courses/ensc305/projects/2009/15demo.… · Title: Microsoft PowerPoint - The Nomad Digital Pen - 440 Final Prep-3rdDraft.pptx

Resolved Challenges� Dependence of zero-acceleration on each trial

Solution:

Raw Acceleration Data

© Copyright 2009 - TechStyles Inc. 42

Filtered Acceleration Data

Derivative of the Acceleration

Acceleration without the constant offset


Recommended