Post on 23-Jan-2016
transcript
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Embedded and Telepresence Control of a 3-Axis Smart Wheel Assembly
Bharath Ramaswamy
December 2, 2004, MS (Plan-B) Thesis DefenseDecember 2, 2004, MS (Plan-B) Thesis Defense
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Presentation Outline
• Smart Wheel Background
• Stand-alone Demonstrator
• Existing System
• Hardware
• Software
• System Limitations
• Future Work
• Videos and Demonstration
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Smart Wheel Background
• CSOIS Robotic Vehicles• T1, T2, T3, ODIS
• Smart Wheel Concept
• Omni Directional Vehicle (ODV)
• Enhanced Smart Wheel
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Stand-alone Smart Wheel Demonstrator
• Prototype Smart Wheel Assembly
• Stand-mounted• My Goals
• Joystick Control• Telepresence Control
• Outcomes ???
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Smart Wheel – Mechanical
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Smart Wheel – Existing Vectronics
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
TT8 Microcontroller
• Tattletale Model 8 (TT8) from Onset Computer Corporation
• Brain of the “Smart” wheel• Processors
• Motorola 68332• PIC 16C64
• Features• RAM 256K• Flash 256K• ADC 8-Channel • TPU I/O Lines 14• RS232 Ports – 2• Hardware RTC
• Programming• ANSI C or TXBASIC
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Wheel Node Digital Interface Board
• Interfaces TT8 Controller with the Master Node and Motors.
• Modules• Power supply• TT8 Controller interface• Motor Driver interfaces• Wheel Encoder interfaces• RS232 line drivers• Wheel watchdogs• Optical Isolation
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Smart Wheel – Existing Software
• Aztec C cross-compiler• MicroC/OS• Low Level Controllers
• Drive Control• Steering Control• Command Listener• Evaluate Command• Service Watchdog• Miscellaneous
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Summary of Modifications
• Z-Axis Control• Telepresence control not possible with all-hardware solution.• Provide interface for z-axis control box with TT8 controller.
• Joystick(s) Interface
• Ethernet-Serial Interface• For telepresence control.• Method to communicate between remote PC and TT8 controller on
wheel node.
• Arbitration• Ensure predictable behavior during simultaneous access attempts by
joystick operator and multiple remote operators.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Hardware Architecture
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Joysticks and Interfacing
Fig. Circuit for ADC input protection.
Fig. Selected joysticks: (a) 3-axes joystick (b) single-axis joystick
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Modification to Z-Axis Controller
• DAC:• TI TLC5615.• 10-Bit Serial.• QSPI, SPI, Microwire.
• Interface• Using General-purpose
Port pins of TT8.• Analog Output to Vin of
Control Box.
Fig. TLC5615 DAC Package.
Fig. Interfacing the DAC with the TT8 controller and the z-axis circuitry.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Auxiliary Board
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Serial Server
• Purpose• Connect wheel node with the
Internet.• Assigns wheel its own IP
Address.• TCP/IP RS232.
• NPort DE-311 Serial Server from Moxa Tech.• 10BaseT and 100BaseT
Ethernet.• Multiple modes.• Multi-OS support.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Internet Camera
• Camera + Computer• Built-in Web server• Configurable IP Address• Direct connection to Hub• DLink DCS 5300
• Video and Audio streaming
• 30 fps at 640x480• Pan, Tilt, Zoom capability• Low-cost
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Software Architecture
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Wheel Node Development Platform
• TT8 Controller• Aztec C
• Integrated Cross-compiler, Linker, Exe Generator
• TOM8• Mini-monitor on TT8
• Crosscut Terminal Emulator • Downloader
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Wheel Node Embedded Software
• Existing Modules• Controller Initialization• Digital I/O Macros• Internal Timer• Time Processor Unit (TPU)• Serial I/O• ADC
• CSOIS Modules• Motor Drivers• Modified Serial I/O• Modified ADC• Wheel Watchdogs
• My Modules• Joystick Routines• DAC Driver• Set-point Conversion• Set-point Controller• Main
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
DAC Driver
• Used QSPI Standard from Motorola
• Toggle General-purpose port pins owing to lack of SPI/QSPI ports.
• 10-bit data with 2 dummy bits.
• CSBAR held low for entire duration.
• Make data available before Rising edge of SCLK.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Conversion of Joystick Inputs into Drive Set-points
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Conversion of Joystick Inputs into Steering Set-points
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Conversion of Joystick Inputs into Z-Axis Positions
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Control Strategy
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Arbitration
• Wheel Node Operating Modes• Idle Mode.• Joystick Mode.• Remote Mode.
• Idle Mode• Wait for either the joystick or any remote operator to begin
controlling the wheel.• Joystick Mode
• Starts when Joystick Operator moves the Joystick(s) along any of the Axes.
• Any requests from remote operator to control the smart wheel are rejected.
• Timeout after 30-second period of inactivity; system goes back into Idle Mode.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Arbitration (contd.)
• Remote Mode• Starts when wheel node received REMOTE_REQ
character.• Commands form Remote Operator will affect Wheel Axes
Set-points. • Any movement of the joystick will have no effect on wheel
set-points. • When Remote Operator is idle for 30 seconds, a timeout
occurs and the system slips into Idle Mode.• The wheel node does not have to arbitrate between multiple
remote operators. This issue is taken care of by the serial server and the remote application software.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Flowchart – Main Module
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Flowchart – ‘Idle Mode’ Routine
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Flowchart – ‘Joystick Mode’ Routine
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Flowchart – ‘Remote Mode’ Routine
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Serial Server – NPort DE311
• Modes of Operation• Host Based / Driver Mode• Pair Connection Mode• Socket Modes
• TCP Server• TCP Client• UDP Server/Client
• Ethernet Modem Mode
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Serial Server – Host Based/Driver Mode
• Configuration Steps:• Install Virtual COM Driver on Remote PC.• Get PC’s IP address authorized from CSOIS• Link Virtual COM Driver with Smart Wheel Serial Server (using Serial
Server’s IP Address)
• Working on Remote PC:• Intercept data sent to the host’s COM port.• Pack into a TCP/IP packet.• Redirects it through the host’s Ethernet card.
• Working at Wheel Node:• NPort Serial Server accepts Ethernet frame• Unpacks the TCP/IP packet• Sends it transparently to Wheel Node’s RS232 Interface.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Telepresence Control Operator Interface
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Communication Protocol – Scenario 1
Fig. Scenario – 1: Remote operator has a successful telepresence control session with the smart wheel.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Communication Protocol – Scenario 2
Fig. Scenario – 2: Session terminates when remote operator sends no new set-points for 30 seconds.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Communication Protocol – Scenario 3
Fig. Scenario – 3: Remote operator is denied access since the wheel is being joystick operated.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Communication Protocol – Scenario 4
Fig. Scenario – 4: Remote operator is denied access since another remote operator is controlling the wheel.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Communication Protocol – Scenario 5
Fig. Scenario – 5: Remote operator is unable to obtain access since the wheel power is turned off.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Communication Protocol – Scenario 6
Fig. Scenario – 6: Remote operator is unable to obtain access since the serial server is turned off.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Control Panel Software Design
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Telepresence Control Software- Misscellaenous
• Serial Communication• MSCOMM Control• 9600 BPS, 8 data bits, no
parity bits, 1 stop bit.• Chosen COM Port – COM5
• Video Display• MS Internet Control• Preset URL to Camera’s
webpage• Pan, Tilt, Zoom through
Camera firmware• User Authentication required
• Other Features• CSOIS Information page on
Smart wheel• Videos of T2 and T3 Robot
Motion
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Tested Scenarios
• Joystick operation.• Remote access attempt during Joystick operation.• Joystick access attempt during Remote operation.• Attempt to access by second remote operator.• Attempt to access when wheel power OFF.• Attempt to access when serial server OFF.• Video and audio available (up to 20 viewers) without
control access.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Problems and System Limitations
• Occasional non-response to joystick after end of a remote session.
• No visual status indicator for joystick operator.• Telepresence Control not platform independent.• Insecure Communication.• Telepresence control access somewhat
cumbersome.
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Future Work
• Panel mounting of Joystick with good status indicators.• Secure and reliable communication protocol with
standardized packet structure and acknowledgement signals.
• Closed loop control of Steering and Drive motors (requires RTOS).
• Implementation of Controller on Remote Location – Networked Control System (NCS).
• Platform independent web-enabled telepresence control solution. (using Java or ASP)
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Questions?
Bharath Ramaswamy Embedded and Telepresence Control of a 3-Axis Smart Wheel Demonstrator 12-02-2004
Demonstrations…