Date post: | 22-Nov-2014 |
Category: |
Technology |
Upload: | julien-de-charentenay |
View: | 261 times |
Download: | 1 times |
ParaViewWeb + Kinect
Towards accessible immersive CFD results visualisation
Introduction
• Objective of the presentation:
• Provide a synopsis of the methodology used when developing proof-of-concept ParaViewWeb + Kinect.
The aim of the ParaViewWeb+Kinect project is to evaluate feasibility and demonstrate proof-of-concept of gesture based navigation for
CFD simulation visualisation, not to provide a final product.
Component Chart
Kinect Sensor
Kinect Driver
Kinect SDK
Adapter (C#)
pvpython + pv_web_visualizer.py
Geometry + CFD results files
Visualizer/index.html
index.html+ interpreter library (JavaScript)
WebSocket
WebSocket
MouseEvent
Components Details
• C# Adapter:
SkeletonFrame DepthImageFrame
InteractionFrame
UserInfo
Broadcast as JSON
Component Details
• HTML/JavaScript
Receive JSON
Create custom HandEvents:HandMove, HandGrip, HandRelease
Display hand "cursors"
Convert HandEvents into MouseEvents (move, over, enter,
leave, down, up, click)
Implementation
Pro• Allow kinect movement with no
modification of targeted web-page;
• Allow for kinect to be hosted on different computer/OS than client;
• Support hand interaction and skeleton movement;
• Small and simple.
Cons• No recognition of hand
gesture;• One hand is dominant when
mapping hand movement to mouse movement;
• Slow;• Not 100% web-based, and
requires distribution the local C# adapter;
• Based on kinect SDK, need porting to openNI for non-kinect sensors.
Demo
• The demo is based on ParaViewWeb, but we trying to make it work other web-based services
ParaViewWeb + Kinect demo: http://youtu.be/XHXqmQPqQNs
The End
This project is standing on the shoulders of giants such Microsoft & Kitware...
Special thanks to
The Edge
and
Hack-the-Evening
Contact details:
Twitter: @FormerlyHibou
https://juliendecharentenay.appspot.com