47
Manual Elsys Corp. Saint – Petersburg 2007
Manual
Elsys Corp.
Saint – Petersburg
2007
2Contents
Introduction ....................................................................................................................................3
System requirements.......................................................................................................................5
Installation ......................................................................................................................................5
Start .................................................................................................................................................5
VibraImage .....................................................................................................................................6
Start Adjusting ................................................................................................................................7
VibraImage menu .........................................................................................................................10 File Menu...............................................................................................................................................10 View Menu.............................................................................................................................................13 Settings Menu........................................................................................................................................15 Help ........................................................................................................................................................18
Image Area....................................................................................................................................19
Lie Detector Mode (Settings)........................................................................................................21
Lie Detector Mode (operation) .....................................................................................................23
Toolbar ..........................................................................................................................................27
Printing module ............................................................................................................................28
Printing menu ...............................................................................................................................29 File menu ...............................................................................................................................................29 View menu .............................................................................................................................................30 Help ........................................................................................................................................................30 Persons list .............................................................................................................................................31 Printing area..........................................................................................................................................32 Printing ..................................................................................................................................................33 VibraImage calling from printing module .........................................................................................34 Toolbar...................................................................................................................................................34 Status bar...............................................................................................................................................34
LogView module ...........................................................................................................................35
LogView menu ..............................................................................................................................35 File menu ...............................................................................................................................................36 View menu .............................................................................................................................................36 Help ........................................................................................................................................................37 Toolbar...................................................................................................................................................38
Aura Interpretation.......................................................................................................................39
Emotions recognition by vibraimage ...........................................................................................42
3
Introduction
Welcome to the VibraImage World! Open a new features in well known objects!
VibraImage technology registers small vibrations (movement) of a live body by standard technical means, like digital or television cameras. This small vibration of a live body is linked with the mental and physiological conditions of a person and reflects emotion levels. VibraImage system captures small changes in a human being states which are not visible by other systems and realizes kinesics diagnostic method.
VibraImage is a new type of image and is so primary as original color image, thermo image or x-ray image. Each image type gives new and unique information about the object. Every pixel of vibraimage reflects vibration parameters - frequency and amplitude of vibration for every object point. Visualization of frequency and amplitude combination in a one frame looks like aura of person.
VibraImage software is designed to achieve the following goals and objectives:
• science research of people and animals behavior; • detection of aggression people; • emotions control and recognition; • passengers remote screening; • psychological and medical screening; • lie detection; • live and recorded video processing. • Aura visualization
VibraImage software consists of the three programs - main module (VibraImage.exe), printing module (VIPrinter.exe) and LogViewer module (LogViewer.exe).
4The method, system and the device of said VibraImage are protected by the patents of Russian Federation RU 2187904 (fig.1), RU2289310, Software Registration N2006614137, international patent application PCT/RU01/00545, USA patent US 2004/0131275 and awarded with Gold medal on the international exhibition of inventions and innovations Brussels - Eureka 2002 (fig.2).
Fig.1 Patent of Russian Federation Fig.2 Diploma of international exhibition of RU 2187904 inventions and innovations Brussels - Eureka 2002
5
System requirements VibraImage software has the following requirements:
• PC with PIV 3000 or better; • Windows XP or Vista (Windows Vista recommended) with DirectX 9.0 or
later; • wdm-compatible video device, like web camera with low nose level (Genius
Eye311Q recommended). • audio capture device
Installation 1. Run VibraImage6.msi from CD to install VibraImage 6.0 application. Follow to the instructions in setup dialog. Click "Close" after installation complete. 2. Install dongle driver from CD before start VibraImage 6.0. Note: administrative rights are required to install the NT/2000/XP driver. 2.1. Close all other applications and to avoid file sharing errors. 2.2. Run INSTDRV.EXE application from "Guardant drivers" folder. When the utility is started, it will check for the presence of Guardant driver in the system. If the driver is not found, only [Install driver] button will be available in the main window. To install or update Guardant driver click on [Install driver] or [Reinstall driver] button. If installation is completed successfully, INSTDRV will display a corresponding message and then return to the main window. 2.3. If the driver installation is successful, a message box is displayed. 2.4. Click [OK] to continue. 2.5. Close INSTDRV application. 3. Connect video capture device and dongle to PC Install drivers for video capture device like web cam according to it manual. 4. Restart the system. 5. Run VibraImage.exe
Start Please install the video device drivers and connect this device to PC before starting the main module (VibraImage.exe). Procedure of installation and connection is set out in your video device descriptions and guides. It is necessary to install dongle drivers before starting the main module. Procedure of installation of VibraImage software and dongle drivers read in section Install.
6
VibraImage Main module (VibraImage.exe) is designed for achieving all VibraImage software goals. Printing of screens is possible from the main menu of VibraImage on default printer. Printing of personal data and images is function of Printing module. For viewing the recorded LOG files use LogViewer module.
After software installation you will see the image on the monitor (fig.3) which consists of the following parts:
• main menu; • image area; • toolbar; • information window.
Fig. 3 The window of the first start VibraImage.exe after installation.
7
Start Adjusting Real image, VibraImage, or image of Aura are shown on the VibraImage area.
The basic window of the base module VibraImage.exe can be configured for supervision of work in one of the two basic modes. The choice of an operating mode is made in item View of the main menu (fig.4).
• VibraImage mode [ VI panel (VibraImage Panel)] • Lie detector mode [LD panel (Lie Detector Panel)]
Fig.4 View menu (VibraImage.exe)
Use menu Settings/Video Settings window to select a video source. System VibraImage allows to process the "live" video signal coming from a video camera and the video data recorded before and saved as a AVI-file. On default the system works with a signal from a video camera. Use menu Settings/Video Settings/AVI file source to select AVI-file (fig.5).
Fig.5 Select AVI-file (VibraImage.exe)
8To enable Vibra mode (V) or change options of video image use menu Settings/Image Settings or use the toolbar.
To switch on/off full screen mode use menu View/Full Screen or use the toolbar.
Accumulation and viewing the frequency information is made with next commands of "File" menu:
• Frequency analysis 10s (gathering of the information in 10 seconds and the window of viewing the frequency information appears automatically);
• Frequency analysis 1 frame (gathering of the information in 1 frame).; • Frequency analysis (the window of viewing the frequency information
appears after a second call of this command); • Frequency analysis 10s (F) (processing frequency information with the
Fast Fourier Transformation (FFT)); • Frequency analysis 1 frame (F) (processing frequency information with
the Fast Fourier Transformation (FFT)).
Before working in lie detector mode select menu Settings/Audio Settings/Audio Devices. Before using VibraImage in this mode you may also expose the level of audio signal (blue strip) as shown in figure 6,7,8. Stand more Grain factor or Base level to Max from Avg if you have a low sound sensitivity from microphone.
Fig.6 The minimal value of entrance audio of a signal (silence in a room) (VibraImage.exe)
Fig.7 The maximal value of entrance audio of a signal (sound of a voice) (VibraImage.exe)
9
Fig.8 Working value of audio signal (blue strip) (VibraImage.exe)
After that the system VibraImage is ready to work and is able to analyze emotions of person and to detect lie The indicator of a lie is the red column in the left part of the basic window of the program (fig.9).
Fig.9"Lie Detector" mode (VibraImage.exe)
NOTE:
The image of the person must have good quality, highest possible size and be in the middle of the screen. Presence of other people in the frame and low image quality would influence to emotion analyze and lie detector functions.
10
VibraImage menu • File • View • Settings • Help
File Menu The File menu (see fig.10) contains the following items:
• Save image... Ctrl +S (Designed for saving the current frame of a window in BMP-file);
• Edit personal information... F3 (Designed for entering and saving in TXT-file personal information);
• Save current image to the archive F2 (Designed for structured saving of the current images in BMP format according to the personal information. The item of the menu becomes accessible only after input of the personal information. This information defines the name of a folder where results will be kept);
• Change archive folder... (Designed for changing folder where archive data is kept);
• Set AVI file...(Sets a name of saving AVI-file); • Start AVI capture F7 (Designed for saving the current image in a file with
the set name in a AVI- format ); • Stop AVI capture F8 (Designed for stopping the recording of AVI-file); • Start log-file writing…(Designed for starting the recording of integrated
characteristics of vibraimage to LOG-file); • Stop log-file writing...(Designed for stopping the recording of LOG-file); • Start aura log-file writing…(Designed for starting the recording of values
of aura in file); • Stop aura log-file writing…(Designed for stopping the recording of values
of aura in file); • Frequency analysis 1 frame F4 (gathering of the information is made in 1
frame); • Frequency analysis 1 frame (F) Ctrl+F4 (processing frequency
information with the Fast Fourier Transformation (FFT); • Frequency analysis 10s F12(gathering of the information is made in 10
seconds and the window of viewing the frequency information appears automatically););
• Frequency analysis 10s (F) Ctrl+F12 (processing frequency information with the Fast Fourier Transformation (FFT) (fig.11));
• Frequency analysis F11(the window of viewing the frequency information appears after a second call of this command (fig.12,13));
• Exit Alt+F4.
11
Fig.10 Menu file (VibraImage.exe)
Fig.11 The frequency histogram with application of transformation the Fast Fourier Transformation (FFT) (VibraImage.exe)
Fig.12 The frequency histogram for a "normal" condition of the person (VibraImage.exe)
12
Fig.13 The frequency histogram for condition of the person different from a normal (VibraImage.exe)
13
View Menu The menu View (fig.14) contains the following items:
• Toolbar (switches on/off the toolbar) • LD panel (switches on/off the displaying of the elements of a window with
the parameters relevant to a "Lie detector" mode); • VI panel (switches on/off the displaying of the elements of a window with
the parameters relevant to a "Aura-VibraImage" mode); • LD Advanced Mode (switches on/off the displaying of the additional
elements of the window relevant to a "Lie detector" mode ); • LD Mode (Makes switching in a mode of displaying of parameters and the
characteristics relevant to a "Lie detector" mode , for example a conclusion of a column of the indicator of lie);
• Frequency analysis results (Designed for displaying a window of viewing the frequency information received before );
• Frequency analysis statistic (Designed for displaying the results of mathematical processing of the received results of the frequency analysis);
• Audio monitor (Makes switching of a window of the level of entrance audio signal control (fig. 15) which is necessary while working in a "Lie detector" mode .)
• VI Panel monitors 10s (On VI panel monitors will be displaying the average value for 10s);
• Video2 (switches on/off mode in which two video cameras are connected to the system and the processing of the signal is made from both cameras);
• Real/VibraImage (switches on/off mode of displaying the initial video image);
• Show center (switches on/off mode of displaying the line dividing aura into two equal parts);
• Without "Aura" (select Aura visualization mode); • "Aura" to Vibra Image (select Aura visualization mode); • "Aura" to Real Image(select Aura visualization mode); • "Aura" LD mode (select Aura visualization mode); • Vibra Image "F" mode (select VibraImage calculation mode); • Vibra Image "Am" mode (select VibraImage calculation mode); • White Background (switches to/from the white background mode); • Full Screen (switches on the full screen mode); • Stop/Start (freeze/unfreeze the output in the VibraImage area).
14
Fig.14 Menu View (VibraImage.exe)
Fig.15 Window of the control of the current level of audio signal (VibraImage.exe)
15
Settings Menu The menu Settings (see fig.16) contains the following items:
• Video Settings • Video Settings (2) • High-speed Camera (used while working with high-speed cameras, for
example connected through interface IEEE 1394). • Audio Settings • Language • Image Settings...
Fig.16 Menu Settings (VibraImage.exe)
Video Settings and Video Settings (2) These menus contain options of video modes. They can differ depending on connected devices. Only an "AVI file source..." item (which allows to choose AVI-file which has been written earlier) is constant in "Video Settings". "Video Settings (2)" is inaccessible if only one device is connected . Audio Settings
The menu Audio Settings (fig.17) contains of the following items:
• Audio Level (Allows to determine options of level of sound); • Audio Devices (Contain the list of audio devices); • Proprieties (Contain options for adjustment of sound).
Fig.17 Menu Audio Settings (VibraImage.exe)
NOTE: The contents of the given items of the menu can distinct from submitted depending on your audio-device.
16Languages
The menu Language contain the list of supported languages (fig.18).
Fig.18 Menu Language (VibraImage.exe)
Image Settings
The Image Settings menu (fig.19) allows to adjust the following parameters:
• Palette Threshold (Defines a threshold in the displayed image, value of brightness less which are considered "black");
• N frames (sets number of the frames of summation. In automatic mode N it is limited to 200 frames);
• K (sets factor of amplification. Intensity of a point is multiplied on [K/10]); • Max FPS (sets the maximal number of the frames processed by computer); • F/Am mode (Defines a way of construction VibraImage on frequency (F) or
on amplitude (Am) fluctuations of points); • Beep on anger (If this item is switch on and a level of aggression is higher
than the set limit, program will give out a sound signal on dynamic of a computer);
• Anger Filter (Defines quantity of last frames averaging value of a level of aggression will be made);
• Stress Filter (Defines quantity of last frames averaging value of a level of stress will be made);
• F/I Filter (Defines quantity of last frames averaging value of a level of aggression and stress will be made);
• Single Points Filter (There is a removal of points, at which next points - black);
• Extended Filter (Designed for reduction of noise of a video camera. In this mode at addition of a new interpersonal difference of value of the module of a difference brightness of two points of less preset value are not taken into account);
• Moving Filter (Designed for reduction of noise from strongly moving objects. Thus the frame with "uncharacteristically big" frame difference are rejected. Value [0..500] defines a threshold on which the frame will rejected. The frame is rejected, if the area of nonzero values of an frame difference makes its area more [0..500] % from the area of nonzero values of the resulting image received at the previous stage);
17• Space Filter (Designed for exception of effect of occurrence VibraImage
on borders of motionless contrast objects. Thus frame difference D (x, y) is multiplied on the factor equal K = (1-(SV*MB)/100); where SV - parameter of the filter, MB - the maximal difference between levels of brightness of a point (x, y) and the next points in the initial image);
• Automatic mode (Automatic calculation value of parameters N frames and Palette Threshold is made (fig.20).For change of modes of automatic tuning are used next values:
o Light level (0..255); o Light density (0..100%); o Dark level (0..100%).
Thus Palette Threshold = ((Dark level * Light level )/100.
• Aura visualization mode (On VibraImage the contour of object is allocated. After that intensity of aura and color on each horizontal site are defined like the sum of intensities of a corresponding horizontal site inside a contour);
• Aura to real image (The aura of the person is shown on his real image); • Aura multizone mode (The aura is under construction for each of people
which are taking place in sight of the camera); • Max Speed mode (A line of parameters A1-P4 calculate with the maximal
speed depended from real speed of input of the staff from a video camera); • Noise Level (When the image is too stable, parameters aggression, stress
and a lie are not calculated).
Fig.19 Menu Image Settings (VibraImage.exe)
18
Fig.20 Menu Image Settings in automatic mode (VibraImage.exe)
Help The Help menu (see fig.21) contains the following items:
• About VibraImage... • Help F1
Fig.21 Help menu (VibraImage.exe)
Use "About VibraImage..." command to view the information about software version and registered user name.
Use "Help" command to call the help system.
19
Image Area The image which is visualized in image area depends on an operating mode (fig.22, 23, 24, 25).
Fig.22. LD mode on, LD and VI panels off (VibraImage.exe)
Fig.23. Advanced LD mode on, LD and VI panels off (VibraImage.exe)
20
Fig.24. AR mode on, VI panel on, LD panel off (VibraImage.exe)
Fig.25. VI mode on, VI panel on, LD panel off (VibraImage.exe)
21
Lie Detector Mode (Settings) It is necessary to make more detailed settings of a hardware-software complex for exact measurements of parameters of the person. For this purpose:
• In Settings/Audio Settings/Audio devices menu choose the device (for example microphone);
• Expose the level of audio signal (blue strip) as shown in figure 26, 27, 28.
.
Fig.26 The minimal value of entrance audio signal (silence in a room) (VibraImage.exe)
Fig.27 The maximal value of entrance audio signal (sound of a voice) (VibraImage.exe)
Fig.28 Working value of audio signal (blue strip) (VibraImage.exe)
• In menu View choose LD panel and set LD Advanced Mode (fig.29);
22
Fig. 29 LD panel on, LD Advanced mode on (VibraImage.exe)
23
Lie Detector Mode (operation) During operation in Lie Detector mode on the screen of a computer the following information displayed (fig.30):
• Four green curves on a black background display physiological parameters of the person. Vertical green strip mark the moment of the beginning of record parameters in LOG file, and dark blue strip - stop of record;
• Vertical red column - a level of a lie; • Vertical green column - the current level of the sound acting from source of
audio signal through the chosen channel; • Settings button - for change values of parameters A1-P4; • Start button - beginning calculation parameters of level of a lie in a manual
mode; • Reset button - dump of the results received after pressing of button " Start "
in a manual mode; • Start LOG - start writing LOG- file.
Fig.30 Information window in Lie Detector mode (VibraImage.exe)
• In an information column - extreme right (fig. 31) system marks a Fig. ticks those parameters, which minimal or maximal value have been overcome for the period of measurement.
24
Fig. 31 An information column in the advanced mode of lie detector (VibraImage.exe)
• If you have a sufficient operational experience with a lie detector can set parameters from A1 to P4. Push Settings button to view settings table (fig.32).
Fig.32 Settings table (VibraImage.exe)
25To each parameter from A1 up to P4 there corresponds a line of table in which it is possible to change values.
To cancel changes push Set Default button. Purpose of parameters:
• Show - defines display a line of parameters in an information column or not; • Calc - defines will be value of parameter taken into account at calculation of a column of the indicator of lie detector; • Level - defines a threshold of change of parameter; • Min - the minimal value of "weight" of this parameter at calculation of an attribute of a lie; • Max - the maximal value of "weight" of this parameter at calculation of an attribute of a lie;
• Min Graph - defines the minimal value of parameter displayed on the screen; • Max Graph - defines the maximal value of parameter displayed on the screen.
The group of parameters A1-A5 registers amplitude of vibrations:
A1 Value of an frame difference of video frames
A2 Average value of an frame difference of the frames for 10 frames
A3 Average value of an frame difference of the frames for N frames (N - established value)
A4 Value A1 filtered on 10 frames
The group of parameters F1-F5 registers amplitude of vibrations:
F1 Average value of frequency of vibration for N frames F2 Average value of frequency of vibration for 10 frames F3 Maximum value of frequency of vibration for N frames F4 Maximum value of frequency of vibration for 10 frames
F5 The attitude of "high" frequencies to "low" frequencies for parameter F1
The group of parameters S1-S9 registers symmetry of vibrations of the left and right parts of a body of the person:
S1 Difference between the average amplitude of vibrations of the left and right parts of a body for 2 frames
S2 Difference between the average amplitude of vibrations of the left and right parts of a body for 10 frames
S3 Difference between the average amplitude of vibrations of the left and right parts of a body for N frames
S4 Difference between the average frequency of vibrations of the left and right parts of a body for 2 frames
26
S5 Difference between the average frequency of vibrations of the left and right parts of a body for 10 frames
S6 Difference between the average frequency of vibrations of the left and right parts of a body for N frames
S7 Difference between the maximal frequencies of vibrations of the left and right parts of a body for 10 frames
S8 Difference between the maximal frequencies of vibrations of the left and right parts of a body for N frames
The group of parameters P1-P4 registers characteristics of mathematical processing of process of vibrations:
P1 Dispersion of frequency distribution for 10 frames P2 Dispersion of frequency distribution for N frames P3 Symmetry of frequency distribution for 10 frames P4 Symmetry of frequency distribution for 10 frames
The group of parameters Lie, Stress, Anger, Voice registers characteristics of a level of Lie, Stress, Aggression and the Voice. The settings table of lie detector as allows to establish the following parameters of a conclusion of results of calculation:
• Graph time (ms) -time of displaying parameters; • Stat time (ms) -time for definition maximal and a minimum level of values of parameters before the beginning of processing; • Diff time (ms) - time for definition of an average level of values of parameters • Lie Threshold (%) - threshold for the indicator of a level of lie in view of all designed parameters and their "weight". • LDL mode - defines calculation of a level of lie. • Show mode - defines calculation and conclusion of parameters of lie detector.
27
Toolbar Toolbar (fig.33) replicates the following menu items respectively:
• Save Image... ("File" menu); • Edit personal information... ("File" menu); • Save current image to the archive ("File" menu); • White Background ("View" menu); • Stop/Start ("View" menu); • Full Screen ("View" menu); • Real/VibraImage ("View" menu); • Without "Aura" ("View" menu); • "Aura" to Vibra Image ("View" menu); • "Aura" to Real Image ("View" menu); • Lie Detection (LD) mode • Vibra Image "F" mode ("View" menu); • Vibra Image "Am" mode ("View" menu); • Image Settings ("Settings" menu).
Fig.33 Toolbar (VibraImage.exe)
28
Printing module Printing module (VIPrinter.exe) is designed to print saved personal data and Images, VibraImages, or Aura-VibraImages - all images which were saved on the screen by entering the personal information from VibraLie or VibraImage software.
Main window of printing module (fig.1) consists of the following parts:
• main menu; • persons list; • printing area; • toolbar; • status bar.
Fig.34 Main window of printing module (VIPrinter.exe)
29
Printing menu • File • View • Help
File menu "File" menu (fig.35) contains the following commands:
• Start Aura-VibraImage main module Ctrl+N; • Change archive folder...; • Print… Ctrl+P; • Print Preview; • Print Setup…; • Exit Alt + F4.
Fig.35 "File" menu (VIPrinter.exe)
Use "Start Aura-VibraImage main module" command to call the main module (VibraImage.exe). This command may be executed with Ctrl+N or toolbar.
Use "Change archive folder…" command to change the archive folder. This folder may not coincide with the path in the main module to provide a possibility to create more that one VibraImage archive.
Use "Print…" command to print personal data and VibraImages. This command may be executed with "Ctrl+P" or toolbar.
Use "Print Preview" command to print preview.
Use "Print Setup…" command to change the printer and printing options.
Use "Exit" command to quit the application. This command may be executed with Alt + F4.
30
View menu "View" menu (fig.36) contains the following items:
• Toolbar (switch on/off the toolbar); • Status Bar (switch on/off the status bar); • White/Black background F6 (select a color of images background); • Refresh F5 (reload archive information. It may be necessary after outside
data change); • Language (change current interface and help language); • Zoom In Ctrl+ (command to zoom in the image in the printing area); • Zoom Out Ctrl- (command to zoom out the image in the printing area);
Fig. 36 "View" menu (VIPrinter.exe)
Help The menu Help (fig.37) contains the following items:
• About VIPrinter... • Help F1
Fig.37 Help menu (VIPrinter.exe)
Use "About VIPrinter" command to view the information about software version and registered user name.
Use "Help" command to call the help system.
31
Persons list Persons list (fig.38) is designed to show the list of VibraImage archive items and to select an item for previewing and printing.
Fig.38 Persons list (VIPrinter.exe)
When the item is selected appropriate VibraImages and personal information is shown in the printing area.
32
Printing area Printing area (fig.39) is designed to show current VibraImages and personal information.
Fig. 39 Printing area (VIPrinter.exe)
Use right double-click on VibraImage to view this image in the new full-screen window.
Use "White/Black background" point of the "View" menu to select a color of images background. This point may be applied with F6 or toolbar.
Use "Zoom In" command of the "View" menu to zoom in the image in the printing area. This command may be executed with Ctrl+.
Use "Zoom Out" command of the "View" menu to zoom out the image in the printing area. This command may be executed with Ctrl-.
Use double-click on VibraImage to call the main module (Aura - VibraImage.exe). The main module is called with parameters of saved image; after closing of the main module its current parameters will not be saved.
33
Printing Use "Print…" command of "File" menu to print personal data and VibraImages. This command may be executed with "Ctrl+P" or toolbar. It is necessary to select an item in the persons list before printing. Then personal data and VibraImages will be shown in the printing area.
Printing module is designed to print no more than 10 images for one item. If more than 10 images were saved in the main module then first 10 only will be displayed. Use Windows Explorer or similar programs to remove unnecessary images.
Use "Print Preview" command of "File" menu to print preview (fig.40).
Fig.40 Window of print preview (VIPrinter.exe)
Use "Print Setup…" command of "File" menu to change the printer and printing options.
34
VibraImage calling from printing module The main module (VibraImage.exe) may be called from printing module directly. To call the main module use either double-click to any image in the printing area or "Start Aura-VibraImage main module" command of "File" menu. It is possible to use "Ctrl+N" or toolbar instead of "Start Aura-VibraImage main module" command of "File" menu.
If the double-click was used then main module is called with parameters of saved image. In this case after closing of the main module the current parameters of main module will not be saved.
Toolbar Toolbar (fig.41) replicates the following menu items respectively:
• Start Aura-VibraImage main module ("File" menu); • Print… ("File" menu); • White/Black background ("View" menu); • Refresh ("View" menu).
Fig.41 Toolbar (VIPrinter.exe)
Status bar Status bar (fig.42) shows the information about selected menu or toolbar item.
Fig.42 Status bar (VIPrinter.exe)
35
LogView module LogView module (LogViewer.exe) is designed for viewing and the analysis results of work VibraImage program.
Main window of LogView module (fig.43) consists of the following parts:
• main menu; • Information column (display parameters); • Area of supervision of schedules of results; • toolbar; • scroll bar (change time of viewing).
Fig.43(Main window of LogView module (LogViewer.exe)
LogView menu • File • View • Help
36
File menu "File" menu (fig.44) contains the following commands:
• Open file...Ctrl+N (opening file with results); • Save Log Ctrl+S (saving file with results); • Open AVI...(opening AVI file); • The list of last open files; • Exit Alt + F4.
Fig.44"File" menu (LogViewer.exe)
View menu The menu View (fig.45) contains the following items:
• Zoom In + ( design for change of scale of supervision of the information deduced{removed} in the field of schedules of results);
• Zoom Out - ( design for change of scale of supervision of the information deduced{removed} in the field of schedules of results);
• Play F5 (start viewing of files with results); • Pause F6 (pause viewing of files with results); • Stop F7 (stop viewing of files with results); • Grid… (To change time detailed elaboration of a conclusion of the
information(fig.46)); • Video (switch on/off display of a window of viewing of the videoimage in
an information column).
Fig.45 Menu View (LogViewer.exe)
37
Fig.46 Menu Grid (LogViewer.exe)
Help The menu Help (see fig.47) contains the following items:
• About LogViewer...
Fig.47 Help menu (LogViewer.exe)
Use "About LogViewer." command to view the information about software version and registered user name.
38
Toolbar Toolbar (fig.48) replicates the following menu items respectively:
• Open; • Zoom In; • Zoom Out; • Start; • Pause; • Stop; • Set marker.
Fig.48 Toolbar (LogView.exe)
39
Aura Interpretation
VibraImage system gives different technical possibilities for emotions recognition, but typical users prefer to characterized person by aura on real image. Aura based on vibraimage allows clearly and visually demonstrate psychological and physiological state of human being. Short interpretation of aura colors and forms follows below. This short information does not limited but only gives to user the main directions of person analysis. Every user after application experience could greatly diversify, extend and intensify knowledge about mental and aura of individual. Brief aura color interpretation
Red- activity and aggression color Yellow – trouble and tension color Green- normal activity and top condition color Blue- rest and calm color Violet- tiredness color
Aura colors irregularity and non-uniformity characterized unbalanced state and character of person.
Brief aura form analysis
− Any aura asymmetry (form, color) characterized about deviation from mental or physiological norms.
− Any breaks in aura uniformity characterized about deviation from mental or physiological norms.
− Ideal aura has mono color, symmetrical and uniform. Any real aura differs from ideal and the question of interpretation is to characterized real aura deviations.
40Note This brief aura interpretation right for default vibraimage system settings and based on main rules for right vibraimage scanning:
- uniform and stable object illumination; - high quality and low nose camera application; - frontal plane object before camera; - maximum facial image size on monitor; - mechanical stabilization of camera.
Detail description of right vibraimage adjusting includes every part of this document. Samples of human being aura visualization Normal and top conditions Normal condition characterized by aura color and form uniformity around the head, relevant monochrome color in the middle of suggested color scale. Activity level is about 0.3-0.6. Stress level is about 0.2-0.5. Tension level is not more than 0.4. Every emotion level measured in the range from 0 till 1,0 and minimal value coordinates with minimal emotion intensity. Frequency distribution histogram is near normal (Gauss) distribution and spectrum of high speed vibraimage signals is near exponential distribution. Aura photos samples for normal condition of person are below:
Fig.1 Aura photos samples for normal condition of persons.
41Stress state or condition Stress state characterized by amount gaps in aura form and greatly aura colors non uniformity. Aura includes every scale colors and sharp color transfer, like red color could transfer to blue. Stress level more than 0.7 Aggression or activity level is low, not more than 0.5 and tension level is high and usually more than 0.4 Frequency distribution histogram has several modes and high speed vibraimage signals spectrum presents superposition of exponential and uniform distributions.
Fig.2 Aura photos samples for stress condition of persons. Aggressive and/or tension state Aggressive state is not every time coordinates with tension, and tension state is not always coordinates with aggression. But often this two emotions accompany each other. Aggressive state obligatory characterized by high frequency vibrations and red colors in aura. Aura size is more than normal and gaps could absent, but color and form non uniformity must present. Stress level could be low, less than 0.3 Anger level more than 0,7 and tension level more than 0.4. Frequency histogram distribution has maximum in right part of the range and distribution has amount dispersion. High speed signals spectrum envelope looks like uniform distribution.
Fig.3 Aura photos samples for aggression condition of persons.
42
Emotions recognition by vibraimage
Head movements in space classically associated with vestibular system are studied and discussed in relation to the status of vestibular reflexes (i.e., the vestibuloocular, vestibulocollic, and cervicoocular reflexes). But it is possible to look on head movements according to the vibraimage system and technology. We supposed that head balance for person without consciously movements could be considered as isolated thermodynamic system and any emission of internal energy would change the balance of this isolated system and realized by movements or vibrations. Every emotional state characterized by specific energy conversation and work done by the system transfers to micro vibrations, if the person forced to stand or seet still. The head vibtration parameters (frequency in range 0,1-10 Hz and amplitude) are stable in time for stable emotional state of person. Parameters of vibrations changed only after emotional state alteration. VibraImage technolgy allows to contactless register of person vibration parameters and calculates emotions according to accomulated statistics of comparitive testing with EEG, skin galvanic reaction and psychological testing. VibraImage technics, parameters and research results are below. VibraImage equipment It is possible to use standard video system for vibraimage registration, like web cam or digital camera, or analogue camera with digitizer. The camera resolution was 640*480 and vibraimage quality highly depends on camera noise. The best results were achieved with easy AVerCam, web cam with 1/3 inc image CMOS sensor. The computer was also standard NB Samsung P40 TV001 with PentiumM2000 processor and VibraImage 6.1 software from Elsys Corp. The camera stands about 0,5 m near the tested person and head was large visible on the monitor. VibraImage parameters Amplitude and frequency of human head vibrations differs in every point of space and total processing of this every point meaning could present integral movement parameter of person. Some vibraimage pictures of one person reflects amplitude (Fig. 1) and frequency (Fig. 2) space distribution of vibrations are showed below visualized by color scale (Fig. 3):
43
Fig. 1 Fig.2 Fig. 3 Based on this two primary images are calculated about 20 integral vibraimage parameters reflects different types of movement and vibration divided into 4 main groups:
A- amplitude parameters; B- frequency parameters; S- symmetry parameter; P- space and time processing parameters.
Frequency histogram
Frequency histogram shows head movement frequency distribution for every pixel and for accumulated time period (default time period is equal 20 seconds). Some real samples histograms coordinated with emotions and energy levels are printed in this point. Figure 4 shows distribution histogram for person in normal conditions, both graphics approximately looks like normal (Gaussian) distribution. On Fig. 5 we see un normal human states, up graphic shows person with low energy level (very tired) and down graphic shows high energy emotions (anger).
44
Fig. 4
Fig. 5 Spectral analysis Spectral analysis of time dependence high speed vibraimage signals, also could informative reflects person emotions. Person in normal conditions has several time more low frequency square in vibration spectrum, than person in tension or aggression. On Figure 6 we see the sample of normal state person on up graphic and tension person spectrum on the down graphic.
45
Fig.6 EEG and VibraImage testing EEG is well known and informative psychophysiological testing, of course we adjusted and tested vibraimage system by comparative EEG testing. VibraImage signals recorded analogical EEG signals by developed VibraEEG system. Program menu with recorded information cite on Fig. 7
Fig.7
46Was calculated correlation between EEG signals and VibraImage signals in theta frequency range (4-8) Hz for person in still state (Fig. 8) and aggressive state (Fig. 9).
Fig.8
Fig.9 It is clear visible, that VibraImage parameters has strong correlation with EEG parameters for aggressive state and have not any correlation with EEG when person is still. That means that head motion depends on minds when person have high internal energy level, and head motion does not depend on mind activity when person is still, low energy and have not strong minds.
47
NOTES
Some parts of this system could be changed by the producer Elsys Corp. without notification. Information in this document is subject of change without notice.
Dispose of this product in accordance with Local and National Disposal Regulations.
Licensed users could download the latest version of VibraImage software by the link http://www.elsys.ru/index_e.php
2007, Elsys Corp. All rights reserved.
Send the questions about any applications of VibraImage technology by e-mails:
