ni.com
Fanie Coetzer, Field Sales Engineer
Northern South Africa
Building a Next Generation Data Logging System
3 ni.com
Outline
Introduction to the Next Generation of Data Logging
Signals and Signal Conditioning
Data Logging Hardware Platforms
Data Logging Software
Timing, Triggering, and Synchronization
Logging Data
Visualizing Data
5 ni.com
Moore’s Law at Work in Data Logging Transistor count by date of introduction
• “We foresee the need for DAQ systems that not only acquire data over a network, server, or PCs but also provide intelligence to help with the decision-making process.”
• Mariano Kimbara, Senior Research Analyst, Frost & Sullivan
6 ni.com
Moore’s Law at Work in Data Logging Hard Drive Price Per Gigabyte
$0.01
$0.10
$1.00
$10.00
$100.00
$1 000.00
$10 000.00
$100 000.00
$1 000 000.00
1980 1982 1984 1986 1988 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008
Apple: 5 MB @ $3,500
Seagate: 1 GB @ $849
Seagate: 750 GB @ $200
7 ni.com
Next Generation Data Logging System Take advantage of the latest COTS technologies
Device 1
Device 2
Data Bus
Nonvolatile Storage
Intel CPU
Memory Controller
Timing Controller
FPGA Bus Technology Processors ADC Storage
8 ni.com
Future Capabilities of Next Generation Logging Systems
Visualization Ability to quickly create custom user
interfaces on tablets and smart phones
Storage Increased storage capacity and logging
to the cloud
Application Software Software customizable on mobile devices
I/O Rates and Timing Faster rates and more custom timing options
Processing More advanced inline analysis and
signal processing
Size and Ruggedness Smaller, more rugged systems based on Intel’s Atom and ARM Connectivity
Better wireless connectivity and synchronization
(Wi-Fi, cellular, Ethernet, IEEE 1588)
9 ni.com
Building a Next Generation Data Logging System Condition Monitoring System
• Requirements:
Measure vibration, speed, and temperature
Rugged, stand-alone system
Flexible software for custom user interface
Correlate all measurement to same timebase
Log data to local nonvolatile storage
Integrate video streaming synchronized to sensor data
View and manage data in a simple tool
Playback all sensor data and video side-by-side
10 ni.com
Mixed-Measurement Applications Are Diverse
Pressure Temperature Force Strain
Vibration Torque Displacement
11 ni.com
Building a Next Generation Data Logging System Choose My Sensors and Signal Conditioning
Sensor, Etc. Signal Conditioning
Temperature: 2 x Thermocouples
Amplification, Cold-Junction Compensation, Filtering
Vibration: 2 x IEPE Accelerometers
Amplification, IEPE Excitation, Filtering, AC Coupling
Video: 1 x Camera
None
12 ni.com
Building a Next Generation Data Logging System Condition Monitoring System
• Requirements:
Measure vibration, speed, and temperature
Rugged, stand-alone system
Flexible software for custom user interface
Correlate all measurement to same timebase
Log data to local nonvolatile storage
Integrate video streaming synchronized to sensor data
View and manage data in a simple tool
Playback all sensor data and video side-by-side
13 ni.com
Overview of NI Data Logging Platforms
Embedded Measurements
Mix and match a variety of modules, designed for continuous, stand-alone
measurements
Measurements with Control
Design a measurement system with highly
customizable onboard timing and signal
processing
High-Performance Measurements
Optimize for high-channel count systems and tight
synchronization
Stand-Alone NI CompactDAQ CompactRIO PXI
14 ni.com
Embedded Controller
C Series I/O
C Series I/O
What is Stand-Alone NI CompactDAQ?
C Series I/O
Chassis (NI-STC3)
15 ni.com
Signal to Backplane
Isolation Barrier Safety, noise immunity,
common mode rejection
Built-in Signal Conditioning Direct connection to sensors for
temperature, pressure, acceleration, strain, load cell, current and so on
High Quality Measurements Streaming up to 1 MS/s
and 24-bit resolution
Guaranteed Accuracy NIST traceable calibration
NI C Series I/O Modules Integrated DAQ, Signal Conditioning, & Connectivity
16 ni.com
Building a Next Generation Data Logging System Choose My Platform and Modules
Web Cam Thermocouples Accelerometers Tachometer
Stand-alone NI CompactDAQ System: cDAQ-9139 C Series Modules: NI 9211, NI 9234
17 ni.com
Building a Next Generation Data Logging System Condition Monitoring System
• Requirements:
Measure vibration, speed, and temperature
Rugged, stand-alone system
Flexible software for custom user interface
Start acquisition off of a hardware trigger
Correlate all measurement to same timebase
Log data to local nonvolatile storage
Integrate video streaming synchronized to sensor data
View and manage data in a simple tool
Playback all sensor data and video side-by-side
18 ni.com
LabVIEW Has Been Proven Over Nearly 30 Years… Withstanding the test of time across operating systems, buses, technologies, and more
19 ni.com
LabVIEW abstracts low-level complexity and integrates all of the tools engineers and scientists need to build any measurement or control system.
Parallel Programming Easily create independent loops that automatically execute in parallel.
Analysis Libraries Use built-in high-performance analysis libraries designed for measurement applications.
Hardware Connectivity Bring real-world signals into LabVIEW from any I/O on any instrument.
Measure in Minutes Reduce development time with abundant sample projects and templates.
Unified Software Solution Manage and organize all
system resources in a single software environment.
Integrate Existing Code Combine and reuse .m files,
C code, and HDL with graphical code.
Deployment Targets Deploy LabVIEW code to the
leading desktop, real-time, and FPGA hardware targets.
Convey With a Clear UI Create modern user interfaces to display
measurements and results.
Accelerate Your Productivity With LabVIEW
20 ni.com
Chameleon for NI CompactDAQ by PVI Systems For Structural Test and Monitoring Applications
Configuration-based software, powered by LabVIEW
Acquire static and dynamic signals
Measures voltage, current, vibration, strain, and temp
Runs directly on stand-alone NI CompactDAQ
Supports over 20 modules and USB, Ethernet, and stand-alone chassis
"Using Chameleon turnkey software based on NI LabVIEW and DAQ software, we can measure more than 32 channels of pressure data from our sensors with expansion capabilities while maintaining time-synchronized data from transient shot events on the firing range.” -Raytheon BBN
21 ni.com
Building a Next Generation Data Logging System Choose My Software
Web Cam Thermocouples Accelerometers Tachometer
Stand-alone NI CompactDAQ System: cDAQ-9139 C Series Modules: NI 9211, NI 9234
LabVIEW System Design Software
22 ni.com
Building a Next Generation Data Logging System Condition Monitoring System
• Requirements:
Measure vibration, speed, and temperature
Rugged, stand-alone system
Flexible software for custom user interface
Start acquisition off of a hardware trigger
Correlate all measurement to same timebase
Integrate video streaming synchronized to sensor data
View measurements remotely from tablet
Log data to local nonvolatile storage
View and manage data in a simple tool
Playback all sensor data and video side-by-side
23 ni.com
NI CompactDAQ Timing Basics
• Analog input, analog output, digital input, digital output tasks
• Sample Clock can be generated from internal or external source
Timing Option Description
Finite Samples Acquire or generate a configurable number of samples at a configurable rate.
Continuous Samples Acquire or generate samples continuously, until explicitly stopped by the API.
Hardware-Timed Single Point Acquire or generate samples continuously on the edge of a hardware clock.
24 ni.com
7 Hardware-Timed Streams
• Built-In Timing Engines - 3 Analog Input
- 1 Analog Output
- 1 Digital Input
- 1 Digital Output
• Additional Timing Sources - Counter/Timers
- External PFI Lines
26 ni.com
Building a Next Generation Data Logging System Condition Monitoring System
• Requirements:
Measure vibration, speed, and temperature
Rugged, stand-alone system
Flexible software for custom user interface
Start acquisition off of a hardware trigger
Correlate all measurement to same timebase
Log data to local nonvolatile storage
Integrate video streaming synchronized to sensor data
View measurements remotely from tablet
View and manage data in a simple tool
Playback all sensor data and video side-by-side
27 ni.com
Reducing Logged Data with Event-Based Logging
Post-Trigger Data Data acquired after a detected event is often logged with more granularity than pre-trigger data
Anomaly Detected Anomalous event could trigger
adjusted data acquisition behavior, e.g. faster data rates
Pre-Trigger Data Data acquired before an event can be stored in a buffer and later logged or simply discarded
Discarded Data Historical data exceeding the length of the buffer is discarded
28 ni.com
File Format Comparison
ASCII
Exchangeable
Small Disk Footprint
Searchable
Inherent Attributes
High-Speed Streaming
ASCII Binary
Exchangeable
Small Disk Footprint
Searchable
Inherent Attributes
High-Speed Streaming
ASCII Binary XML
Exchangeable
Small Disk Footprint
Searchable
Inherent Attributes
High-Speed Streaming
ASCII Binary XML Database
Exchangeable
Small Disk Footprint
Searchable
Inherent Attributes
High-Speed Streaming
ASCII Binary XML Database TDMS
Exchangeable
Small Disk Footprint
Searchable
Inherent Attributes
High-Speed Streaming
29 ni.com
Author = John Smith
Description = Test Drive
MyFile.tdms
Vehicle = Malibu
Track = East
TC_Type = J
Units = Deg C
Road_Surface = Paved
Engine Temperature
Test Run #1
TDMS File Format
• Single streaming binary file
• Three levels of hierarchy for better organization
• File, groups, and channels
• Customizable, descriptive properties at each level
• Extensible and Scalable
Property 1
Property n
Data Set (File)
Property 1
Property 2
Property 1
Property n
Property n
Channel(s)
Channel Group(s)
30 ni.com
Where should you save data?
Advantages Considerations
Onboard Storage • Onboard • Fastest
• Data access and retrieval • Limited disk space
USB Thumb Drive • Removable, swappable • Price per GB
• Slower throughput
USB HDD • Fast throughput • Removable, swappable • Large capacity
• Susceptible to vibration
USB SSD
• Fast throughput • Removable, swappable • No moving parts • Extended temperature
• Smaller capacities • Price per GB
Ethernet or Cloud Storage
• Large capacity • Network connectivity • Security
31 ni.com
Cloud Technologies
Data Cloud
Web-Based Thin Clients
Desktop Applications
Data Dashboard for LabVIEW
Stand-Alone NI CompactDAQ
LabVIEW
32 ni.com
IP Security Cameras • Supported brands:
• Basler Vision Technologies • Axis Communications
• Compressed images • 1-5 frames per second
(depending on resolution)
Vision Integration with NI CompactDAQ
Machine Vision, Scientific, Specialty Cameras • Available on Stand-Alone NI CompactDAQ • Full-frame rate, uncompressed images • GigE Vision, EtherNet, USB options
34 ni.com
Building a Next Generation Data Logging System Condition Monitoring System
• Requirements:
Measure vibration, speed, and temperature
Rugged, stand-alone system
Flexible software for custom user interface
Start acquisition off of a hardware trigger
Correlate all measurement to same timebase
Log data to local nonvolatile storage
Integrate video streaming synchronized to sensor data
View measurements remotely from tablet
View and manage data in a simple tool
Playback all sensor data and video side-by-side
35 ni.com
Flexible Visualization Options with Stand-Alone NI CompactDAQ
Headless Mobile
Local Remote
36 ni.com
Industry Trend: Integrating Mobile Devices
Data Dashboard for LabVIEW
Control and visualize data from LabVIEW systems on a tablet
37 ni.com
Ready to use data search and mining
Easy, flexible access to databases and files
Live data collection and display
Interactive analysis and report generation
Automation through VBScript
Data Management with NI DIAdem
39 ni.com
Building a Next Generation Data Logging System Condition Monitoring System
• Requirements:
Measure vibration, speed, and temperature
Rugged, stand-alone system
Flexible software for custom user interface
Start acquisition off of a hardware trigger
Correlate all measurement to same timebase
Log data to local nonvolatile storage
Integrate video streaming synchronized to sensor data
View measurements remotely from tablet
View and manage data in a simple tool
Playback all sensor data and video side-by-side
40 ni.com
Future Capabilities of Next Generation Logging Systems
Visualization Ability to quickly create custom user
interfaces on tablets and smart phones
Storage Increased storage capacity and logging
to the cloud
Application Software Software customizable on mobile devices
I/O Rates and Timing Faster rates and more custom timing options
Processing More advanced inline analysis and
signal processing
Size and Ruggedness Smaller, more rugged systems based on Intel’s Atom and ARM Connectivity
Better wireless connectivity and synchronization
(Wi-Fi, cellular, Ethernet, IEEE 1588)