+ All Categories
Home > Documents > A Methodology for Designing Scalable SDR...

A Methodology for Designing Scalable SDR...

Date post: 25-May-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
33
New England Software Defined Radio Workshop „13 Worcester Polytechnic Institute, May 17, 2013 http://sdr-boston.org Erich Whitney Group Leader, Lead Digital/Micro Hardware Engineer The MITRE Corporation Contributors: Hieu Nguyen, Karl Wagner, Joseph Chapman, Chuck Mazzola and Robert Reynolds The MITRE Corporation A Methodology for Designing Scalable SDR Systems Approved for Public Release; Distribution Unlimited. 13-2075
Transcript
Page 1: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

New England Software Defined Radio Workshop „13 Worcester Polytechnic Institute, May 17, 2013

http://sdr-boston.org

Erich Whitney Group Leader, Lead Digital/Micro Hardware Engineer The MITRE Corporation

Contributors: Hieu Nguyen, Karl Wagner, Joseph Chapman, Chuck Mazzola and Robert Reynolds The MITRE Corporation

A Methodology for Designing Scalable SDR Systems

Approved for Public Release; Distribution Unlimited. 13-2075

Page 2: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

MITRE‟s Software Defined Radio (SDR) development

encompasses a wide variety of applications across

communications, sensors, and navigation. This presentation

discusses MITRE‟s methodology used to develop large, scalable,

Field Programmable Gate Array (FPGA) based SDR systems. The

process starts with up-front radio frequency (RF) planning, then

explores analog and digital signal processing tradeoffs, and

completes with component-based waveform design,

implementation, verification, validation, and deployment. This

methodology, developed through many years of experience, has

resulted in multiple SDR systems successfully deployed to

sponsor operations, hand-off to military contractors, and ground-

breaking field experiments.

| 2 |

Abstract

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 3: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Introduction

Preparation & Planning

– Frequency Planning and RF Design

– Waveform Design Methodology

– Platform Preparation

– Documentation

Component-Based Design

– Waveform Integration

– Embedded Software Considerations

– Functional Verification

– Performance Validation

Standard Release Process

Conclusions

| 3 |

Outline

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 4: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 4 |

SDR System Design Process

Frequency Planning & RF

Design

Waveform Design

Methodology

Platform Preparation

Documentation Implementation Verification Validation Deployment

Preparation Component-Based Design

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 5: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

System Requirements

– Modulation

Data Rate

– Link Parameters

Transmit Power

Signal Propagation Characteristics

RF System Cascade Analysis

– NF, IP3, Gain, etc.

RF to Bits

– ADC Sampling and Dynamic Performance

Sampling Clock Jitter

RF/Analog Circuit Design

– Replace System Blocks with component design

Filters, Amplifiers, Mixers, IQ Demodulators, ADC

ADC Interface

Need to know your environment!

– Expected Interferers

– Channel Characteristics

| 5 |

Frequency Planning & RF Design

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 6: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 6 |

Example: Receiver System Level Plan

ADC Noise Floor -72.0 dBm ADC Max Spur

-98 dBm kTB

-55.0 dBm

-65.0 dBm

SINAD

64.6 dB

SFDR

-72.0 dBc

Amplified kTBFn

ADC Max 10 dBm

0 dBm Max Average

Interferance

Signal

- 40 dBm Max Interference Power

B = 40 MHz -130 dBm

Signal of Interest

-90.0 dBm NF_rf = 3 dB

NF_sys = 3.4 dB

SNR = -36.4 dB

C/No= 39.6z db-Hz

- 54.6 dBm Total Noise Floor J/N

90 dB

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 7: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 7 |

System Tools Used for Examining Trade-Offs

• System and circuit simulators

• Time Domain

• Frequency Domain

• EM

• Math Packages

• End to End System Level Simulation

• Define System Level Blocks

• Examine Tradeoffs

• Incorporate Circuit for Blocks

• Test critical subsystems/components

before PCB design

• Don’t take the manufacturer’s

word on it!

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 8: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 8 |

Waveform Design Methodology

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 9: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 9 |

IP Reuse is critical to our success

Wireless

GPS

Future

SDR

RADAR

SATCOM

Centralized IP Repository

Provides Centralized Control

& Flexibility for Change

Standardized Development &

Verification Methodology

Common Design

Environment

Increase

Collaboration

IP

Reuse

Component IP Reuse Across Projects.

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 10: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Code Development Process

RTL and C++ Coding Guidelines

Distributed Version Control

Online Code Reviews

Bug Tracking

Nightly Regressions

| 10 |

Industry Best Practices

Coding

Guidelines

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 11: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

WC1 WC2 WC3 WC4

Well defined interface at component boundary reduces ambiguity and increase porting efficiency

Take advantage of open non-proprietary interface defined by industry

IP porter only has to learn and understand one set of interfaces

Minimize number of gaskets needed during interfacing process

Allow waveform porter to treat every component as a black box

Document all the component configuration parameters

Enable developer to protect the underlying design implementation

Common interface also enables more automation in design flow

Common Interfaces

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 12: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

http://www.ocpip.org

Defines a Master/Slave, Initiator/Target relationship between components

Dataflow

– Master

Data

Cmd

– Slave

CmdAccept, ThreadBusy

Memory

– Master

Address, Data

Cmd

– Slave

Data

CmdAccept, ThreadBusy

| 12 |

Open Core Protocol-International Partnership (OCP-IP)

Master

Slave

I T

I T

Request Phase

Data Phase

Response

Phase

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 13: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

XML is a great way to capture IP metadata

– Interface Ports

– IP Source Files

– Design Parameters

Open source and scripting support

IP industry now embraces XML with IP-XACT

– IEEE 1685 IP-XACT Standard, June 2010

– Accellera IP-XACT Schema Technical Committee, July 2010

– SPIRIT XML Schemas provide a mechanism to exchange IP

across vendors and tools

| 13 |

Component Metadata

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 14: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 14 |

Waveform Design

FFT

h2(x) h1(x)

OC

P

OC

P

OC

P

OC

P

h3(x)

OC

P

OC

P

OC

P

OC

P

h4(f)

OC

P

OC

P

h5(f)

OC

P

OC

P

Virtual Platform

Model

Model

A combination of C++ and RTL

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 15: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Platform is the hardware support for the waveform

All hardware interfaces adapted to OCP-IP

Control plane is part of the platform design

External memory interfaces

High-speed serial data interfaces (chip-to-chip/board-to-board)

ADC/DAC and other I/O interfaces

Control plane infrastructure tied to a processor or processors

Exception handling (i.e. interrupts and error handling)

Debug interfaces (i.e. data capture buffers, read-back registers)

Clock and reset architecture

System bring-up support and hardware synchronization

Chassis/Backplane Support and Configuration

| 15 |

Platform Preparation

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 16: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 16 |

Platform Preparation

PCIe

SRAM

ADC

DRAM

DAC

MGTs

CPU GbE

LVDS

OC

P

OC

P

OC

P

OC

P

OC

P

OC

P

OCP Control Plane

OC

P

OC

P

Platform Infrastructure

BER

OC

P

BER

OC

P

Capture

Buffer OC

P

Pattern Gen

OC

P

OC

P

OC

P

OC

P

OC

P

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 17: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Platform preparation provides a “pipe-cleaner” application to

validate all necessary I/O interfaces

Waveform development may be done in stages where some

FPGAs are used in pass-through initially

Waveform partitioning requires breaking the data path at

appropriate places with high-speed data interconnect

Control plane device map created for software control

Waveform component initialization validation procedure

| 17 |

Waveform Integration

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 18: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 18 |

Waveform Integration

PCIe

SRAM

ADC

DRAM

DAC

MGTs

CPU GbE

LVDS

OC

P

OC

P

OC

P

OC

P

OC

P

OC

P

FFT

h2(x) h1(x)

OC

P

OC

P

OC

P

OC

P

h3(x)

OC

P

OC

P

OC

P

OC

P

h4(f)

OC

P

OC

P

h5(f)

OC

P

OC

P

OCP Control Plane

OC

P

OC

P

Complete Waveform

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 19: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Waveform Partitioning

New FPGA devices pack more resources (logic cells, Block RAMs, etc.)

Need to impose limit on resources per component to give porter flexibility during repartitioning

Oversized components may fit into larger FPGAs but not into smaller devices

Taking middle ground makes the waveform more portable

Lo

gic

s

BLK Mem

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 20: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Specifications

– Interface Definitions

– Architectural

– Functional

– Implementation (reference performance & utilization)

– Test Plan

User Documentation

– Provided to the end-user

Design Reviews

– Specification Reviews

– Code Reviews

– Verification Reports

| 20 |

Documentation

Documentation

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 21: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

| 21 |

SDR System Design Process

Frequency Planning & RF

Design

Waveform Design

Methodology

Platform Preparation

Documentation Implementation Verification Validation Deployment

Preparation Component-Based Design

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 22: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Inte

rface

I/O I/O I/O I/O

Target FPGA1 Target FPGA2

Data

Source

Tx

Data

Reta

rget

Component-Based Design

gasket3 gasket4 gasket5 gasket6

Data

Source

Tx

Data

Rep

art

itio

n

Wav

efo

rm

Data

Source

Tx

Data WC1 WC2 WC3 WC4

FPGA 1 FPGA 2

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 23: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Control and data flow

– Most data is processed by the FPGAs and moved between them

without CPU intervention (if possible)

– CPUs run control software which manages component

initialization and any real-time hardware interaction

API, user interface, and debug facilities

– API should provide a relatively architecture-neutral way to control

hardware and data flows.

– API used to create UI and allow for custom UI

| 23 |

Embedded Software Considerations

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 24: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Distributed processors for large systems

– Central CPU on SBC for primary control of system, some signal

processing (esp. altering data formats)

– Embedded CPUs on FPGA boards used for control of the FPGAs,

relaying commands from the central CPU

– Extra CPUs on SBCs for additional data processing (if needed)

– Proper coordination between CPUs is paramount.

| 24 |

Embedded Software Considerations (cont.)

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 25: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Embedded system typically contains:

– Ethernet infrastructure (GbE/10GbE, etc…)

Control and/or data channel

– Serial RapidIO (SRIO) and/or PCI-Express (PCIe)

Each has its benefits and drawbacks

Data channel

Can be used for control channel also

– Flash file system/boot loader

– Embedded OS, not always real time (RTOS)

VxWorks

Linux

| 25 |

Embedded Software Considerations (cont.)

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 26: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Boot time considerations

– Make booting as fast and reliable as possible

Middleware

– Multiple layers of middleware may be needed:

Communicate from CPU to FPGA in an architecture-agnostic manner

Data transmission between FPGAs

Robustness and error handling

– Reduce user interaction

| 26 |

Embedded Software Considerations (cont.)

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 27: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Components can be very complex

Constrained-random verification methodology provides a way to run continuous regressions for improved code quality

Functional tests are designed to detect a wide range of defects

Large waveform verification can be compute intensive

Platform verification creates additional challenges from complex interfaces

Comprehensive lab validation is key to verifying complex waveforms

Complete verification is a typically a hybrid approach where simulation and lab validation are used together

| 27 |

Functional Verification

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 28: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Performance validation is a process to characterize the overall system performance across a range of operational modes

Digital Loopback Testing

– Characterize and validate the digital performance

Bit error rate

Implementation loss

Noise performance

Analog Loopback Testing

– Characterize and validate the analog performance

Bit error rate

Implementation loss

Noise performance

| 28 |

Performance Validation

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 29: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Core of each waveform component can be encrypted to protect Intellectual Property (IP)

Automated repartition process using MITRE developed CAD tool

Allows porter to define FPGA boundaries and configure the waveform

Automatic RTL code generation and additional verification facility

Unlimited test vectors enable porter to exercise all different modes and configurations

(.XML) (Script)

RTL FPGA PARTITION

(.EXE) VECTOR GENERATION

RTL TESTBENCH

Standard Release Process

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 30: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Standard Release Process

Waveform delivered to contractor on Virtual Machine (VM) VM behaves like virtual computer that runs on a host machine

Setup with user account (username and password)

VM environment is pre-configured by MITRE Lab (OS, tools, scripts, etc.)

Three Layers of documentations Environment : Introduce tools, script, general usage

Application : Overview of waveform settings and performance results

Component : Functional description and interface parameters

The VM copied to external mini-drive with AES encryption Instructions to access mini-drive given after contractors receive package

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 31: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

SBC

FPGA Boards

ADC, DAC, and Fiber Interconnect

19” Rack Chassis

– High speed backplane

– Power supply

Transit Case

| 31 |

SDR System Components (OpenVPX Example)

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 32: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Large SDR systems are complex

Employing a structured, systematic methodology greatly

increases success

A “divide-and-conquer” strategy can be used to improve

schedule

Up-front planning and verification pays off in decreasing the

amount of time and money spent on back-end debug and

validation

| 32 |

Conclusions

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075

Page 33: A Methodology for Designing Scalable SDR Systemsecewp.ece.wpi.edu/wordpress/sdr-boston/files/2013/05/... · 2013-05-25 · MITRE‟s Software Defined Radio (SDR) development encompasses

Thank You!

| 33 |

Questions?

© 2013 The MITRE Corporation. All rights reserved. Approved for Public Release; Distribution Unlimited. 13-2075


Recommended