Overview of DRC

• Founded in 1978– Privately held– 550 regular employees – 4,000 seasonal/temporary

employees

• Mission– To be the preferred

provider of high quality differentiated services to our clients.

Responsive • Flexible • High-Quality • Continuity of Relationships

Headquarters, Maple Grove, MN

Brooklyn Park, MN

Minnetonka, MN

Harrisburg, PA Austin, TX

Brooklyn Park, MN

Woodbury, MN Cincinnati, OH Harrisburg, PA

DRC Locations

Arlington, VA

Olympia, WA – Opening soon

DRC Services

• Survey Research Services– Customer satisfaction surveys– Organizational surveys– Educational surveys—district, teacher, parent– State curriculum evaluation instruments– DoD DIACAP Certification

• Document Services– Advanced data and document solutions– High-speed variable digital printing and mailing services– Offset printing of scannable forms– Full service digital print and fulfillment operations– 88 million digital impressions annually

DRC Services

• Education Services– Full-service, customized solutions for statewide assessment

programs– Summative and formative assessments, paper-based and online– Item and test development– State-of-the-art item bank– Secure materials packaging, distribution, and collection– Image and OMR scanning and scoring– Performance assessment – Psychometric services

Document Services

• DRC provides advanced data and document services and unique technology solutions– Producing the highest

quality documents and mission critical communications

– Enabling highly customized materials and communications for educational assessments, commercial and federal clients

– GPO Level II Certified Printer

Document Services

• Data Collection Processes & Forms– Custom and standard, data collection forms that are designed and

printed to exacting specifications to guarantee the highest possible data integrity

– Cut, continuous, and booklet production, document numbering (litho codes, human-readable serial numbering, bar-codes and highly customized finishing solutions)

• Variable Data Printing – B&W and Color Digital– Seamless, integrated solutions in the variable intelligent printing

arena. High-speed merge-print and intelligent insert capabilities. – Short-run, digital color capabilities– Digital or inkjet print technologies (document personalization) – Intelligent inserting and packaging

• Camera system – ensuring and verifying accuracy

– Bar-coding & MICR numbering – Direct mail services

Education Services

• One of the most experienced educational testing contractors in the nation

• Responsibility for projects involving the testing of over 4 million students nationwide

• Current education contract base includes assessment projects for 12 states– Alabama – North Carolina– Alaska – Ohio– Idaho – Oklahoma– Louisiana – Pennsylvania– Maryland – South Carolina– Nebraska – Washington

Test Development

• Test Development Team– A commitment to quality at every stage of the item and test development process– A team of experienced test developers, with a solid base of knowledge in areas of

content expertise

• Developing Tests– DRC follows a series of steps, uniformly recognized as industry standards– Steps are in alignment with the Standards for Educational and Psychological

Testing– Goal is to enhance educator’s understanding of the link between assessment and

instruction

• What we do:– Develop test designs and item specifications– Write, review, and revise items– Construct test forms to meet content and psychometric parameters– Develop test ancillaries– Conduct content, bias, and item/data reviews– Develop performance-level descriptors– Facilitate standard setting committees– Develop professional development materials and conduct workshops

– Item Analysis

– Application of Item Response Theory

– Scaling and Equating

– Differential Item Functioning

– Setting Performance Standards

– Reliability and Validity Studies

– Test Form Construction

– Computerized and CAT Testing

– Training Workshops

– Technical Reports

– Research Design/Consulting

– Special Studies

Psychometric Services

• Provide high-quality, experienced, and personalized psychometric guidance and support for our clients

• Quality procedures in all work

• Highly qualified psychometricians and statisticians with applied experience in supporting high-stakes testing programs

• A complete range of psychometric services

State Government Educational Assessment ContractsAlabamaAlaskaIdahoLouisianaNebraskaNorth CarolinaMarylandOhioOklahomaPennsylvaniaSouth CarolinaWashington

PartnersAmerican Institutes for Research (AIR)Educational Testing Service (ETS) Measurement Incorporated (MI)Pacific Metrics (PacMet)Riverside Publishing (Division of Houghton Mifflin)University of Kansas, Center for Educational Testing and EvaluationWestEdWestat

Federal GovernmentArmy Research Institute (ARI)Defense Finance & Accounting Service (DFAS)Defense Manpower Data Center (DMDC)Health and Human Services (HHS) Medicare

Financial ServicesThe HartfordRBC Dain Rauscher

ManufacturingThe Boeing Company CaterpillarSubaru of America

HealthcarePfizer Animal HealthPrivate HealthcareQuest DiagnosticsUniversity of California— Los AngelesUniversity of Minnesota

Travel & LeisureHilton HotelsBest Western Hotels

Representative Client ListAmong All Service Areas

Approach to Quality:

• A Way of Managing– Vice President of Quality and dedicated Quality Assurance staff:

• Director of Quality–Operations• Sr. Director of Software Quality Assurance• Director of Quality–Psychometric Services

– Focus on defining and implementing critical quality control processes, procedures, and metrics on Project Delivery process

– Focus on collaborative, continuous improvement– Management audits of processes and corrective action system– ISO 9001:2000 Certified

Survey Services

• Pre-survey consulting & analysis

• Design, printing & distribution

• Multi-mode• Project management• Post-survey consulting

& analysis• Secure access & data

security• Incoming call center

support

Survey Services

• OMR scanning, imaging & processing

• Comment coding & processing

• Data file & database management

• Reporting• Full Service Provider of

Scannable Surveys• Produce over 6 million paper

surveys • Process 2.5 million paper

surveys• Send over 2 million web

surveys• Process 600,000 web

responses

Research Data Collection • Operational Expertise

Research and Data Collection

• Nationally recognized– 30 years of expertise in multi-

mode surveys

– Participant populations ranging from 500-1,000,000+

– Proven track record • Federal government & Fortune

100

• Expertise covers full range– Design

• dual-mode, multiple versions, multiple languages, global locations and sensitive content

• short focused surveys (single business units, special topic PULSE surveys)

– Management

– Execution

– Reporting

Clients

• The Boeing Company• Subaru of America, Inc.• Caterpillar, Inc.• Trane • Quest Diagnostics• The Hartford • CVS Caremark/Caremark• Department of Defense• The United States Army • Higher Education Research

Institute (UCLA) • The Search Institute• Pfizer• 21st Century Insurance

IT Security - DIACAP

• DRC has received the Department of Defense’s (DoD) Information Assurance Certification and Accreditation Process (DIACAP) certification

• All DRC information systems that transmit, collect, store, or process DoD information are accredited in accordance with DIACAP

• DRC has been given DoD’s Authority to Operate (ATO), by the Department of Defense, Human Resources Activity, Defense Manpower Data Center

Project Design & Management • Process consultation• Best practices• Project management• Communication plan

Data File & Database Management• Survey data tracking and link to data file• Comment cleaning and coding

Reporting• Response rate reports• Group data reports• Comment reports• Cross-tab results• Data results in Excel

Customized Survey Design & Distribution• Communication & survey distribution via the web, phone or paper/mail

Data Collection• Web, scanning or key

entry based process• Secure access & data

security• Data & comment

processing• Call center

Feedback & Action Planning• Guide and training• Follow up analyses

On-line Pilot Test• Usability test• Adjust deployment plan

accordingly

Survey Process

Web Survey Features

• Unique E-mail invitations

• Save & return feature

• User-friendly

• Progress bars

• Custom branding

• Complex skip patterns

Custom Data Reporting Capabilities• Develop & host unique reports

Summary Reports

How would you rate the overall importance of each of the following factors when selecting a specialty hospital to refer your cases?

Specific Question Summaries

How many patients have you referred to specialists at other referral hospital (s) in the past year?

Data Reporting Options

• Custom cross tabulated results (examples):– Function– Site– Tenure– Organizational structure– And more…

• Participation data– Demographic group– Functional organization– Response time per item– And more…

• Reports are hosted via secured web site• Multiple export options available

– PDF, PowerPoint, Excel, ASCII

Comment Processing

DRC provides several options assisting our clients in getting the most out of open-end comment data including:

• Code list development– Themes/Topics

– Value/Emotional Content

– Demographics

– Positive/negative

• Cleansing• Verbatim transcription• Open-End Editing• Survey Image Capture

– For archiving & retrieval of actual survey

• Hot comment process• Executive escalation

Leadership Attributes 360: Overview• Highly customized to Client and

individual user

• Option for web or paper completion for all action steps

• Individuals are guided through the Assessment process, timelines and system

• Custom messages and correspondence to all participants

– Managers, Approving Managers, Raters, or Partners

• Highly flexible to accommodate program “exceptions”, assigned timelines and expedited reporting

• Reports allow for easy monitoring of progress at varying levels of detail

• End-of-cycle statistics and reports

Feedback & Action-Planning Support• Basic

– Customized materials• Feedback and action–planning guide

• Templates: PPT and action-planning forms

– Define with client distribution of materials, and training requirements

• Train-the-trainer– All materials (as above)– On-site DRC-lead group training available– Training: Results interpretation, feedback

sessions, action planning process – Client trainers roll out to the organization

Consulting Services

• Conduct ad hoc / special topic research– Literature and research reviews of specific topics (e.g., Provide

reports/white papers on rating scales, multi-cultural deployments)

• Improve follow-up processes– Create and refine customized action-planning supports

• Ensure alignment with existing development and PMP processes

• Map internal and external resources for improvement (e.g., classes)

• Identify top performers and capture best practices

• Identify significant career experiences and opportunities

• Articulate specific suggestions for improvement

– Provide accountability and tracking metrics• Track creation and submission of action plans

• Examine completion of milestones for individuals, groups,

• organizations

A Partner in Applied Research

• Past presentation, publication, topics – Automated content analysis of 360

comments – 360 Feedback and Organizational

ROI– Leveraging Online Technology in

Organizational Surveys– Improving web surveys via Usability

Testing – Impact of web comment length on

quality– Linkage research – Maintaining anonymity and

confidentiality in web surveying

Partnership Opportunities

• DRC is interested in best-in-class partnerships– Operational Excellence (back-end services)– Quality and Integrity– DoD DIACAP IT Security Authorization– Subject Matter Expertise– Prime/Subcontractor opportunities

• What we’re looking for in a partner– Quality and Integrity– Subject Matter Expertise– Prime/Subcontractor opportunities– Industry Expertise

www.datarecognitioncorp.com