Praxis® 101 and ETS® Data Manager for PRAXIS The Praxis ... · PRAXIS® 101 Terry Owens, Client...

PRAXIS® 101

Terry Owens, Client Relations Director

April 28, 2015

Praxis® 101 and ETS® Data Manager for The Praxis Series® Test Tutorial

Terry Owens, Client Relations Director

April 28, 2015

Copyright © 2015 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING. LEARNING. LEADING., GRE, THE PRAXIS SERIES and PRAXIS are registered trademarks of Educational Testing Service (ETS). PROETHICA is a trademark of ETS. All other trademarks are property of their respective owners.

Today’s Topics• Background and short history of ETS

• Licensure testing and The Praxis Series® tests

• Test development/regenerations and multistate standard setting studies

• Score Reporting

• Support for State Agencies, IHEs and Test Takers

• Test prep

• Data Manager Tutorial

• Open Lines: Answers to Your Questions

2


Background of ETS• Nonprofit organization, founded in 1947

− ACE, Carnegie Foundation, College Board®

• Mission: Advance quality and equity in education for all people worldwide

• Develop, administer, score

− 50+ million assessments

− 180+ countries

− 9,000+ locations worldwide

3


About ETS

• 3,300+ employees • Plus 2,500 at Prometric® • 1,000 advanced degrees• 400 doctorates• 1,100+ have training/expertise in education,

psychology, stats, psychometrics, computer sciences, sociology and the humanities

• ETS is the world’s largest private educational assessment and research organization

4


Our Mission: Advancing Quality and Equity in Education Worldwide

• Producing fair, valid and reliable assessments

• Measuring knowledge and skills

• Promoting learning and educational performance

• Supporting education and professional development

• Conducting world-class educational research and providing related services

5


ETS’s Guiding Principle: Supporting Opportunities for All Learners

• Founders − Harvard President James Conant and ETS’s first leader Henry Chauncey ─ envisioned an organization devoted to educational research and assessment

• They believed an organization devoted to research and testing could advance education in the United States by expanding educational opportunity to all learners

James Conant

Henry Chauncey

6


ETS/Praxis® Timeline

ETS is incorporated

National Teachers Exam (NTE) -project which

would become the Praxis Program

GRE® becomes the first

nationally administered admissions

exam offered on computer

NTE becomes

The Praxis Series®exams

SCRIBE installed, the

first major high-speed

computerizedtest scoring

system

Missouri Performance Assessment

1947 1948 1960 1992

ETS School Leaders Licensure Assessment (SLLA

and SSA)

Praxis Performance

Assessments for Teachers (PPAT)

Georgia Assessments for the Certification

of Educators® (GACE®)

ETS acquires

Prometric®

1993 2009 2012 2014

Entire Praxisprogram is computer delivered

2006 2007

Customized offerings

included Texas Educator

Certification Program

2015

IPT roll out; Continuous

testing begins phasing in;

New test dev.

7


ETS Set the Standard

• Experts in research, test development, psychometrics, statistical analysis, linguistics and global assessment, and specialists in education policy

• Helped build the science and practice of educational measurement

• Standards are used not only in our tests, but also by our competitors

• Built a strong chain of validity evidence from assessment development through adoption and administration

• Strong validity/reliability reduces legal challenges

8


World Leader in Education Research

9


• Princeton, NJ (Headquarters)

• Ewing, NJ

• Concord, CA

• Sacramento, CA

• San Francisco, CA

• Washington, DC

• Tampa, FL

• New York, NY

• Philadelphia, PA

• San Antonio, TX

• Olympia, WA

• Hato Rey, Puerto Rico

• China

• France

• Jordan

• Korea

• Poland

• The Netherlands

• United Kingdom

• Canada

National and International Locations

10


Teacher Licensure and Certification• Praxis® tests are used by 39 states and territories• Praxis® Subject Tests include 90 subject area assessments

– Praxis® Core Academic Skills for Educators (replaced Praxis I® tests)– Principles of Learning and Teaching (4 levels)– Elementary Education (Multiple test choices)– Ten Special Education tests– Specialty tests: School Psychologist, Speech Path, Audiology, Gifted,

Journalism, Braille, Citizenship ...– World Language tests for French, German, Spanish and Chinese Mandarin

(We also have Latin)– New subject area tests for Computer Science and Algebra

• Praxis® Performance Assessment for Teachers (PPAT)

11


Additional ETS Assessments

• ProEthica™ Assessments

• ETS® National Observational Teachers Exam (ETS NOTE)

• ETS Performance Assessment for Teacher Leader (PATL)

• ETS Performance Assessment for School Leader (PASL)

• School Leaders Licensure Assessment

• School Superintendents Assessment

12

Copyright © 2015 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING. LEARNING. LEADING., GRE, THE PRAXIS SERIES and PRAXIS are registered trademarks of Educational Testing Service (ETS). PROETHICA is a trademark of ETS. All other trademarks are property of their respective owners. 13


Test Regeneration

• Keeps content fresh, relevant and current with changing requirements for prospective teachers

• Provides tests aligned to most current standards

• Continue to provide valid and reliable measures

• Annual confirmation of specifications performed by a committee of experts

14


Annual confirmation of specifications by a committee of experts to answer the following questions:

1) Do the test specifications still represent knowledge and/or skills that are important for competent, beginning-level practice?

2) Are there areas of knowledge and/or skills that are not included but are critical for competent, beginning-level practice?

3) Are changes on horizon that could impact these specifications in the future, either at the national level or within your state?

15


Test Development – Standard Setting• Multistate Model

– Usually 2 national panels per test – States are asked to nominate up to 6 panelists per test – Result is a recommended score and each state sets their own score

• State Standard Setting Model – For tests a state is adding to existing requirements – Need a 12−15 member panel per test – Result is a recommended score and state sets the score

• Test Reviews – Done within a state with approximately 5−12 educators – Review of tests, multistate technical reports and available data – Panelists recommend cut scores to state after reviewing performance

data, requirements of other states and other pertinent information

16


Score Reporting• Multiple-choice test scores

– Unofficial score results viewed immediately at test center at conclusion of test

– Official score reports available by web 12 business days after the test date (in windows, 12 days after window closes)

• Constructed-response test scores – Official score reports available by web 17 business days after the

test date (in windows, 17 days after window closes)

• Scores are posted on the web for download and print for one full year

17


Continuous Testing

• Project well underway to move all multiple-choice tests to continuous model

• Moving from post-equating to pre-equating and new test design

• Work has begun for fall 2015 rollout– Expecting 80% of the volume by 2017

• Benefits– More availability for candidates– Will include all MC tests (even low volume)– Quicker “official score” turnaround

18


ETS Services to Agencies and IHEs• Separate Dedicated Web Portals for Agencies and IHEs

• Standard Setting Studies; Technical Reports on results

• Annual Change updates; annual and regional meetings

• Dedicated client relations director and tech support

• Access to ETS® Data Manager(Multiple levels, updated weekly)

• Title II Services

• Praxis® client newsletter, research and policy reports

• Participation in test development and regeneration (NACs and MSSS panels, and test development committees)

• Test Prep to assist students

19


ETS Services to Candidates

• Full service Praxis® website

• Test requirements listed for each state agency

• Test prep materials – most are free

• Online registration 24/7 (no registration fee)

• Phone and email support

• Candidates can designate four score recipients – free

• Testing accommodations available

• Free webinars – live and recorded for on-demand

20


Praxis® Website


Praxis® Website


• Free, comprehensive Praxis® Study Companion consolidating:

─ Test at a Glance (TAAG)

─ General Info and Study Tips

─ Sample questions

─ Study Plan document

• All titles completed

• Merged Study Guide information into an expanded Study Companion

23


“What to Expect on Testing Day” Video

www.ets.org/praxis/testday

24

http://www.ets.org/praxis/testday


“Strategies for Success” Video

www.ets.org/praxis/strategiesforsuccess

25

http://www.ets.org/praxis/strategiesforsuccess


Computer-delivered Testing

Demonstration

26


Interactive Practice Tests

• Interactive Practice Tests underway for every title • Value Pack is available for Core and Elementary

Education Multiple Subjects tests• Over 50 titles available now, remainder rolling

out this year• Correct/Incorrect answers with explanations• 10 uses or 90 days • 20% volume discount for institutions

27


ETS® Services: Data Manager

28

Questions?

ETS® Data Manager for The Praxis Series® Tests

Karen Palmeri, Product Manager andSharon Temmer, Product Manager


What it Contains

• Access to individual score reports

– Download reports

– Look up individual student scores

• State-of-the-art data analysis and reporting

– Analyze data across delivery methods

– Analyze performance throughout testing year

31


Features

• Free service

• No encryption software needed

• Data refreshed weekly on Monday evenings– Web service offers a server-to-server connection

for score reporting

• Email notification sent when new scores are available

32


Access

• Easy-to-use, web-based interface

– Available 24/7 over the web

• One Primary User with multiple Secondary Users

• Each user has full and independent access

33


Test-Taker Score Report Features

• Retrieving data by specific report date and testing program

Report by Report Date

• Search by first name, last name, Social Security number or candidate identification number

Search by Keyword

• Create a report containing test takers who reported to the Designated Institution within a selected year

Annual History Report

• Search by specific test, test date, date range and variable

Advanced Search

34








Fields Provided in Export:• First and Last Name• Candidate ID #• Date of Birth• SSN• Address, City, State, ZIP Code• Test Date• Test Name• Score• State Passing Score• Pass/Not Pass Status• Report Date• Category Points Earned and Available



Overall Design of Quick and Custom Analytical Reports

• Commonly requested information in a preset design

Quick Reports

• “Designer” feature that allows the user to design and customize reports from scratch

Custom Reports

• Location to save reports created in Custom Reports

My Projects

43


Difference Between Attending and Designated Institutions

• Attending Institution (AI) – School selected by test taker indicating the location where

training for the test was received

– Scores not automatically sent to the selected AI

• Designated Institution (DI)– Location selected by the test taker indicating where score

report should be sent

– Test taker must list their agency in order to get scores (Exception: state agencies in automatic reporting states)

44


Comparison of Features

Feature Quick Reports Custom Reports

Steps to Results Select Criteria Select Criteria; Select Variables; Edit Reports

Date Ranges Testing Years (Sept. – Aug.)

Fully customizable(down to individual months)

Variable Options 9 categories 33 categories

Statistic Options 9 (available based on quick report chosen)

9

Duplicate Candidate Options 2 4

Create Charts/Graphs No Yes

Customize Layout/Report Type No Yes

Export Formats HTML, PDF, Word, Excel® HTML, PDF, Word, Excel®

45













Contact Information

Email Address: [email protected]

Website: https://tlcs.ets.org

Additional Information:www.ets.org/praxis/institutions/services_tools/data_manager

57

mailto:[email protected]

https://tlcs.ets.org/

http://www.ets.org/praxis/institutions/services_tools/data_manager

Date post:	25-Sep-2020
Category:	Documents
Upload:	others
View:	12 times
Download:	0 times

Praxis® 101 and ETS® Data Manager for PRAXIS The Praxis ... · PRAXIS® 101 Terry Owens, Client...

Documents