EMSTesting .com Instructor User Guide

ã Platinum Educational Group Phone 616.818.7877

0

P L A T I N U M E D U C A T I O N A L G R O U P

EMSTesting User Guide

EMSTesting.com offers you a faster, easier and more comprehensive way to prepare for your National Registry test and/or state certification exams online. We know the site has a lot of functionality behind it, so we have provided this guide to help you through the process of learning the site so you have the tools you need to use it effectively and confidently. As always, Platinum Educational Group provides exceptional customer service along with this guide. We are ready to help you whenever or wherever you need it by phone or email. We also provide ongoing live help webinars for you or your group. Do not hesitate to call us if you are unable to find the answers, we will be happy to take care of any questions you may have!

Phone: 616.818.7877 Help requests: https://platinumed.zendesk.com/anonymous_requests/new

To provide you with our very best customer service, we always welcome any comments or feedback you can provide to improve the EMSTesting.com web site and/or its functionality and usefulness to you. Sincerely, Doug Smith & Thomas Gottschalk Platinum Educational Group

ã Platinum Educational Group Phone 616.818.7877

1

TABLE OF CONTENTS TABLE OF CONTENTS ......................................................................................................................................... 1 INSTRUCTOR ACTIVITIES ................................................................................................................................... 4 ADDING/EDITING YOUR TESTS ......................................................................................................................... 4

ADD NEW TESTS .................................................................................................................................................................... 4 PULL QUESTIONS BY CURRICULUM ........................................................................................................................................... 6 REVIEWING YOUR TEST............................................................................................................................................................ 9

CREATING A RE-TEST ....................................................................................................................................... 12 PULL QUESTIONS FROM MY ACTIVE TESTS (RE-TEST THE SAME QUESTIONS AS ORIGINAL TEST) ...................................................... 12 PULL QUESTIONS BY TEXT, KEYWORD, OR ID ............................................................................................................................ 13

GROUP TESTING ............................................................................................................................................... 14 START A NEW GROUP TEST .................................................................................................................................................... 15

Pull Questions From ........................................................................................................................................................ 16 Curriculum ...................................................................................................................................................................... 16 My Tests .......................................................................................................................................................................... 16

MESSAGING ....................................................................................................................................................... 18 SEARCHING FOR A TEST .................................................................................................................................. 19 PRINTING/SAVING A TEST ............................................................................................................................... 19 CREATING A FINAL EXAM ................................................................................................................................. 21

DELETE A TEST .................................................................................................................................................................... 21 ADDING A CLASS ............................................................................................................................................... 22 ADDING A STUDENT TO A CLASS .................................................................................................................... 22 ADDING A TEST TO A CLASS ............................................................................................................................ 22 ADDING A PLATINUM SECURE TEST ............................................................................................................... 25 ADDING COMPUTER ADAPTIVE TEST MODULES TO A CLASS ...................................................................... 25

EXPLANATIONS: ................................................................................................................................................................... 26 EDITING A TESTS PROPERTIES AFTER IT HAS BEEN ADDED TO A CLASS ................................................... 27 EDITING TEST QUESTIONS WITHIN A CURRENT, BUT NOT ACTIVE, TEST ................................................. 29 DROPPING A STUDENT .................................................................................................................................... 30 REACTIVATING A STUDENT ............................................................................................................................. 31 VIEWING STUDENT ASSESSMENTS ................................................................................................................ 31 SETTING A STUDENT’S ABILITY TO RETAKE AN ASSESSMENT TEST .......................................................... 33 REVIEWING COMPLETED TEST RESULTS ....................................................................................................... 34

CLASS TEST RESULTS........................................................................................................................................................... 35 INDIVIDUAL STUDENT RESULTS ............................................................................................................................................. 36

Regrade Test Button........................................................................................................................................................ 37 Retake Tests .................................................................................................................................................................... 37 Toggle Grade Visibility ..................................................................................................................................................... 37 Export Answers ............................................................................................................................................................... 37

CLASS DETAILED RESULTS .................................................................................................................................................... 38 ADDING QUESTIONS/ADDING IMAGES TO QUESTIONS WITH ANSWERS & ANNOTATIONS ..................... 38

ADD IMAGE .......................................................................................................................................................................... 39

2

REPLACE IMAGE ................................................................................................................................................................... 39 DELETE IMAGE ..................................................................................................................................................................... 40 ANSWERS/ANNOTATION TAB ................................................................................................................................................. 40

ADDING/EDITING PROPERTIES TO QUESTIONS............................................................................................ 40 PROPERTIES TAB .................................................................................................................................................................. 41

Cut Score explanations: ................................................................................................................................................... 41 Bloom level explanations: ............................................................................................................................................... 41

ADDING/EDITING KEYWORDS TO QUESTIONS .............................................................................................. 42 KEYWORDS TAB.................................................................................................................................................................... 42 TO ADD OR EDIT A KEYWORD TO AN EXISTING QUESTION ........................................................................................................... 42

ADDING/EDITING PROGRAM TYPE, PROVIDER LEVEL, AND CURRICULUMS TO QUESTIONS ................... 44 CURRICULUMS TAB ............................................................................................................................................................... 44 ADDING CURRICULUMS TO NEW QUESTIONS .......................................................................................................................... 44 EDITING A CURRICULUM ON AN EXISTING QUESTION ................................................................................................................. 45

ALTERNATIVE METHOD OF OBTAINING TEST RESULTS ............................................................................... 45 UTILIZING THE GRADE BOOK .......................................................................................................................... 46

ADDING GRADES TO THE GRADE BOOK ................................................................................................................................... 46 EDITING/ADDING GRADES ............................................................................................................................... 47 GRADEBOOK NOTES ........................................................................................................................................ 48

TEST RESULTS..................................................................................................................................................................... 48 REPORTS ........................................................................................................................................................... 49

STATIC TEST REPORT ........................................................................................................................................................... 50 Summative Results.......................................................................................................................................................... 50 Class Breakdown ............................................................................................................................................................. 50 Charts ............................................................................................................................................................................. 50 Detailed Results .............................................................................................................................................................. 51

ADAPTIVE REPORT ............................................................................................................................................................... 51 Summative Results.......................................................................................................................................................... 51 Charts ............................................................................................................................................................................. 52 Curriculum Breakdown ................................................................................................................................................... 52

GROUP TEST REPORT........................................................................................................................................................... 53 ADAPTIVE TESTING........................................................................................................................................... 53 VIEWING ADAPTIVE TESTING RESULTS .......................................................................................................... 54 INTERPRETING STUDENT ASSESSMENT TESTS ............................................................................................ 54

READING LEVEL: .................................................................................................................................................................. 54 PARAMEDIC ENTRY ASSESSMENT (AVAILABLE FOR PARAMEDIC STUDENTS ONLY): ....................................................................... 55

Math Score: ..................................................................................................................................................................... 55 Text Anxiety Level:........................................................................................................................................................... 56 Motivation (Highest and Lowest) ..................................................................................................................................... 56 Learning Style ................................................................................................................................................................. 57

DESCRIPTION OF TERMS ................................................................................................................................. 57 GLOBAL VS. ANALYTICAL ....................................................................................................................................................... 57 STRUCTURED VS. FLEXIBLE .................................................................................................................................................... 57 INDEPENDENT VS. SOCIAL ..................................................................................................................................................... 57 AUDIO VS. VISUAL VS. KINESTHETIC ....................................................................................................................................... 57 GARDNER’S MULTIPLE INTELLIGENCES ................................................................................................................................... 57

3

Linguistic......................................................................................................................................................................... 57 Spatial ............................................................................................................................................................................. 58 Logical/Mathematical...................................................................................................................................................... 58 Musical ............................................................................................................................................................................ 58 Body Kinesthetic ............................................................................................................................................................. 58 Interpersonal .................................................................................................................................................................. 58 Intrapersonal .................................................................................................................................................................. 58

USES IN THE CLASSROOM: .................................................................................................................................................... 58 Presentation Styles ......................................................................................................................................................... 58 Seating Arrangements ..................................................................................................................................................... 58 Work/Breakout Groups .................................................................................................................................................... 58 Study Partners ................................................................................................................................................................ 58

FREQUENTLY ASKED QUESTIONS .................................................................................................................. 59 EDIT MY TESTS .................................................................................................................................................................... 59 EDIT CLASS ......................................................................................................................................................................... 59 GRADE BOOK ...................................................................................................................................................................... 60 CAT ................................................................................................................................................................................... 61 EDIT MY QUESTIONS ............................................................................................................................................................ 61 WANT MORE Q&A’S? ...................................................................................................................................................... 62

4

INSTRUCTOR ACTIVITIES If you are an Administrator, make sure to change your role to an Instructor in order to utilize these functions.

As an Instructor you will do 8 basic things.

1. Add New Tests 2. Add From Questions/ Add Questions From Tests 3. Review Your Tests 4. Manage Your Classes 5. Look at Your Tests and Test Results 6. Review Admissions Assessment Tests 7. View Reports 8. Send Messages

ADDING/EDITING YOUR TESTS To add or edit tests select Manage Tests from the top menu bar. This will bring you to the page titled Test Search.

You can search for a previously created test or create a new test. The first time you visit this section there will not be any tests in your question bank to search for, therefore you must create a new test.

ADD NEW TESTS Click the Create New Test button and you will be directed to the Add New Test page. The following are the definitions of the fields on this page:

5

Test Name* - In this field you name the test based on what your students will see. Test Title* - In this field you name the test based on how you will refer to it. Reference - This field can be used as an additional descriptor.

Test Status –This field shows the status of the test as a Draft because it is a new test. Once you have finalized your test you will notice that the status will switch to Active.

Provider Level* - You are required to pick a provider level from the drop down options. This is a critical field because it designates which question bank the questions are drawn from.

Test Type* - This is a required field. This will match up to the gradebook and what passing score is needed for this type of test (see gradebook).

6

Import Test From - This field is a way to get tests from other teachers in your school or to make a copy of any of the Platinum Final Exams. Note: The Platinum Final Exams use a completely different question bank than the normal Platinum test building questions.

Test Instructions – This field only applies if you intend to place this test online. In this field you will enter any directions you would want the students to follow as if you were standing in the classroom administering the test. You may want to address things such as; how much time is allowed to take the test? When will the results be available? Can I log out and come back in? Will the previous button be available? Can I use my book or notes? Etc.

Personal Test Notes – This field is for your personal notes that can only be seen be you on this screen.

Share This Test - This option will allow you to share this test across your school. This does not make it available to the entire system. Any instructor in your school who makes a test at the same provider level and test type will have a drop-down box that will pop-up a list of any shared tests in their school matching those levels. Choosing and importing one of those shared tests will make a copy for the instructor.

Once you click Save you will see a new tab called Question Criteria.

You will see the options to either Pull Questions By Curriculum, Pull Questions From Active Tests or Pull Questions By Text, Keyword, or ID. If this is your first test the system will not allow you to add from prior tests because you have not created any prior tests.

PULL QUESTIONS BY CURRICULUM Click the Add from Question Banks button and select your criteria.

7

QUESTIONS If you do not want the default 20 questions from the question banks then input a different number into the Questions box.

QUESTION BANK If you would like to select a different Question Bank, click the dropdown arrow. (Note: if you have not created any questions for your personal database the Platinum database questions will be the only option.)

SCENARIO BASED QUESTIONS Do you want to include Scenario Based Questions in your Questions Selection Criteria? If so, click On. Any means you don't care if Scenario Questions or included or not an it is also the default setting. If you do not want Scenario Questions, click the Off toggle.

CURRICULUM Curriculum allows you to choose between Educational Standards, Module/Topic/Objective or National Registry.

Educational Standards - Questions developed based on the new Educational Standards published around 2010. Module/Topic/Objective - Questions developed based on the National Curriculum that was replaced by the 2010 Educational Standards. National Registry - Questions developed based on the National Registry Practice Analysis. BLOOM LEVEL The third box, allows you to select your Bloom level.

Bloom Level Explanations:

Knowledge - Lower level straight from book stuff. Comprehension - Next level up, just stated differently than the book. Application - Middle level, ability to use as intended. Analysis - Next level up, diagnosing. Synthesis - High level, outside the box. Evaluation - Highest level, able to defend.

8

Clicking the arrow will show you all sub-topics within that category. Check the box next to the topics you want on your test. You can also check your sub-topics individually by selecting the box next to the desired sub-topics. You may also select the parent category box, which will select all of the sub-topics and then deselect the one or two you do not want. When your selected criteria is met click the Save Criteria button. You will see your selected topics listed in the green section.

A third tab called Test Questions will appear next to the Question Criteria tab with your questions.

Note: If you did not select the correct criteria you can hit the Delete button to clear your criteria and start over.

9

You will now see in the Question Criteria tab the ability to add additional questions from the question banks or prior active tests if desired.

You can also select the Test Questions tab and look at the test questions you have selected. Once you have reviewed and edited the questions you have selected, you can then go back to Question Criteria by selecting the Question Criteria tab.

You may continue to add from the question banks or prior tests until you are satisfied.

REVIEWING YOUR TEST Once you are satisfied with your test questions, go to the Test Questions tab and review your questions by scrolling down the page.

10

Tip: If you would like to re-order any of the questions, drag and drop them into the area with your mouse and the system will automatically re-number your questions. If you would like to select questions to remove, check the red checkbox and then click the remove selected button.

Questions are initially listed in the order of the queries you selected. Clicking the question lets you see the question detail. These details include the multiple choices, the correct answer and the explanation of the question or annotation.

You can also click the Replace button to replace an individual question from within the same question criteria selection.

To choose a question to replace the question with, click the Choose button.

To remove a question, click Remove from the button dropdown. This will remove your question, but the question will still be available to re-add to this test. Your test will be one question less.

To exclude a question, click Exclude from the button dropdown. This question will no longer be available to use on this test. Your test will be one question less.

To ban a question, click Ban from the dropdown button. You will NEVER see this question again when building new tests. This action cannot be undone. Your test will be one question less.

Every question also has a unique ID number that you should use to communicate any problems or comments about it to us.

11

You can also review the questions:

Reading Level (RL), Bloom Level (BL), Cut Score (CS), Difficulty (DIF), National Registry Reference (NR), Educational Standard Reference (ES) and National Curricular Objective Reference (OBJ).

If you are not satisfied after reviewing your test questions, you can select the Question Criteria tab and delete any of the segments you do not like.

You can go back and query the bank again, and review your questions as many times as you need.

When you are satisfied, go back to the Test Questions tab and click the Finalize Test button. By doing this you will automatically turn the test to Active. This test is now ready to be added to a class.

You will then automatically be returned to the Test Search page. You should see your most recently modified tests and well as the test you just created or modified on the top of the list.

Note: Check and make sure that this test has more than 0 active questions.

12

CREATING A RE-TEST Please ensure your role is that of an Instructor.

Select the Manage Tests button. Click the Create New Test Button. Give the test a name and title. The test title and or name should probably include a term to imply this is a re-test.

Select the Provider Level and Test Type. When you are finished click the Create button.

You can create a re-test using 3 different methods:

1. If you would like your re-test to be significantly different than the original test, select Pull Questions By Curriculum button and follow the blueprint you used to create the original test. See Adding/Editing Your Tests.

2. If you would like to use the same questions as the original test you will need to select the Pull Questions From My Active Tests button and follow the steps below.

3. If you would like to Pull Questions By Text, Keyword, or ID select that option if you would like to pick different questions.

PULL QUESTIONS FROM MY ACTIVE TESTS (RE-TEST THE SAME QUESTIONS AS ORIGINAL TEST) Enter the number of questions you would like from the original test. Try not to exceed the number on the original test.

Select the Add From My Active Tests button and choose the test you would like to re-test from the dropdown menu.

13

If you would like the test questions to be scrambled, select On under Scramble Questions. If you would like the questions in the same order leave the toggle on Off. Off is the default.

Click the Save Criteria button.

Select the Test Questions tab to see your test.

If you had chosen less questions than were on the original test, the replace button will function properly. You can also delete and/or rearrange any of the questions by dragging and dropping them.

When you are satisfied, click the finalize test button.

PULL QUESTIONS BY TEXT, KEYWORD, OR ID Click the Create New Test button and you will be directed to the Add New Test page.

Give the test a name, title, provider level, test type, instructions and notes. Click the Create Test button.

14

Select Pull Questions By Text, Keyword, or ID. Choose the number of Questions you would like, the Question Bank you would like to use, the Bloom Level, and the Search By option. You can also search all questions for the word/phrase entered in the search text box. The text must be an exact match but is not case sensitive. The search includes questions, answers, annotations and reference IDs. Click the Save Criteria button.

You will be brought to the Edit Test Questions page. Click the Test Questions tab to see your questions by Text, Keyword, ID or Search By option.

Click to expand a question to see questions details. Click the Replace button if you want to replace, exclude or ban a question. When you are done click the finalize test button.

You will be brought to the Test Search page where you will see the test you created under Your Ten Most Recently Modified Tests.

GROUP TESTING Group Testing is an exciting new way to add a group trivia experience to your class tests!

On the instructor home page in current classes, expand one of your current classes to see the Group Testing button.

15

Select the Group Testing button and start a new group test by clicking the large red Create a Room button.

Note: If you already have started a test and then left the test, you will see that test displayed with its room code in the Active Tests area. You can click on that to resume your test.

START A NEW GROUP TEST You will see some information on the left with the heading Student Instructions: when you initially see the page. That information is displayed to help your students join on their mobile device. But first, you will need to look to the right of the screen to setup your test settings.

16

Pull Questions From This button lets you choose where you want to pull your questions from. You can choose a Curriculum or choose questions from a test you created by clicking on My Tests. The options under this will change when you have chosen one to pull your questions from.

Curriculum Click the dropdown and select a Curriculum, Module or Topic.

My Tests If you are choosing one of your already created tests, choose that test from the Select a Test dropdown.

All other settings in this section can be toggled on our off. We recommend all of them on for the best group testing experience, but we understand the needs to have them off as well for different classroom experiences.

Now that you have set your group testing settings, have your students go to the emstesting.com/quiz/join link from their browsers on their devices (safari, chrome, etc.).

17

They will then enter their name and room key (in the large green box) or click on the active test if the test is already setup to play.

Once you have all your students in (the # Players on the top of the settings section will tell you how many students have joined the room), click on the red Start Game with X Players on the bottom of the screen to begin.

Students will receive a "Get Ready to Answer!" prompt and the first question will begin.

The student will choose from A, B, C, D to select the best answer.

18

Once the you have completed the test, you will see a leaderboard at the end (if you toggled it on) showing the students rank, score and name. If you would like to start a new game, click the New Game button. If you would like to Exit, click the Exit button.

The student will also see their score and rank on their device.

Go to the Reports section for how to run the Group Test Report!

MESSAGING From your home screen click the New Message button in the bottom right hand corner.

19

Click the dropdown to select a recipient. Complete the subject field, click Important if you want others to see the message as important, then type your message.

Click the Send button.

SEARCHING FOR A TEST Ensure your role is that of an instructor. From your home screen select Manage Tests.

Type the test name or title of the test into the Search Tests box. If you want to narrow down your search further, you can select the Test Type, Test Status, Program Type or Provider Level.

Enter any information you have about the test, then click the Search button to search tests.

PRINTING/SAVING A TEST Ensure your role is that of an instructor. From your home screen select Manage Tests.

20

Type the test name or title of the test into the Search Tests box. If you want to narrow down your search further, you can select the Test Type, Test Status, Program Type or Provider Level.

Find the active (green) test you would like to print from your search results.

Click the test name to expand the area for more details and then select your desired printout. This will open in a PDF format which you can then print and/or save.

21

CREATING A FINAL EXAM To create a final exam select Manage Tests. This will bring you to the page titled Test Search.

Click the Create New Test button and you will directed to the Add a New Test page.

Provider Level* - You are required to pick a provider level from the drop down options. This is a critical field because it designates which question bank the questions are drawn from. We have Final Exams at all levels except I-99, however you can make your own final exam still for this level.

Test Type – Select Final Exam for your Program Type.

Click the Create button to create your final exam.

DELETE A TEST To delete a test, search for the test you would like to delete from Manage Tests. Then click the edit test button on the far right of the test panel you would like to delete.

22

Note: If a test is associated with a class it cannot be deleted only disabled. This will prevent you from adding it to a class.

ADDING A CLASS As of August 13, 2017, the ability to create classes has been removed from the Instructor role and added to the School Administrator role as part of the Unified Course/Class creation between all Platinum Educational Group products.

ADDING A STUDENT TO A CLASS Students can be accepted into classes by School Administrators in the dashboard, or if the "Allow instructors to manage student class enrollments” option is enabled in your school, instructors can accept student class enrollment requests from the dashboard as well.

ADDING A TEST TO A CLASS Ensure your role is that of an instructor. Make sure you have already created the test.

Select the current class you would like to add a test to.

23

Click the Edit Class button.

Select the Tests tab.

You will see all tests associated with the class. Click the Add Test to Class button.

24

This page will list all tests available for this class, click the add button next to the test you would like to add.

Once you have clicked the add button you will see the available settings options for your test. See the explanation of the fields below. Remember to click save once you have your test settings completed.

25

ADDING A PLATINUM SECURE TEST

After adding a test to a class (directions above), check the Require Platinum Secure Testing check box if you want to lockdown your test with Platinum Secure Testing.

For more explaination: Read more about Platinum Secure Testing.

ADDING COMPUTER ADAPTIVE TEST MODULES TO A CLASS

Ensure your role is that of an instructor. Make sure you have already created the class.

Select the current class you would like to add Computer Adaptive Testing Modules to.

Click the Edit Class button.

Select the Adaptive tab.

26

Set the Test Limit. This is the total number of Adaptive tests your students will be able to take. A value of 0 means there is no limit.

Select the modules you would like to set for the class. We show all the curriculums for the current provider level.

Click the Save button.

EXPLANATIONS: Start Date and Start Time – This is the earliest a student can start taking the test.

End Date and End Time – This is the latest a student can start taking the test. Test results are only available after this date and time setting. The test end date can be moved either forward or backward. You would move the ending date forward because all students had completed the test early. You would move a test end date back to accommodate a student who was absent or missed a test.

Start/Resume Limit – This setting limits the number of times a student can login, logout and login again. Since this includes internet service interruptions we suggest you leave this setting to unlimited unless you are administering the test in a controlled environment.

Minutes Allowed – This is the length of time you will allow the students to take the test. This timer begins upon selecting the first question and does not stop if a student logs out.

Enable Previous Button – If you allow students to answer prior questions they can back up but WILL be required to re-answer all questions that were backed over. This box will turn yellow with a warning when selected because selecting this may invalidate your test results.

27

Student Test Result Detail Level - This provides four categories of test results. Level 1- Score Only Review shows cut/raw score, passing score, then indicates pass or fail. Levels 1,2- Extended Review shows time on test, and results based on: Reading Level, Bloom Level, Cut Score, National Registry, and Educational Standard. Levels 1,2,3 - Curriculum Breakdown Review shows 4 tabs, one for each of our curriculum options. Each tab will display the topic areas tied to questions on the test, as well as how a student performed in each of those topic areas. Levels 1,2,3,4 - Full Question/Answer/Annotation Review allows the students to see the questions, and by selecting more, the choices, the key, their choice, and the rationale.

Require Platinum Secure Testing - When students use Platinum Secure Testing, they are unable to print, copy, go to another URL, or access other applications. Checking Require Platinum Secure Testing will require your students to download software onto their computers, which is available before they begin their test(s). Click the red question mark icon for more information. Students can do secure testing on an iPad. More information about Platinum Secure Testing on an iPad.

Show Student Results Immediately - By selecting this box you are asking that the students receive their results immediately upon completion of their test. (Note: Because this can occur prior to any of the other students even starting, this box will turn yellow with a warning when selected because selecting this may invalidate your test results and is not recommended).

Student Test Password - By entering a password into this line, the student or test proctor will need to enter the password when requested prior to actually beginning the test.

Click the Save button.

Note: You should now see the test listed in your tests currently associated with this class.

EDITING A TESTS PROPERTIES AFTER IT HAS BEEN ADDED TO A CLASS Ensure your role is that of an instructor. Select the current class that the test was taken in.

28

Click the Edit Class button. Select on the Tests tab.

Click on edit button for the test you want to edit from the list.

29

You may now change any of the test properties you desire. Once you are satisfied, click the Save button to update the test properties.

Note: DO NOT change the "Start Date" of a test if the current "Start Date" is in the past.

EDITING TEST QUESTIONS WITHIN A CURRENT, BUT NOT ACTIVE, TEST

Note: Tests that students have started in a current or previous class cannot be edited.

From your home screen select Manage Tests.

Select the test criteria by searching for the test by name or title. You can also narrow down your search by type, status, program type and provider level. Once your criteria is selected, click the Search button to find your test.

Once you have found the test you would like to edit from the search results click the edit test button to the right of the test name.

Click the Test Questions tab.

30

Click the re-enable test editing button. This will allow you to change test settings, add additional questions, replace or delete existing questions etc.

When you have made the desired changes you must go back to the Test Questions tab and click the finalize test button as you did when you first created the test.

DROPPING A STUDENT Ensure your role is that of an instructor. Select the current class that the student is enrolled in.

Click the View Gradebook button.

31

To drop a student click the "x" to the left of the student’s name. When asked if you want to drop this student from your class, click OK and Cancel.

If you would like to zoom in on one student (must have multiple students in the class), click the green zoom in button next the the drop student button. This will show that one student in the gradebook.

REACTIVATING A STUDENT Ensure your role is that of an instructor. Select the current class that the student is enrolled in.

Click the View Gradebook button.

To reactivate a student, click the Show Dropped Students button.

Select the "+" sign to the left of the student’s name. When asked if you want to add this student back into your class click OK or Cancel.

VIEWING STUDENT ASSESSMENTS Ensure your role is that of an instructor. Select the current class that the student is enrolled in.

32

Click the Student Assessments button.

Select the student from the class roster by clicking on their name.

Click through the tabs to see the assessment results for Reading Level, Paramedic Entry Assessment, Math Score, Test Anxiety Level, Motivations and Learning Style.

33

If you would like to print or save out these assessment results, click the Excel Export button to download the student results.

SETTING A STUDENT’S ABILITY TO RETAKE AN ASSESSMENT TEST Ensure your role is that of an instructor. Select the current class that the student is enrolled in.

Click the Student Assessments button.

Select the student from the class roster by clicking on their name.

34

To reset the student’s assessment, click the Delete Test button to the upper right. When asked if you are sure, indicate “ok”.

REVIEWING COMPLETED TEST RESULTS Ensure your role is that of an instructor. From your home screen under Current Tests along the left side of the screen select Completed.

Expand out the test you would like to see results on. Click Test Results.

35

CLASS TEST RESULTS The Class Summative Results will show you the test Cut-Score Average, Raw-Score Average, KR-20 and the student Confidence Score in the question.

Note: KR20 indicates reliability and will not have valid results until at least 4 students have taken the test.

The Curriculum dropdown allows you to sort results according to Educational Standards, Module, Topic, Objective and/or National Registry 2015.

In the example above, the screen shows the class test results using the Educational Standards Curriculum. If a student Flags a Question while testing, the topic or objective the question is tied too will display under the Class Summative Results in the Most Requested Curriculum for Discussion section.

36

You will also see the curriculum change in the Class Detailed Results. Click on any of the red numbers to see the question detail.

This question has the following curriculums associated with it. Question, answer and annotation was changed to Latin text for this example.

INDIVIDUAL STUDENT RESULTS The Individual Student Results area of the page will show student results individually. You will also see the ability to Re-grade Tests, Retake Tests, Toggle Grade Visibility and Export Answers.

37

Regrade Test Button This button will re-grade the test for all students selected. Select the top checkbox (next to Student Name) to select all students. Toggle over the Re-grade Tests button to see the following directions. “This action will re-grade the selected student’s tests. This is primarily used when a test is closed early or when the gradebook has been modified”.

Retake Tests This button will let your selected student(s) retake the test. Select the top checkbox to select all students. The existing test will be archived for future reference. If you have chosen to let the student(s) retake the test, an orange box in the Retakes column will show the number of retakes the student has received.

Toggle Grade Visibility The Toggle Grade Visibility button will let you exclude selected student(s) grades from the test. Select the top checkbox to select all students. This functionally is the same as the show/hide feature in the gradebook. When you select your students to be excluded, a line will cross out their name in the list. The Class Summative Results will also change to reflect the excluded students.

Export Answers You can export an answer sheet for selected students or all student results (by selecting the top checkbox to select all students) to excel by clicking on the button labeled Export Answers.

Please Note: There are 3 columns of note included in the Export Answers excel spreadsheet. The “Answered on” column is displayed using the instructors time zone. There is also an “Archived” column that shows a 1 for archived tests and zero if there are no archived tests. The non-archived test will show if you filter the column by 0 in excel. The student must have taken the retest to see

38

the non-archived test. The last column of note is the question reference, which is the question id of the actual question in our system.

The View Student Results link will show you the specific students results of the test and the Curriculum Breakdown by Educational Standards, Module Topic Objective, National Registry 2015.

CLASS DETAILED RESULTS The Class Detailed Results area of the page will show you the class detailed results.

Your goal is to keep the class difficulty level less than or equal to the national level and to keep discrimination values positive. You can also jump to the full question detail by clicking the desired test question number in red. In the Review column, if there is a “1” shown the student has selected that question to be reviewed in class.

ADDING QUESTIONS/ADDING IMAGES TO QUESTIONS WITH ANSWERS & ANNOTATIONS Ensure your role is that of an instructor. Click Manage Questions from the menu bar along the top portion of the screen.

Click the New Question button in the red bar. You will go to the Add New Question page.

39

Fill in your Question Text, click the add image button if you would like to add an image to the test.

ADD IMAGE Note: Make sure the image is a reasonable size (if image is too large, the image will take extra time for your students to download during a test) in either .jpg, .gif or .png format.

Click the add image button to browse and upload an image for the question you are adding from your computer. Once your file has been chosen, the image will appear after your Question Text.

Click the Save button to save the image and the rest of the question information you have entered.

REPLACE IMAGE To replace your image, click the swap image button to browse and upload your replacement image for the question you are adding from your computer.

40

DELETE IMAGE To delete your image, click the delete image button under the image.

ANSWERS/ANNOTATION TAB You will first choose your Answer Type. You can choose “Multiple Choice – Select One” or “Multiple Choice – Select All That Apply.”

Add your Answers to the question and make sure you check off the correct answer(s).

The maximum number of choices for answers you can have is 4. ANNOTATION The Annotation is your explanation for the correct and incorrect rationale.

ADDING/EDITING PROPERTIES TO QUESTIONS

41

PROPERTIES TAB

Here you will fill in your Question Reference ID, select your Question Bank, School (if you are in multiple schools) Status, Cut Score, Bloom Level, and enter the Reading Level of the question. QUESTION REFERENCE ID The Question Reference ID is a reference point for your questions. I.e. Cardiac 01, Cardiac 02, etc. QUESTION BANK The Question Bank is the question bank the question will reside in. STATUS We suggest you choose “Active” for your question, to avoid forgetting to set it to Active to use it for a test.

CUT SCORE Select from the drop downs for Cut Score.

Cut Score explanations: • 0.9 corresponds with zero “good wrong” answers • 0.6 corresponds with one “good wrong” answer • 0.45 corresponds with two “good wrong” answers • 0.36 corresponds with three “good wrong” answers

BLOOM LEVEL

Select your Bloom Level from the drop down.

Bloom level explanations: • Knowledge – Things like definitions

42

• Comprehensions – Definitions in your own words • Application – Using information as it is intended • Analysis – Selecting from a list or diagnosing • Synthesis – Thinking outside the box • Evaluation – Ranking/justifying/selecting the best answer when all are correct.

READING LEVEL Click “Re-calc” to calculate the reading level.

SCENARIO QUESTION If this question is a scenario question, click the checkbox to be able to search for your scenario question later. The ability to build a scenario test is coming soon. CAT ENABLED If you would like this question to go in Adaptive Testing, click the checkbox to enable it.

ADDING/EDITING KEYWORDS TO QUESTIONS

KEYWORDS TAB To add a keyword to a new question, click on the Keyword tab.

Type in any keywords you would like to associate with this question and then click the Add Keyword button. The keywords you entered will show below in grey.

Click the “X” next to any keyword to delete it from the question.

Click the Save button to save your changes.

TO ADD OR EDIT A KEYWORD TO AN EXISTING QUESTION

Click Manage Questions from the top menu bar.

43

Use the search tool to locate the question you want to edit.

Click the edit button next to the question you want to edit the keyword on.

Click the Keyword tab to edit/add keywords.

Type in the keyword you would like to add and click the Add Keyword button.

44

Click Save when your desired changes have been completed.

ADDING/EDITING PROGRAM TYPE, PROVIDER LEVEL, AND CURRICULUMS TO QUESTIONS

CURRICULUMS TAB To add a curriculum to a new question, click on the Curriculum tab.

ADDING CURRICULUMS TO NEW QUESTIONS Select your Program Type, Provider Level, Curriculum and Curriculum Level from the dropdown menus.

Click the Add Curriculum button. You will see the curriculums listed under “Curriculums Associated with This Question.” Continue to add them until you have all curriculums you need associated with the question.

Click the Save button to save your changes.

45

EDITING A CURRICULUM ON AN EXISTING QUESTION

Use the search tool to locate the question you want to edit.

Click the edit button next to the question you want to edit the keyword on.

Click the Curriculums tab.

To delete a curriculum, click the “x” next to the curriculums listed under “Curriculums Associated with This Question.”

To add more curriculums, select your preferences and click the Add Curriculum button.

Click Save to save your changes.

The Statistics tab will show you detailed information about the question. The Messages tab will show you any comments made on the question. The History tab will show the question history and when the question was changed and who made the change to the question. The Notes tab will show any Notes the question has.

ALTERNATIVE METHOD OF OBTAINING TEST RESULTS After logging in as an Instructor, and selecting the desired class, select View Gradebook.

46

Then select the name of the test you would like results.

This will yield results identical to all other methods of obtaining test results.

UTILIZING THE GRADE BOOK ADDING GRADES TO THE GRADE BOOK Make sure that you have created the corresponding category you would like to place these grades in, if you kept EMS Other the new assignments will default to that type. Note: Grades cannot be placed in EMS Quiz, Test, or Final Exam.

47

Click the + Add New Assignment link.

Enter a name, the date, and select the appropriate type from the drop-down. Then select the Save button to save your changes.

EDITING/ADDING GRADES All grades not generated by EMSTesting.com must be entered manually.

48

To edit a grade, hover over the grade desired and select edit. If you would like to go back to the previous computer generated grade just enter -1, and select "OK". If you would like a grade to be different, type in the new grade and select "OK".

You may also hide a grade, which will remove the grade from the student’s class average.

GRADEBOOK NOTES TEST RESULTS All tests/assignments are listed in order by their end date. Students are ordered by their last name. The grade book will now automatically select the current class segment. If none are current then it will select the first segment.

49

If you need to add in your own tests from outside of EMSTesting you will need to create a new grade type (Ex "Paper Tests") and add that to the class via the add new assignment feature.

All grades for the new student will be set to 0 and shown/enabled. Instructors can edit the new grades as needed. When adding/ editing an assignment you must enter a valid date for the current class. Dates outside the scope of the class will result in an alert and the data will not be saved until corrected. Improved support for incomplete grade book settings. Zeros entered into the class percentage fields will no longer result in being unable to view your grade book. Please note, if you are using a test/assignment in the grade book it needs to have a value greater than 0 placed in the weight.

All grades for the new student will be set to 0 and shown/ enabled. Instructors can edit the new grades as needed.

Note: the students average only looks at all assignments/tests in the past and does not include future items.

REPORTS To view reports, click the Reports link in the top black menu bar, then click the instructor name and school you would like to view the reports on.

Select the Provider Level and Curriculum from the dropdowns, then click the Run Report button. Note: You can also download the respective document for your objectives or print the report pages.

50

You will see 2 tabs, the Static Test Report from EMSTesting.com and the Adaptive Report (formerly EMSCat.com).

STATIC TEST REPORT Summative Results The Summative Results will show you results from the provider level and curriculum you choose for you as an instructor.

Class Breakdown The Class Breakdown section of the reports will show you more detailed information about your classes. Click the View link to run your reporting by the class.

Charts The Charts section of reporting will show you a graph with an average score per module.

51

You can hover over each module to see the actual score percentage.

Detailed Results The Detailed Results section will show you in-depth information by Curriculum Level. Click on the arrows to expand and collapse the information.

ADAPTIVE REPORT The adaptive report tab shows you all adaptive testing for you as an instructor by provider level and curriculum. Note: Adaptive test results change on a day to day basis based on other participant’s results.

Summative Results The summative results section shows you an overall summary of adaptive tests for you as an instructor.

52

Charts The Overall Indication chart shows you an overall indication for success by module. The next three charts contain a detailed breakdown for each of the key indicators summarized in the first chart. These key indicators are:

Percentile Ranking Greater Than 51% Average Score Greater Than 65% Highest Difficulty Achieved Greater Than .60

Curriculum Breakdown The curriculum breakdown section shows you in-depth information by Curriculum Level. Click on the arrows to expand and collapse the information.

53

GROUP TEST REPORT

To view a Group Test report, go to the Reports menu item at the top of the page and select your Name and School Name from the menu.

Choose the Provider Level and Curriculum you used for the Group Test and click the Run Report button.

You will see 3 tabs when you run your report, choose the last tab titled Group Test Report.

ADAPTIVE TESTING Ensure your role is that of an instructor. Select the current class that you want to activate CAT (Computer Adaptive Testing) in.

Click the Edit Class button.

54

Click the Adaptive tab.

Test Limit of zero allows for unlimited testing. Select the desired modules by clicking the box or boxes to the left of the module names under Enabled Modules. Click the Save button to activate adaptive testing for the students in this class.

VIEWING ADAPTIVE TESTING RESULTS See the Reports, Adaptive Report section for adaptive testing results.

INTERPRETING STUDENT ASSESSMENT TESTS READING LEVEL: Process - The student is asked to respond to the following statement:

55

“In at least 125 words, please write a letter or create an essay on why you have selected a potential career path in Emergency Medical Services. NOTICE: This assignment has two purposes. First, it helps us know why you selected this profession and how we can best serve your needs and it also helps us identify your reading level.”

Teachers are provided with the material the student wrote as well as an estimated school-grade level of what they wrote. For example, a 9.5 would mean what was written would be at a level someone halfway through the tenth grade should easily understand. As this is the student’s writing level, the reading level will typically be about two grades higher than this. Note: If a student uses no punctuation, incorporates spelling errors, and other gross typographical mistakes, the results can become quickly invalid. Anything over the 20th grade level should be suspect. PARAMEDIC ENTRY ASSESSMENT (AVAILABLE FOR PARAMEDIC STUDENTS ONLY): Process - The student is given a Basic EMT comprehensive final exam and then the teachers are provided with feedback of where within the Registry Practice levels the student is weak or strong. Math Score: Process - For the math assessment, students take a test based on the following topics. The results are then provided in a percent correct fashion: MFR and Basic EMT Candidates answer questions 1 to 25 EMT I-85 Candidates complete items 1 to 60 Intermediate 99, AEMT, and Paramedic Candidates take questions 1 to 120

56

Text Anxiety Level: Process-This section asks questions that would be reflective of a person who is, or is not, comfortable taking tests. If they show any indication of anxiety, a presentation opens that goes over how to overcome test anxiety challenges. Motivation (Highest and Lowest) Process - The student completes a questionnaire that will ask them (using a number of statements representing the motivations below) to select one answer that best matches their opinion of two choices. When done, Platinum reports the top two motivations and the least. The first one listed is their motivation, the second highest is the reason why the first is their highest (the motivation behind the motivation). The lowest represents what will demotivate the student. The 6 categories are listed below.

• Social Relationships: to make new friends or meet a need for association or friendship • External Expectations: to fulfill the expectations of someone of authority • Social Welfare: community service and to serve mankind • Personal Enhancement: achieve higher status at work, provide professional

advancement, or stay abreast of competitors • Escape/Stimulation: to relieve boredom, provide a break from the routine at work or

home, or provide contrast to the exacting details of life • Cognitive interest: to learn for the sake of learning, seek knowledge for its own sake, or

satisfy a curious mind

Item Numbers: Application: 1-18 Vital Signs 19-22 Pulse Pressure 23-25 Burn Percentage Assessment 26-35 Weight Conversions 36-45 Metric Volume Conversion 46-50 Weight Conversions (Story Problems) 51-55 Complex Operations Drip Rates 56-60 Volume Infusions (Story Problems) 61-70 Rounding 71-75 Metric Weight and Volume Conversions 76-85 Decimals/Percent’s 86-90 Proportions 91-110 Fractions 111-112 Complex Operations (Medication Drip Administration) 113-114 Unit Reduction 115-117 Using Formulas 118-119 Solving for a Variable 120 Dextrose Calculation Following Directions

57

Learning Style Process - Students are given a series of questions that have them identify themselves with statements that are based on the descriptors that follow. A description and use of this information is provided here:

DESCRIPTION OF TERMS

GLOBAL VS. ANALYTICAL Global - (Right brain) A learner who must see the big picture before they can concentrate on individual parts. Analytical - (Left brain) A learner who processes information in a logical, sequential method and after analysis, arrives at the big picture

STRUCTURED VS. FLEXIBLE Structured - Learns best when an exact lesson plan is followed. Would learn best with a handout that is followed as written Flexible - Learns best when information is presented as they need it regardless of prepared order. Would learn best with brainstorming and question/answer format

INDEPENDENT VS. SOCIAL Independent - Learns best when working independently or isolated. Needs an environment, which is quiet and undisturbed. Learns well from written reports, reading assignments and papers. Social - Learns best when multi-tasking in busy environments with other people. Enjoys study sessions, group projects and cooperative learning.

AUDIO VS. VISUAL VS. KINESTHETIC Audio - Learns best by hearing information. Learns best with lecture, oral presentations and classroom discussion Visual - Learns best by seeing information. Learns best with videotapes, slide presentations, overheads, illustrations, posters, X-rays, Moulage and other visual props Kinesthetic - Learns best by manipulating information through physical means by handling and touch. Learns best with 3-dimensional models and replicas, laboratory sessions, scenarios and role-playing

GARDNER’S MULTIPLE INTELLIGENCES Linguistic Enjoys working with the spoken word and language

58

Spatial Enjoys visual, artistic imagery, has the ability to create visual pictures in their mind Logical/Mathematical Enjoys puzzles and problem-solving requiring thought Musical Enjoys music and understand the language of music Body Kinesthetic Has an aptitude for sports and recreational activities involving body movements Interpersonal Works well with others and is tuned into those around them Intrapersonal Enjoys self-reflection and introspection, is aware of their body USES IN THE CLASSROOM: Presentation Styles

• Vary format of presentations to meet the needs of your different learners Seating Arrangements

• Place the kinesthetic learner in the back of the room • Place the audio and visual learner in the front. Further, place visual learners so as to

avoid visual distractions and audio learners as far away as possible from auditory interference

• Place independent students in isolation (preferably) or they can be grouped together • Place social learners together and away from independent learners

Work/Breakout Groups

• Select groups that have a variety of learning preferences and intelligences so that they may benefit from each other

• Alternative selection would be to place structured in one group and flexible in the other group and then vary learning preferences

Study Partners Select study partners that have at least one strong intelligence in common and complement each other’s with strengths and weaknesses

59

FREQUENTLY ASKED QUESTIONS

EDIT MY TESTS Can I export the tests/results to Blackboard or another LMS (Learning Management System)? The straightforward answer is yes. The process will require the user to have Adobe Writer. Our tests are produced in a PDF format. With Adobe Writer you can save this test in a variety of different formats. The format needed will be dependent on the LMS system you use. When generating a test, can I choose the overall cut score/reading level of the test? No you cannot. Because of the limited number of questions per module, restricting the query to also include cut score and reading level would result in a very small number of questions being returned. You can however, replace questions of an undesirable reading level or cut score with other questions, if available, though this is cumbersome and may not yield the result you desire.

EDIT CLASS I have added a student to my class, but now I need to move them to another class. Can I do this? Yes. First you will want to flag the student in your class. Then the student will just need to enroll in the correct class and be accepted by some with access to class enrollment requests.

Can I give the same test multiple times? Our first response would be why would you want to? However, if you are determined to do so we do allow for this. Go to edit my test, add new test, give the test a name like “same test again”, and make sure you select the appropriate level and type. Select save and then on the question criteria tab, add from test. Then select the correct number and the test you want to offer again. Note: you may not call the second test the same name as the first test. Can I assign tests to certain students in a class and not others? Again, not sure why you would want to do this as it certainly defeats the concept of reliability. The answer is yes, but you will need to then come up with some method of adjusting the grade book. Can I have my test switch from one student result detail level to another automatically when the testing period is completed? No, this has to be done manually. When giving a test, can I randomize the question order from student to student? Not really. Again, this process will cause the test to become unreliable, as each student will have a different encounter. Imagine the student with test anxiety who randomly gets the hardest questions first and another student gets the easiest questions first. The makeup of the test will alter the student’s performance. This is often requested in an attempt to deal with potential cheating issues.

60

We have other methods that do not negatively impact the cognitive evaluation process to deal with cheating issues. Can I have a test begin/end at 2400 hours? 2400 is also known as 0000 hours, which is the terminology we use. As long as the dates are different 0000 to next day 0000 would give the students 24 hours to take the test.

GRADE BOOK After students have completed a test, can I remove a question from the test if I determine it was a bad question? Yes, we have added the ability to throw out a question from the class test results page. You will just select the question or questions you would no longer like to be taken into account and click the “Exclude Questions” button. The program will then recalculate the test results without that question or questions.

Can I print off a quiz and then enter the quiz grade in the grade book as an “EMS Quiz” type? Yes. You would still need to place the test into the class as an active test. Make sure no students actually take the test online. This will create a set of zeroes you can then manually enter the grades. Make sure you either have chosen raw score or do the appropriate cut score conversion. Can I delete a test after students have taken it? No. We try not to delete evidence. With the grade book you do have the ability to make up whatever grades you would like. Can I grade some tests by Raw Score and some tests by Cut Score? No. You must choose one method or the other. Is there a way to get a print off of the “Class Detailed Results” from the bottom of the instructor-reporting page? Currently our system does not provide a print off of this information. Your Internet browser should have the ability to “print the page” or even print parts of the page. Can I change the answers on a student’s test, after the student has taken it, to change the answers of unfair questions and give them credit? No. Again, we try not to encourage tampering with evidence. Again, the grade book does allow you to make up whatever grades you would like. Can I organize all the grades in the grade book by their type? Not within the grade book itself but you can export the grade book to Excel where you can arrange the grades as you see fit.

61

CAT Can I see a report of all the questions my students were asked in the CAT? Nope. Can I see all the answers to questions I was asked on the CAT? As a student you cannot. When you select “Provide Feedback” the question and answers are sent to the instructor. Can I add my own questions to the CAT? Yes. Can I assign adaptive tests to students in the program? You don’t really assign them to the student you enable the student to take adaptive testing experiences. Is there a way to open up the adaptive testing to some students and not others? No. Adaptive testing is enabled by class not by individual student.

EDIT MY QUESTIONS Can I create essay/short answer questions for a test? Yes, but the system will not react well to this type of question unless you only print the test and do not administer it online. Can I add pictures to a question I create? Yes. Can I add my own assessment tests? Yes, but the assignment of type and level will be difficult.

62

WANT MORE Q&A’S?

For more Q&A’s on EMSTesting.com, go to our blog and choose the tag EMSTesting.com or click here to go directly to it. We add more Q&A’s each quarter to our blog. You can also see all new EMSTesting.com Q&A’s by subscribing to our mailing list to receive our quarterly newsletters. Did you know that Platinum Educational Group, the creators of EMSTesting.com also offer PlatinumPlanner.com for clinical and lab scheduling? If you are interested in a free trial, click to contact a Sales Representative today!