NEW FDNY RSOE PRACTICAL Exam

7/21/2020

NYCBill de BlasioMayor

Daniel A. NigroCommissioner

FDNY

Attendees Sign In

FDNY staff C2 representatives School representatives

2

Introduction The simulator replacement project started in October

2017. Purpose:

to bring the simulator to the latest computer technology with a stable operating environment

to bring the testing mode to reflect the current operating refrigeration equipment.

3

Development Process

FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years of combined industry experience in NYC .

Experiences learned from the old simulator were rolled into and improved upon in the new simulator.

4

Development Process

There have been many steps taken - including new test questions, 3-D model development, validation of questions, system upgrades, and other important steps.

One Alpha test. Two Beta tests:

Phase 1- invited Q-01/Q-99 holders to take the exam Phase 2- invited new examinees to take the exam

5

Preparation Materials

The FDNY will provide the following materials for free on the FDNY website: An instruction manual A tutorial video

6

New Exam Format Introduction

Two parts of the exam Part 1: 45 minutes walk-through and practice exam

(Mandatory) Part 2: 240 minutes actual exam with both

Centrifugal and Reciprocating systems

7

New Exam Format - Part 1 45 minutes walk-through and practice exam

explore both Centrifugal and Reciprocating systems; take the practice questions shown in the tutorial

video to practice how to select a question, find the answers, submit answers, and complete questions;

practice the use of navigation bar, tool box and reference materials.

The practice exam provides feedback so that examinees will know if they submitted the correct answers.

8

New Exam Format - Part 2 2 Systems- Centrifugal and

Reciprocating Choose either one to start. Must complete one system

first and then the other one. Cannot go back to the

previous completed system. Total time limit: 240

minutes (4 hours)

9

Categories in Each System

6 categories in each system. Operation Validation of Repairs/Maintenance Refrigerant Handling Troubleshooting Multi-Step Scenario

10

1. Operation

You need to know the locations and functionsof each component, examples: Component Identification; Component Function Reading Gauges Calculations of Temperature/Pressure Differences; Use of Pressure/Temperature Charts and

Conversions

11

2. Validation

Examples:Normal maintenance and repair problems;Validation of repairs; Start-up procedures

12

3. Refrigerant Handling Examples:

Refrigerant Recovery Refrigerant Charge

4. Troubleshooting Examples:

Troubleshooting and diagnosing problems with system operations

Interpret the readings and know which reference document is required for answering the questions. 13

5. Multi-Step Questions

These questions include multiple sub-questions, but do not rise to the level of complexity of a scenario.

They are a combination of comprehension-level and application-level learning and represent areas of content covered in all the categories above.

Only one multi-step question in each system. A multi-step question may have a maximum of 6

follow-up questions.

14

6. Scenarios These questions are at an application-level of learning

and will include portions of the question/scenario that connect to the other categories.

For example, the end-to-end recovery procedure for the reciprocating unit would go into this category, but a single question related to comprehending that process would be assigned to troubleshooting category.

Only one scenario question for each system. A scenario question may have a maximum of 16

follow-up questions.15

Beta Phase 1 10 Q-99/Q-01 certified examinees. Individual user interview after their trials. The goal:

to obtain user experience to validate the model layout and component.

After Phase 1: Improved the exam model Modified the tutorial video Developed the instruction manual Developed the proper score report

16

Beta Phase 2Score Distribution

0

1

2

3

4

5

lower than50%

50-59% 60-69% 70-79% more than80%

(total=13 examinees who do not have valid Q99/Q01 )

# ofexaminees

Beta Phase 2 Pass rate: 31%*Note: Old exam pass rate in the first 3 months: 21.7%

New Changes 3D model vs Real System Photos Old exam: real system photos New exam: 3D pictures (The examinees must be

familiar with the component legend.)

Entire System vs Part of the System Old exam: examinees only need to find parts in a very

limited area. New exam: examinees will see the entire system and

all the components. Examinees need to know where to find the exact component asked by the question

New changes

The reading of gauge/thermometer/control panel The reading or status is not shown in photos but shown on the status

bar.

New Changes

Navigation functions Examinees can hide the components Examinees can trace piping by highlighting the pipe

when rotating the system images

20

New Changes

Four terminals Currently we are set up to administer exams on 2

terminals, with plans to shortly expand to 4. This will significantly improve our ability to timely

schedule practical exams.

No mandatory failure question at all.

21

Feedback from the examinees

In the post-exam feedback, more than 90% of the examinees agree that the tutorial video is helpful for preparing for the new

exam walk-through session is helpful for being familiar

with the exam and system.

22

Quote from the examinee who got more than 90

What do you like most about this new exam?

“Better evaluation, not just memorizing a click sequence”

23

Lessons Learned You must watch the tutorial video several times. You must be familiar with the instruction

manual. You should use the walk-through session to

practice how to operate the exam and be familiar with the layout of the Centrifugal and Reciprocating systems.

24

Lessons Learned

It is a knowledge test not a memory test. You must have a knowledge of where each of

the components are located and what their functions are.

You must know how to identify inlet piping and outlet piping for chilled water vs condenser water or other systems.

You must know when to use the reference documents to answer the questions.

25

How can schools help? (Graduated students)

For the graduated students: email them the link of the instruction manual.Emphasize that the new exam is very

different from the old practical exam. DO NOT use the same preparation strategy for the new exam.

Emphasize that the instruction manual and tutorial video are critical.

26

How can schools help?(Current/new students)

Prepare students to be a Certified Refrigeration System Operating Engineers by training them: the general layout of the systems and where components

are located and their functions the common operation and maintenance tasks the use and interpretation of the common reference

documents, such as Safety Data Sheet (SDS), Pressure Temperature (PT) chart, Chiller Specification Sheet; Equipment schedules, and Reaction/Separation/Recycle (RSR) Operating Procedure Diagram.

27

New RSOE exam start date

Proposed start date: 09/08/2020. The FDNY will email/provide the scheduled

examinees with the new exam information before their exam. (The beta examinees received the material 4 days before their scheduled exam, and about 1/3 passed the exam.)

28

Exam Materials and Information

We will email the updated PowerPoint to all schools.

The PowerPoint, instruction manual, and tutorial video will be provided on the FDNY website.

29

Questions and Answersin the Seminar

Question: Can examinees watch the tutorial video at the FDNY, then take a 45min walk-through? Answer: No. Examinees must watch the tutorial on their own time and

device before they sit for the FDNY practical exam. The FDNY practical exam will only include the walk-through and the actual exam.

Question: Will examinees who are color blind have a negative experience with the color coding of components on this exam? Answer: No. The color coding of chiller system components used in the

exam is similar to a typical chiller plant. While color coding could help examinees identify components more quickly, knowledgeable examinees can identify and distinguish components by their shapes and locations in the system, without the benefit of color coding. Additionally, there are no questions where examinees must identify equipment of a certain color.

30

Questions and Answersin the Seminar

Question: The centrifugal chiller includes a portable recovery system. Will examinees be required to connect this system to the chiller? Answer: Effectively yes. Examinees will be required to know what

toolbox items are required, the locations where refrigerant hoses must be connected on the recovery system and the chiller, and what position recovery system and chiller valves must be in when hoses are connected and during refrigerant transfer operations. However, the model will not physically show the refrigerant hoses connected to the recovery system or the chiller.

Question: Why would examinees need to view the chiller from the “floor view?” Answer: Similar to a typical chiller system, there are components located

under the evaporator and condenser. The clearest look at these components would likely be from the “floor view.”

31

Questions and Answersin the Seminar

Question: When will the school receive the updated tutorial video and instruction manual? Answer: The updated material will be posted on the

FDNY website around mid August. The schools will also be notified via email.

Question: Anyone who is booked after 09/08/20 must take the new exam? Answer: Correct. Examinees will be provided with

the updated tutorial and instructional manual.

32

Any comment or suggestion?

You can email to provide any further comments or ask questions: huiyun.tseng@fdny.nyc.gov elsa.araya@fdny.nyc.gov

33