Language Proficiency Test - infoWERKlpt.infowerk.at/help/lpt-help.pdf · ICAO...

Document version 14.2.2, 2014

USER MANUAL© 2014 Infowerk

All rights reserved. No parts of this w ork may be reproduced in any form or by any means - graphic, electronic, or mechanical, including

photocopying, recording, taping, or information storage and retrieval systems - w ithout the w ritten permission of the publisher.

Products that are referred to in this document may be either trademarks and/or registered trademarks of the respective ow ners. The publisher

and the author make no claim to these trademarks.

While every precaution has been taken in the preparation of this document, the publisher and the author assume no responsibility for errors or

omissions, or for damages resulting from the use of information contained in this document or from the use of programs and source code that may

accompany it. In no event shall the publisher and the author be liable for any loss of profit or any other commercial damage caused or alleged to

have been caused directly or indirectly by this document.

Printed: 2014 in Innsbruck, Austria

© 2014 InfowerkPage 2

Language Proficiency Test

© 2014 Infowerk Page 3

Table of Contents

Part I Introduction 5

........................................................................................................................................................................................... 61 Requirements

........................................................................................................................................................................................... 72 IW-LPT and ICAO

Part II Quick usage guide 10

........................................................................................................................................................................................... 101 Getting started

........................................................................................................................................................................................... 112 Menu items and usage

........................................................................................................................................................................................... 143 Examination

........................................................................................................................................................................................... 194 1st rating

........................................................................................................................................................................................... 245 2nd rating

Part IUSER MANUAL

Page 4 © 2014 Infowerk



1 Introduction

Welcome to the Language Proficiency Test Tool

IW-LPT is an aviation language testing tool for testing candidates in accordance with the ICAO language proficiency requirements. The questionnaire is considered appropriate to the diverse contexts in which aviation language testing occurs. The principles underlying this questionnaire suit various operational and regulatory needs.

This test is designed to assess SPEAKING and LISTENING proficiency abilities in accordance with each component of the ICAO language proficiency rating scale and the holistic descriptors.

ICAO standard phraseology should be used whenever possible but when phraseology is not applicable pilots and air traffic controllers should demonstrate also PLAIN ENGLISH.

The minimum skill level requirements are embodied in the ICAO language proficiency rating scale.LEVEL 4 is considered the minimum level of proficiency to ensure an acceptable level of safety.

IW-LPT may be used for testing operational (4), extended (5) and expert (6) level.

This is the document version 14.2.2



1.1 Requirements

Requirement for the Usage of the LPT-System

Headset:A headset connected to the computer is required.To record the interview in a good quality, we recommend to install a table microphone.

Computer:A standard computer suitable for office purposes.

For optimal use we recommend a minimum screen resolution of 1280 x 1024 pixel.

Operating system:Windows, Mac OS X

Internet connection:We recommend a high speed internet connection for optimal use. The minimal requirement is a bandwidth of 512kBit.

Webbrowser:Currently we support the following browsers:

Internet Explorer 6Internet Explorer 7Internet Explorer 8Internet Explorer 9Internet Explorer 10Internet Explorer 11Firefox up to the actual versionSafari 4Safari 5

Flash:A functional Adobe Flash Plugin, minimum version 10, is required.

Javascript:Javascript must be enabled in the webbrowser.

Acrobat ReaderFor displaying the final documents the Acrobat Reader is required. You can download it for free at the Adobe Homepage.



1.2 IW-LPT and ICAO

The philosophy of the software is to give the examiner an easy to use tool according to theICAO requirements and the specifications of the local authority. Also the final document output will depend on the needs of the examination country. There are no limitations on the number ofexams conducted by the LAB/LPE/LPLE. Only exams finished by the candidate are invoiced at the end of the month. To give the examiners and raters some support in rating the exams, the possible answers are also provided in the rating interface. In addiction the LAB can manage their examiners and raters on their own.

The software combines the semi-direct testing method as described in ICA O Circula r 318-A N /180 cha pter 1, §3.6.7 and also the capability to rate the interview in direct testing mode as described in ICA O Circula r 318-A N /180 cha pter 1, §3.6.3.As a result of this concept the testing method can provide the complete requirements of the ICAO as described in ICA O Circula r 318-A N /180 cha pter 1, §3.6.9.

The core of the software is the question pool.To guarantee a wide range of testing capabilities we split the pool into eleven sections:

Common questions

Personal questions

ICAO phonetic alphabet

Pictures and animations

Animations and drawings

Personal opinion

Accident, incident, occurrence reporting

Radiotelephony

Radiotelephony emergency situations

Aviation operations

Standard and emergency situations – interactions

In the system configuration it is defined, how many questions of each category are provided at least for the test. This ensures a comparable result over a wide range of exams and minimizes the possibility of having two similar exams.

For local needs we have designed an interface definition, so that individual questions can be implemented quite easily. We also provide a versioning of the question pool. For guaranteeing an access to the exams for at least ten years we must ensure, that the questions can be replayed as they have been at exam time. Even a change in the rating criteria assignment would cause a new version of the question.

The question pool was developed with two level 6 examiners and a LPLE, so the requirements of ICA O Circula r 318-A N /180 cha pter 1, §4.1 to §4.11 and cha pter 2, §1.2 to §1.2 are fulfilled .

There is a special logarithm implemented to be able to select classified level 6 questions and also questions related to the pilot’s license. We fulfill the needs and comply with principles of good practice and a code of ethics as described in Doc 9835.

For providing several dialects we use a minimum of four speakers in the question pool.The rating mechanism uses strictly the requirements as described in



ICA O Circula r 318-A N /180 cha pter 2, §1.3 and §3.1.We provide a short demo of the complete software as described in ICA O Circula r 318-A N /180 cha pter 2, §4. Due to security reasons the demo-mode provides only the first question of each category.An examination for english level 6 requires that the student writes a summary (minimum 80 words)on his english competencies.

As described in ICA O Circula r 318-A N /180 cha pter 2, §4.2.1 and §4.2.3 we have implemented some security features to avoid manipulation of the exams. The questions will be selected after the audio check immediately before starting the test. The candidate has to answer all 30 questions without the possibility of a break. An interrupted exam cannot be continued and has to be repeated. The data of the interrupted exam will remain in the system for statistic and audit needs.

The backup mechanism as described in ICA O Circula r 318-A N /180 cha pter 2, §4.3 is working automatically in a daily process. All recorded audio data and the whole database is stored on a backup system in our datacenter in Vienna, and also on the backup system in our company. The process is monitored and possible errors would cause a technician to check the systems.

The backend of the software are two server systems and a backup mechanism. The main server provides an http-server and a MySql database system. PHP, Javascript and Flash as programming languages ensure an optimal load balance between client and server. The minimum requirements to use the system match to almost every actual office pc. For downward compatibility we also support older browser versions including the outdated Internet Explorer 6.

As described in ICA O Circula r 318-A N /180 cha pter 2, §6 the raters must have a valid examiner or LPE license. These licenses are given from the local authority, which is also providing the initial training as well as the rater-, LPLE- and LAB-trainings.

The training of the candidates is done by the several raters and LAB’s. In Austria the national authority provides the preparation for testing methods as described in ICA O Circula r 323-A N /185 during the rater training.

Part IIUSER MANUAL




2 Quick usage guide

Short Overview of the LPT-System

This quick user guide shall help you to start the application without problems.

2.1 Getting started

Please log in to the system using the username and password you got from Infowerk.

After a successful login switch to the system menu. You will see the main window. In this example the user level is Examiner / Rater.



2.2 Menu items and usage

Menu items in the system

According to the user level there are up to 4 menu entries available:

My AccountExaminer / Rater / Admin (LAB Admin only)CandidatesLPT

My Account

These are the actual data of the currently logged in User.You are able to change several personal information, including login name and password.

Please ensure, that the Examination Country is selected correctly!



Examiner / Rater / Admin

If you are registered as Language Assessment Body, the defined admin of the LAB

can insert ( ) and the data of the other members of the LAB.

Candidates

Before you can start an exam, the candidate must be inserted into the system.

Here you can manage the candidates basic data ( , ) .



And you can insert and plan a new exam ( ), with all details. You will jump directly to the LPT section.

Please make sure you enter the correct licence data, this information will be used as criteria for the questions and also printed on the final PDF.



LPT

In this section all information about exams is accessible. Depending on your user level and your login the displayed options may be different.

Logged in as Examiner / Rater:

You can only see your own exams and those, where you have the role as 2nd examiner. The date behind 'P: ' shows the date of assignment.

Logged in as Admin:

You can see all exams of the LAB, assign and edit them and finally download the PDF. An admin is not allowed to start examinations.

2.3 Examination

Examination in the IW-LPT-System

To start an exam you must be logged in as examiner / rater.

Ensure to select the correct candidate. Press to continue.



(Level 6:) Personal assessment

First the student has to write a summary (minimum 80 words) on his english competencies.

Audio test

After starting/continuing, the examination tool starts up. You will be asked by Adobe Flash Player to allow the software to access your microphone.

Select to continue.

Then you hear a question and you have to answer to check the volume adjustment.



Afterwards you can review to the recording quality. Please ensure, that the volume is high enough and the quality is clear.

If necessary, adjust the audio-settings of your computer/headset

and the procedure.

Accept and start the recording part of the exam

After you press you will see the screen with the start button.

You have to the Declaration of consent to start the recording part.



- From this point the exam (question part) is running till the end. - Do not refresh the page or interrupt the exam, there will be no possibility to start again. - Please be patient while loading the questions!

The exam (questions)

There are 4 different types of questions: pure audio, text, animation and image. In each type the question is spoken. All 30 random questions take about 20 - 30 minutes.

In the window are several controls:

Volume of the spoken question

Time display for the duration of the answer

The Button

If you left the fullscreen mode the button is visible



The exam (interview)

After the question part you can start the interview ( ).

After installation of the table microphone it is recommended to conduct an audio test (the same as

in the question part). The student has to the conditions for conducting at the beginning.

- From this point the interview is running till the end. - Do not refresh the page or interrupt the interview, there will be no possibility to start again. - The minimum time is 15 minutes. After this time you can stop the interview.



2.4 1st rating

1st Rating by LPE

The LPE can evaluate the questions of the Computer Based Exam (CBE) either before or after theinterview.

Rating the CBE

The colored buttons will guide you through the various actions. They will change according to the state of the exam.

- The date/time behind 'S: ' shows the start date and time of the question part. - The date/time behind 'E: ' shows the end date and time of the question part. - The time behind 'D: ' shows the duration of the question part (20 - 30 minutes).

Start the CBE rating procedure

Click on the button ( or in a later status ).

(Level 6:) Text of personal assessment

First you can review the personal assessment written by the student. It can serve as an additionalmeans for the assessment.

To rate the questions click on the button on the top.



The CBE Rating

The button plays the question, the button plays the recorded answer.For each question you can set the reached proficiency level in each possible category.

If you want to set the whole row to a specific value, you can use the preset selectors on the top of the list. A dialogue box will appear. Please select the option you need.



You can leave the rating screen every time, the current state is saved immediately.

Finishing the CBE rating

When all questions are rated, you will find a button at the top of the main window.

You have to conclude the rating before you are able to go ahead in the system.

You can not change the rating of a concluded CBE.

You can view the details of a concluded CBE-rating by pressing the button

and . The ratings are displayed as values and small bars:



Start the interview rating procedure

After the CBE is concluded you are able to rate the interview and the holistic descriptors.

Click on the button ( or in a later status ).

To listen to the interview, use the player on the top right.

You can set the reached proficiency level in each possible category and holistic descriptors.

At this point the additional language proficiency can be entered also at the right side.



When all is rated, you will find a button at the top of the main window.

You can not change the rating of a concluded interview.

Finishing

If both parts are rated and concluded, you can view the details by pressing the

button and .

You will be able to download a PDF-sheet "R1" with the results of the 1st rating. This may be different, depending on the several requirements of the different countries.

As LPE you have to download the PDF R1 (using the button ),

sign it, scan and upload it as "R1S" using the button .

The upload dialogue for R1S:

Please note, that ACG only accepts forms with the original sign of the first rater.



After an upload you can upload R1S again (in case of mistake) using the button ,

or download your uploaded R1S using the button .

If you upload the R1S-document again the previous document is replaced and not available anymore!

2.5 2nd rating

For all exams a 2nd rater is required.

Once you have finished your 1st rating, a button appears:

Click on it and you will see the access-code.



You have to submit this India Whiskey Code and password to the 2nd rater. He has to be a LPLE.

The second rating by a LPLE

The second rater (LPLE) can find the appropriate exam by inserting the individual

India Whiskey Code in the right search box. After accepting the exam ( ) he has

to insert the given password and click on .

The second rater (LPLE) uses the same user interface as the initial rater, without the

Holistic Descriptors. (See chapter "1st rating".)

To ensure the independent assessment through the LPLE, he can't see the initial assessment of the LPE.

After concluding of the CBE and interview rating you are able to view the details of the exam

using the button and .



All question ratings are displayed as values and small bars.Here you can compare the rating of the LPE (left bar) with the rating of the LPLE (right bar).

Depending on the deviation the bars are highlighted:



Index

- 2 -

2nd examiner 11

- A -

additional language proficiency 19

- C -

candidates 11

Chrome 6

Computer 6

conclude 19

concluded 19

- E -

Examiner 10, 11

- F -

Finishing the CBE rating 19

Firefox 6

Flash 6

- H -

Headset 6

- I -

Internet 6

Internet Explorer 6

Introduction 5

- J -

JAR Licence 11

Javascript 6

- L -

LAB 11

Language Assessment Body 11

licence data 11

- M -

Mac 6

main window 10

My Account 11

- P -

personal information 11

- R -

Rater 10, 11

Rating 19

Rating the CBE 19

- S -

Secretary 11

Short Overview 10

- T -

The CBE rating procedure 19

The INTERVIEW rating 19

- W -

Webbrowser 6

Windows 6

Printed: 12.12.2014 in Innsbruck, Austria

© 2014 Infowerk

Page 28

Date post:	17-Mar-2020
Category:	Documents
Upload:	others
View:	5 times
Download:	0 times

Language Proficiency Test - infoWERKlpt.infowerk.at/help/lpt-help.pdf · ICAO...

Documents