STANDARDIZED TEST OF BULGARIAN AS A FOREIGN LANGUAGE · 2019. 11. 13. · 3 GENERAL DESCRIPTION OF...

SOFIA UNIVERSITY ST. KLIMENT OHRIDSKI

DEPARTMENT FOR LANGUAGE TEACHING AND INTERNATIONAL STUDENTS

STANDARDIZED TEST OF BULGARIAN AS A FOREIGN LANGUAGE

EXAMINATION PURPOSE, CONTEXT OF USE, INTENDED POPUPATION AND

GENERAL DESCRIPTION OF THE ASSESSMENT

CORRESPONDENCE BETWEEN CEFR AND ACTFL PROFICIENCY LEVELS

2

PURPOSE OF THE EXAMINATION

The Standardized Test of Bulgarian as a Foreign Language (STBFL) is an examination for

test takers who want to evaluate their general Bulgarian language proficiency in social,

educational, and workplace contexts. The examination provides an assessment of the extent to

which the test takers are able to communicate effectively in everyday situations such as daily

routines, free time activities, traveling, education and career, the environment, cultural and

social life, etc. Listening recordings, reading passages and written task reflect everyday

interactions in a Bulgarian speaking environment.

The examination provides an objective and reliable assessment of the overall language

proficiency in Bulgarian as a foreign in terms of CEFR descriptors of linguistic competences.

The assessment is independent from any syllabus, teaching methodology or textbooks used.

Four language skills (speaking, listening, reading and writing) are tested and assessed. The

exam results are presented as:

• oral exam mark (speaking assessment);

• written exam mark (combining listening, reading and writing assessments);

• final exam mark (combining oral and written exam marks);

• verbal description of examinee’s communication skills in terms of CEFR Can-Do

statements.

CONTEXT OF USE OF THE EXAMINATION The exam is designed to assess the communicative competence in Bulgarian as a foreign

language in the following contexts of use:

• education at Bulgarian high schools and universities

• applying for work

• applying for the Seal of Biliteracy award when graduating from a high school in USA

• certifying the level of language proficiency of the students of Bulgarian schools abroad

• certifying the level of language proficiency of the undergraduate and postgraduate students

at Slavic faculties of foreign universities

• certifying the level of language proficiency of people for business, traveling, cultural

interchange or adopting Bulgarian citizenship.

POPULATION FOR WHICH THE EXAMINATION IS APPROPRIATE The examination is appropriate for the following groups of test-takers:

• students at Bulgarian schools abroad aged 13+

• students at public school in USA applying for Seal of Biliteracy award on their high school

diploma

• undergraduate and postgraduate students at Slavic faculties of foreign universities

• people who like to certify their proficiency in Bulgarian for education, business, traveling

or adopting Bulgarian citizenship.

3

GENERAL DESCRIPTION OF THE ASSESSMENT

• Title of the assessment: Standardized Test in Bulgarian as a Foreign Language

Available examination levels according the Common European Framework of Reference for

languages (CEFR):

• for young learners: A1.1, A1, A2

• for upper secondary, college and university students and adults: A2, B1, B2, C1, C2

• Skills tested

At each examination level (A1, A2, B1, B2, C1, C2) the four language skills (speaking,

listening, reading and writing) are tested independently with equal weights (25%) at the same

competence level.

• Languages for which the assessment is available:

Bulgarian

• When the assessment is given (end of a specific course, end of a language

level, when requested by student, etc.)

The assessment is given by the request of individual test-takers (individual examination) or by

the request of a school, college, university or authorized testing center (group examination).

• Description of how the scoring rubrics equate to the proficiency sub-levels and the method used to equate the scores:

First, the cut-off score for scoring rubrics is set by a panel of experts using the Angoff

method.

Second, the mean of the test scores for these rubrics is calculated.

Third, the segment from cut-off and maximum test score is divided into four approximately

equal sub-segments, corresponding to satisfactory, good, very good and excellent proficiency

sub-levels within the testing CEFR level. The mean of the test scores is within or very close to

the segment, associated with good proficiency sub-level .

• Minimum score used to equate to intermediate-mid proficiency:

For B1 level test the cut-off score is 60% and the minimum score for intermediate (good) sub-

level is 41 points or 72% out of 57 (the maximum test score).

For B2 level test the cut-off score is 60% and the minimum score for intermediate (good) sub-

level is 56 points or 70% out of 80 (the maximum test score).

4

• Description of the scoring process, including: • Who scores the assessments • What training is provided • What checks and balances are used to ensure inter-rater reliability

The reproductive skills (listening and reading) are computer scored by the examination

platform based on Moodle 3.5 release.

The productive skills (speaking and writing) are scored by certified raters, approved by the

examination board under rigorous rater certification procedure.

The raters training includes familiarization with CEFR Can-Do descriptors for language usage

and CERF descriptors for communicative competences, taking part in standard setting

procedures and benchmarking of samples of oral and written production.

Two rater reliability procedures were carried out in 2013 and 2015 to assess the inter-rater

reliability by calculating Cohen’s Kappa for pairs of raters and intraclass correlation (ICC) for

intra-raters agreement between different groups of raters.

DETAILED DESCRIPTION OF THE ASSESSMENT AT B1 AND B2 LEVELS OF CEFR B1 Level Assessment

Oral exam (Speaking)

Parts Tasks Maximum

score (points)

Candidate’s

scores

Part1 Interview 12

Part 2 Spontaneous communication 15

Part 3 Monologue 15

Part 4 Comment on a picture 15

Total 57 points

Minimum Pass Score 34 points 60% of the maximum

score

Converting Raw Scores Into Grades

Raw score (points)

0 - 33 34 – 40 41 – 46 47 - 53 54 - 57

Grade Fail (2)

Satisfactory (3 – 3.49)

Good (3.50 – 4.49)

Very Good (4.50 – 5.49)

Excellent (5.50 - 6)

5

Into each raw score interval the grade is calculated proportionally to candidate’s

raw score points.

Written Exam Written exam consists of 3 divisions – Listening, Reading and Writing,

whish are assessed independently.

Assessment Skill

Parts Maximum points

Candidate’s scores

Listening Global and detail listening comprehension, spontaneous communication

Part 1 15

Part 2 15

Part 3 15

Part 4 12

Total Minimum pass score

57 34

60% of the

maximum score


Raw score (points)

0 - 33 34 – 40 41 – 46 47 - 53 54 - 57

Grade Fail (2)


Good (3.50 – 4.49)

Very Good (4.50 – 5.49)


Into each raw score interval the grade is calculated proportionally to candidate’s raw score points.

Assessment Skill Parts Maximum points


Reading: Global and detail reading comprehension, Vocabulary and Grammar

Part 1 15

Part 2 15

Part 3 12

Part 4 15


57 34

60% of the maximum

score


Raw score (points)

0 - 33 34 – 40 41 – 46 47 - 53 54 - 57

Grade Fail (2)


Good (3.50 – 4.49)

Very Good (4.50 – 5.49)



raw score points.

6

Assessment Skill



Writing (Essay writing)

Part 1 25

Part 2 32


57 34

60% of the maximum

score


Raw score (points)

0 - 33 34 – 40 41 – 46 47 - 53 54 - 57

Grade Fail (2)


Good (3.50 – 4.49)

Very Good (4.50 – 5.49)



raw score points.

Final Examination Grades

Grade Numeric Verbal

Oral Exam Grade

Written Exam Grade (average of the Listening, Reading and Writing grades)

FINAL EXAM GRADE 0.25 х (Oral Exam Grade) + 0.75 х (Written Exam Grade)

The officially accepted system of assessment in the Republic of Bulgaria is the six-grade scale with the highest grade “Excellent 6” and the lowest pass grade

“Satisfactory 3”. Correspondence between Verbal and Numeric grades:

Numeric Verbal

2.00 – 2.99 Fail

3.00 – 3.49 Satisfactory

3.50 – 4.46 Good

4.50 – 5.49 Very Good

5.50 – 6.00 Excellent

7

B2 Level Assessment

Oral exam (Speaking)

Parts Tasks Maximum

score (points)

Candidate’s

scores

Part1 Interview 20

Part 2 Spontaneous communication 20

Part 3 Monologue 20

Part 4 Comment on a picture 20

Total 80 points

Minimum Pass Score 48 points 60% of the maximum

score


Raw score (points)

0 - 47 48 – 55 56 – 64 65 - 73 74 - 80

Grade Fail (2)


Good (3.50 – 4.49)

Very Good (4.50 – 5.49)



raw score points. Written Exam

Written exam consists of 3 divisions – Listening, Reading and Writing,

whish are assessed independently.

Assessment Skill



Listening Global and detail listening comprehension, spontaneous communication

Part 1 10

Part 2 10

Part 3 20

Part 4 20

Part 5 20


80 48

60% of the maximum

score

8


Raw score (points)

0 - 47 48 – 55 56 – 64 65 - 73 74 - 80

Grade Fail (2)


Good (3.50 – 4.49)

Very Good (4.50 – 5.49)



raw score points.

Assessment Skill Parts Maximum points


Reading: Global and detail reading comprehension, Vocabulary and Grammar

Part 1 24

Part 2 10

Part 3 10

Part 4 10

Part 5 26


80 48

60% of the maximum

score


Raw score (points)

0 - 47 48 – 55 56 – 64 65 - 73 74 - 80

Grade Fail (2)


Good (3.50 – 4.49)

Very Good (4.50 – 5.49)



raw score points.

Assessment Skill



Writing (Essay writing)

Part 1 40

Part 2 40


80 48

60% of the maximum

score


Raw score (points)

0 - 47 48 – 55 56 – 64 65 - 73 74 - 80

Grade Fail (2)


Good (3.50 – 4.49)

Very Good (4.50 – 5.49)


9


raw score points.

Final Examination Grades

Grade Numeric Verbal

Oral Exam Grade

Written Exam Grade (average of the Listening, Reading and Writing grades)

FINAL EXAM GRADE 0.25 х (Oral Exam Grade) + 0.75 х (Written Exam Grade)

The officially accepted system of assessment in the Republic of Bulgaria is the

six-grade scale with the highest grade “Excellent 6” and the lowest pass grade “Satisfactory 3”. Correspondence between Verbal and Numeric grades:

Numeric Verbal

2.00 – 2.99 Fail

3.00 – 3.49 Satisfactory

3.50 – 4.46 Good

4.50 – 5.49 Very Good

5.50 – 6.00 Excellent

CORRESPONDENCE BETWEEN CEFR AND ACTFL PROFICIENCY LEVELS

The Common European Framework of Reference for Languages abbreviated as CEFR, is a

guideline used to describe levels of proficiency in a foreign language. It was developed by the

Council of Europe and it is widely used in language teaching and assessment across Europe.

This framework, also known as CEFR levels, can be used to refer to all languages.

In this framework there are 6 levels going from beginner to near-native. Below are the short

description of the levels.

CEFR LEVELS DESCRIPTION

A1

BEGINNER

• Can understand and use familiar concrete everyday expressions and

very basic phrases.

• Can introduce him/herself and others and can ask and answer

questions about personal details such as where he/she lives, people

he/she knows and things he/she has.

• Can interact in a simple way provided the other person talks slowly

10

and clearly and is prepared to help.

• Main grammar points to know: common adjectives & adverbs of

frequency, going to, how much/how many, imperatives, I’d like, ‘s

– possessive, common prepositions of place and time, present

simple & continuous, there is/are

A2

ELEMENTARY

• Can understand sentences and frequently used expressions (e.g.

very basic personal and family information, shopping, local

geography, employment).

• Can communicate in simple and routine tasks and exchange

information on familiar and routine matters.

• Can describe in simple terms aspects of his/her background,

immediate environment and matters in areas of immediate need.

• Main grammar points to know: countable/uncountable nouns,

adverbs of frequency, future will/going to, much/many, present

perfect, past simple, past continuous, common phrasal verbs,

common modals: can/should

B1

INTERMEDIATE

• Can understand the main points of clear standard input on familiar

matters regularly encountered in work, school, leisure, etc.

• Can deal with most situations while traveling in an area where the

language is spoken.

• Can produce simple connected text on topics that are familiar or of

interest.

• Can describe experiences and events, dreams, hopes and ambitions

and briefly give reasons and explanations for opinions and plans.

• Main grammar points to know: question tags, intensifiers:

too/enough, future tenses, past tenses, modals, conditionals, wh-

questions in the past.

11

B2

UPPER-

INTERMEDIATE

• Can understand the main ideas of complex text on both concrete

and abstract topics, including technical discussions in his/her field

of specialization.

• Can interact with fluency and spontaneity that makes regular

interaction with native speakers quite possible without strain for

either party.

• Can produce clear, detailed text on a wide range of subjects and

explain a viewpoint on a topical issue giving the advantages and

disadvantages of various options.

• Main grammar points to know: perfect tenses, mixed conditionals,

modals in the present, phrasal verbs, reported speech, wish, relative

clauses

C1

ADVANCED

• Can understand a wide range of demanding, longer texts.

• Can express ideas fluently and spontaneously without much

obvious searching for expressions.

• Can use language flexibly and effectively for social, academic and

professional purposes.

• Can produce clear, well-structured, detailed text on complex

subjects, showing controlled use of organizational patterns,

connectors and cohesive devices.

• Main grammar points to know: inversion, mixed conditionals,

modals in the past, all passive forms, phrasal verbs (all patterns),

wish/if only for regrets

C2

PROFICIENT

(NEAR-NATIVE)

• Can understand with ease virtually everything heard or read.

• Can summarize information from different spoken and written

sources, reconstructing arguments and accounts in a coherent

presentation.

• Can express him/herself spontaneously, very fluently and precisely,

differentiating finer shades of meaning even in the most complex

situations.

See the official correspondence between CEFR and ACTFL levels on the next page.

12

13

INTERPRETATION OF THE EXAMINATION RESULTS

CERF A1 LEVEL ASSESSMENT

The four language skills (speaking, listening, reading and writing) are tested independently

with equal weights (25%) at the same competence level A1.

The pass grade (satisfactory, 3) for each skill means that candidates has the “minimally

acceptable competence” for this skill at the level being tested, e.g. A1.

The other exam grades indicate the following: the higher the exam grade the more competent

is the candidate within the tested level, e.g. A1.

According to ACTFL competence scale the exam results may be interpreted depending on the

exam grade as follows:

grade band 3.00 – 4.49 grade band 4.50 – 6.00

receptive skills (listening and reading)

NOVICE HIGH INTERMEDIATE LOW

productive skills (speaking and writing)

NOVICE HIGH NOVICE HIGH

CERF A2 LEVEL ASSESSMENT


with equal weights (25%) at the same competence level A2.


acceptable competence” for this skill at the level being tested, e.g. A2.


is the candidate within the tested level, e.g. A2.

CEFR competence scale does not distinguish in rating between receptive and productive

skills.





INTERMEDIATE MID INTERMEDIATE MID


INTERMEDIATE LOW INTERMEDIATE LOW

14

CERF B1 LEVEL ASSESSMENT


with equal weights (25%) at the same competence level B1.


acceptable competence” for this skill at the level being tested, e.g. B1.


is the candidate within the tested level, e.g. B1.


skills.





INTERMEDIATE HIGH ADVANCED LAW


INTERMEDIATE MID INTERMEDIATE HIGH

CERF B2 LEVEL ASSESSMENT


with equal weights (25%) at the same competence level B2.


acceptable competence” for this skill at the level being tested, e.g. B2.


is the candidate within the tested level, e.g. B2.


skills.





ADVANCED MID ADVANCED MID


ADVANCED LOW ADVANCE MID

15

CERF C1 LEVEL ASSESSMENT


with equal weights (25%) at the same competence level C1.


acceptable competence” for this skill at the level being tested, e.g. C1.


is the candidate within the tested level, e.g. C1.


skills.





ADVANCED HIGH SUPERIOR


ADVANCED HIGH ADVANCE HIGH

CERF C2 LEVEL ASSESSMENT


with equal weights (25%) at the same competence level C2.


acceptable competence” for this skill at the level being tested, e.g. C2.


is the candidate within the tested level, e.g. C2.


skills.





DISTINGUISHED DISTINGUISHED


SUPERIOR SUPERIOR

16

SAMPLE CERTIFICATE

MATERIALS DEVELOPED BY:

D-r Mardik Andonyan

Test Administrator

Dept. for Language Teaching & International Students

Sofia University

Date post:	23-Jan-2021
Category:	Documents
Upload:	others
View:	2 times
Download:	0 times

STANDARDIZED TEST OF BULGARIAN AS A FOREIGN LANGUAGE · 2019. 11. 13. · 3 GENERAL DESCRIPTION OF...

Documents