1

Classroom Observations: LoFTI

Evaluation Resources Link:Evaluation Resources Link:http://www.serve.org/Evaluation/Capacity/

IMPACT II MeetingUnion Middle SchoolDecember 11/2007

2

LoFTILoFTILooking For Technology Integration

Classroom technology observation protocol

http://www.serve.org/Evaluation/Capacity/EvalFramework/resources/LoFTI.php

3

What is LoFTI?

An “observation protocol” – a standard way of getting data about technology use in classrooms

A “drop-in” visit, not an immersion LoFTI is not a teacher evaluation! Review the paper-pencil LoFTI

4

LoFTI gathers evidence of how technology is actually being used

This is different from what people think or feel is happening

Records instances of particular uses, not the quality of use

Reports totals at the school level only

What data does it collect?

5

Concepts examined by LoFTI Classroom organization Teacher and student activities Student-assessment methods Student engagement Technology’s role as a learning tool Hardware and software use

What data does it collect?

6

Why would we use LoFTI?

You want to ask… How often is technology being used in

classrooms? What do classrooms look like when

technology is in use? What are teachers and students are doing with

technology?

7

Why would we use LoFTI?

You want to ask… How engaged are students when using

technology? What hardware and software are used most

often by teachers and students?

8

Determine who will do LoFTI visits Practice using LoFTI and compare results

among visitors Do a large number of LoFTI visits

Make visits unannounced Stay only 5-10 minutes See rooms at different times and days Avoid non-instructional times

How do we use LoFTI?

9

Avoid influencing class activities Think about visitor placement Avoid temptation to provide feedback to teachers

Record only what is observed during the visit Keep track of visits but do not associate names

or room numbers with data

How do we use LoFTI?

10

What can we learn from it?

Compare with STNA data to confirm classroom practices, student activities, and impact of technology

Use results to inform decisions about improving project implementation

Plan for how you will report results to staff members in a timely way

11

The Observer

The observer doesn’t have to be a principal; in fact, it’s often desirable for teachers to observe each other.

It’s crucial that all observers be trained in how to use LoFTI before they actually use it. It’s not the same as observing teachers for their performance review.

12

LoFTI page 1.

Is technology in use? # Students in Class vs. # Students

using technology Activities – Check only if technology

is being used

13

LoFTI page 1.

There may be more than one response for each item – check all that apply

“Content Area” is defined by the learning goal(s) of the activity

Use of “Other” response

14

LoFTI page 2.

Student engagement – Mark the percentage of students showing each positive indicator

Technology used as a tool – Adapted from Partnership for 21st Century Skill

Hardware – Definitions are broad

15

LoFTI page 3.

Definition of “use” – Record who is actually “touching” the technology

Web applications are scripted programs, not types of resource (e.g., libraries)

16

Using The Protocol

Visits are not scheduled. Keep a separate record of visits Avoid typical non-instructional times

– beginnings, endings, or transitions. Visit a given room at different times

and days of the week.

17

Using The Protocol

Visit more rooms for shorter times rather than fewer rooms for longer times.

Spend at least 5 and not more than 10 minutes in each room.

If technology is not in use, mark “No” and move on – this is data.

18

Using The Protocol

The observer’s presence will undoubtedly influence what they observe.

Be mindful of the observer’s placement and interactions with students and teachers.

Observers should record only what is observed during the actual visit.

19

Using The Protocol

Teacher’s name or room number aren’t noted on the Observer Record.

Since LoFTI is intended for school use, it shouldn’t be used to give feedback to individual teachers.

20

The Data Tally Tool

Emulates bar graph output of how often each instance occurs.

Update the Data Tally Tool regularly to avoid “embarrassing data build-up”.

Tallying is easiest with two people.

21

The Data Tally Tool

Tally over a designated time or number of observations.

Will accommodate new data until any row is full.

…

22

Interpreting LoFTI Data

Of the 60 visits technology-use was not observed on 14 occasions. Technology-use was observed in 46 (or 77%) instances.

23

Interpreting LoFTI Data

Of the 46 instances in which technology-use was observed, the learning environment reflected that in:

•16 instances, technology-use was observed in the a classroom (35%)

•13 instances, technology-use was observed in a computer lab (28%)

•17 instances, technology-use was observed in the media center (37%)

24

Interpreting LoFTI Data

First level – How often technology is used?

Second level – What technology tends to be in use?

Third level – What are the implications?

25

Interpreting LoFTI Data

LoFTI data don’t allow you to see correlations or associations (e.g., how often calculators are used to teach math).

With this type of data, it’s not appropriate to do any further statistical analysis (e.g., determining means).

26

Technology-Enabled LoFTI

Electronic version of LoFTI is being developed for Pocket PC, Palm, and Windows operating systems.

Data will be maintained on PC in each school, in Access databases.

27

Technology-Enabled LoFTI

Electronic version of LoFTI is being developed for Pocket PC, Palm, and Windows operating systems.

Data will be maintained on PC in each school, in Access databases.

28

LoFTI PDA Version

When initiating a new LoFTI observation:

•Select time in

•Select date

•Type, graffiti, or scroll to record the number of students in the classroom

•Type, graffiti, or scroll to record the number of students using technology

29

LoFTI PDA Version

30

LoFTI – PDA Version

Scroll to select the question to be answered.

31

LoFTI – PDA VersionCheck box to respond to Yes/No questions and Teacher/Student use.

32

LoFTI – PDA Version

Type or graffiti notes for text “other” responses.

33

LoFTI – PDA Version

Use scroll bar or type response to behavioral involvement questions.

Save at any point and exit the observation file

34

LoFTI – PDA Version

LoFTI generates a file number for each observation.

•File name format is mm/dd/yyyy/hh/mm/ss

•Month/day/year/hour/minute/second