UTOP Instruments, User Manuals, and Samples

Instruments

The UTOP can be used to evaluate quality of instruction and provide meaningful feedback for improvement at any level of education, in a variety of settings. 

UTOP for Mathematics and Science Instrument [Word doc]

UTOP for Humanities Instrument [Word doc]

User Manuals

The UTOP is a criterion-referenced instrument, requiring training and recalibration to maintain the integrity and fair use of the instrument. Training guides are intended to provide resources to instruct, develop, and sustain inter-rater reliability.

Interactive discussion of terminology used to define and describe each indicator is essential for groups of observers in order to ensure consensus and consistency in the rating process. As much as is humanly possible, raters’ personal opinions and/or directive judgments and suggestions for improvements should not play a role in their choice of ratings; evidence for ratings must be based on what was observed or discussed in the classroom.

The UTOP can be used to evaluate quality of instruction and provide meaningful feedback for improvement at any level of education, in a variety of settings. It is composed of 26 items rated on a 5-point Likert scale (1 to 5), with an NA (Not Applicable) rating option for a few items where sufficient information may not be accessible during the observation session.

The UTOP instrument is designed for use over multiple observations of a teacher’s practices over the course of time—several weeks, at minimum—thereby reducing the impact of a low score on any other single indicator.

UTOP for Mathematics and Science Training Guide and User Manual [PDF]

UTOP for Humanities Training Guide and User Manual [PDF]

Sample Scoring

The examples—videos and sample completed instruments—provided here are intended for training purposes only and should be viewed and discussed in a formal training session with a UTOP certified facilitator.

Grade 8 Science: Energy Transfer

An observer scored this sample based on classroom observed in the AU4 Energy Transfer video on the TIMSS website.

Grade 8 Mathematics: Exponents

An observer scored this sample based on classroom observed in the US3 Exponents video on the TIMSS website.

Grades 10–11 Mathematics/Science: Project-Based Instruction

An observer scored a series of days based on a multi-day project observed in a classroom at Manor New Tech High School in Manor, Texas.