Notes for Week #5: Evaluating Educational Software I

Roger B. Blumberg, CS92/ED89, 227 CIT
http://www.cs.brown.edu/courses/cs092/2000/cs92.rbb6.html

Tuesday

Designing Interfaces for Education: A Few Dilemmas

The field of computer science is young compared to many other disciplines in the university, just as the introduction and use of computers in schools is a relatively recent development; thus, it is no surprise that we find it difficult to distinguish between knowledge, opinion and error in those areas of "research" where computer science and the use of computers in school overlap. Perhaps the best example of this difficulty can be found in the design and evaluation of educational software. Although there is already a significant literature on interface design and human-computer interaction, a quick survey of this literature reveals that the methods of study are primitive compared to those of other sciences, the sample sizes are insignificant by statistical standards, and the sample populations are biased in ways that prevent generalizing most if not all of the studies' conclusions.

So what is an educational software designer to do? Well, articles like "Screens for Learning" can lead us to ask good questions, even if the conclusions of the authors seem obvious. In the 1998 version of CS92, Elaine Chen articulated some of these questions in her Notes on Interface Articles and this semester Will Heublein has taken that analysis further with his notes for today, by proposing questions and exercises that get us to question basic assumptions about the design of the user interface. Similarly, articles like Copeland 1987 let us think about the design of educational software in terms of the sorts of functions we think the computer program should perform and the sorts of experiences the users of that software should have.

Thursday

Software Goes to School

The articles we're reading for today, by Nickerson and Schwartz, might be thought more ambitious than those we read on Tuesday. The concerns of the authors, and indeed all of the authors in the volume, are with how well-designed software can improve the effectiveness of learning, and specifically in the development of students' understanding of the material they study.

We'll spend most of the class time in discussions based on Aron's notes, but here are a few additional questions about Schwartz' "The Right-Sized Byte" that you might consider:


Home Page