From New Currents 2.5 November 1995

Applying computer-based multimedia in learning and instruction

Bohdan Bilan, Director
Shoppers Drug Mart Multimedia Development Centre

This is the second part of a two-part series by Bohdan Bilan on computer-based multimedia.

Introduction to part two

Software needs to be functional, adaptable, culturally sensitive, and capable of addressing a wide variety of learning and presentation styles. We need to develop effective instructional software quickly. I explored some of these issues in the October 10 issue of New Currents in Teaching and Technology (2.4.) In part two of this article, I will discuss two more applications of computer technology to the learning process.

The cultural component

Cultural considerations should be made when creating software. Learning Our Numbers is an example of a piece of software that placed cultural criteria ahead of accepted screen design and instructional design theory. In this project, Dale Auger, a graduate student in the Faculty of Education and Sagaw Cree from northern Alberta, wanted to explore the possibility of integrating native instructional methodology as he perceives it, traditional art, and native language into a storytelling format that allowed students to learn both English and Sagaw Cree.

The central character of Learning Our Numbers is Ayikis or little toad. The toad serves as a bridge between the learner and the content. When the program starts, Ayikis asks the learners if they would like to learn how to count.

The target audience is preschool and Division I students, both Cree and English speaking. The program doesn't assume facility in either language. The opening screen provides the user with auditory cues in both languages and visual cues on how to begin. Since the intended users are still developing their hand-eye coordination, screen buttons are large.

By selecting a language on the opening screen, the learners are sent to a screen that lets them choose Show Me (I want to learn new numbers) or How Many (a self test.) Many cultures use hand gestures and body language to augment verbal communication. The second screen in the program shows four hand gestures that are commonly used among the Cree to augment verbal communication. These gestures were incorporated into the screen's navigational buttons to serve as visual cues; they visually describe the function of particular buttons.

From the second screen, the learner can select an animal from a pictorial screen palette of animals found in the northern bush (i.e., bee, whitefish, duck, and jackfish.) These are all animals that the Cree children know and that have cultural significance.

If Show Me is selected, the learners are shown a screen that allows them to select a number between one and ten. The program then reveals animals flying or swimming past the little toad. Each step or instruction is reinforced with audio and written cues. If How Many is chosen, the learners then select an animal, and the program randomly designates a number between one and ten. The program then displays the chosen animal for the designated number of times in animated sequences. The learners can then tell the program how many animals they saw by selecting one of the numbers from one through ten located on a palette at the bottom of the screen. The program is designed to keep track of the number of attempts correctly and incorrectly answered while offering no limit to the number of questions chosen.

In both instances, the animated sequences end with the total number of animals being displayed and the Cree or English word for the number. The animal appears as text and the text is read by the little toad.

In its original inception, the program had to fit onto one high-density floppy disk and had to include the program shell, animated animal sequences (created by Michele Jacobsen, a PhD student in the Faculty of Education), and both the English and Cree digitized audio. The audio quality had to be very good, because the Sagaw Cree have a rich oral history.

One of the most interesting aspects of this project was finding the correct phrasing and spelling for the 60 Cree words that Dale had decided to use. Since the language is oral, its written form is still under development. When prototypes were taken to northern Alberta, members from different communities had difficulty agreeing on which word or phrases were appropriate given the context. Additionally, they could not agree on how to spell the words. Arriving at a written language set that most people could agree to took more than one year.

The program has undergone many iterations. Initially, it used more animated sequences in order to make it feel more like a non-linear story. Native story telling doesn't necessarily subscribe to the beginning, middle, and end model. Since the most important component besides the visuals were the audio clips, we decided that we would use 16-bit sound. This necessitated three sessions in the recording studio. In its current form, the program is stored in a non-compressed format on four floppy disks. The shell sits on one disk, the animated sequences on a second, and the English and Cree audio clips on two separate disks.

Computer-based thesis defence

Our final example is given from the perspective of the student. We were pleased to be asked by Dr. Brian Rusted, from the Faculty of General Studies, and Carol Jeffries, an undergraduate honours student in communication studies, to assist in the creation of a multimedia paper. This undergraduate honours thesis was presented and defended as a computer-based multimedia program titled Writing Reality. The thesis uses a variation of the shell (discussed in part one of this article) that was adapted to the content of the thesis. The thesis is an analysis of documentary script writing. Content included a rationale for choosing the multimedia format, history of the medium, rhetorical analysis of three documentaries, a conclusion and discussion, findings, and recommendations. The multimedia format was chosen because the medium being analysed and discussed was visual, documentary film. The project took six days to assemble. It consists of 90 MB (approximately 15 minutes) of carefully selected and edited digital video and approximately 600K of text. This multimedia thesis was delivered and defended successfully in the spring of 1995.

Conclusion

The variety of the programs being developed in our faculty has and will continue to provide us with new insight into the instructional software development and application process.


If you would like to interact with any of these projects, or if you would like to discuss the possibility of joint development, please call Bohdan Bilan at 220-7768, e-mail: bilan@acs.ucalgary.ca or drop by the Nursing Faculty, PFA 1243.