COMPUTER SOFTWARE
The major kinds of software are described, rather artificially, in the categories below. Games represent one of the largest segments of the industry, but these are not considered in any detail in this discussion.
Productivity - Often referred to as tool software, this category includes the fundamental core of software programs essential for general productivity as a competent student or professional. These include word processing, spreadsheet, database, and graphics programs. Specialized programs will be important to specific disciplines and jobs, but these core programs are important for almost everyone.
Drill and Practice - Much maligned by teachers and the popular press, drill and practice software represents one of the earliest specialty areas in educational and training software dating back to the mainframe days of the 1960s. Despite the criticisms, drill programs in math, typing, and other areas can be effective and useful to certain students under the right conditions.
Drill and practice provides students with practice on concepts they have already learned. Good drill and practice provides feedback and explains how to get the correct answer. Some contain student management systems that keep track of student progress. Two of the most popular titles of this type are Math Blaster, and Number Munchers, by Minnesota Educational Computer Consortium.
Problem Solving - With increased emphasis on problem solving skills, a number of titles have appeared that promise to improve thinking and reasoning ability. One popular program is the Oregon Trail which creates problems for students to solve in a wagon trip in 1850. Where in the World is Carmen Sandiego and its subsequent variations, is probably the most well known. There are now many kinds of similar software, stand alone and on the Internet, but the efficacy has not been thoroughly investigated.
Tutorials - A tutorial is designed to teach a new skill or knowledge. Many tutorial programs have been developed for education and training at all levels, and these are especially popular with the military. Multimedia applications are increasingly popular.
Demonstration and Presentation - The most prevalent software in this category is PowerPoint, which is used to make a slide show. This may be the most widely used application of professors and teachers for synchronous presentations to accompany lectures and speeches.
Reference - These are electronic forms of encyclopedias, atlases, dictionaries, and other informational databases.
MultiMedia - While this has been a separate category, all it really means is that a software program incorporates sound, graphics, animation, video, and pictures. Many software programs on the Internet and CD-ROM have comprehensive programs that use all these elements for entertainment and instruction.
Simulation - A simulation is a facsimile or "virtual" activity offering a student the ability to vicariously experience something through a computer without actually suffering the consequences of mistakes, such as flying, driving, or engaging in some scientific experiment. As in other cases, the distinctions between categories can become blurred. For example, with more intensive graphics and audio, the Orgeon Trail could qualify as a simulation rather than only problem solving. On the other hand, a simulation, such as Sim City, which simulates growth and planning problem for city planning, certainly requires problem solving.
The Computer as a Tool
Although even pre-school and kindergarten children may use computers, and there is a "Writing to Read Program" available for children this young, most children around the third grade are able to begin to learn keyboarding skills, although there is considerable debate about this practice and the desirability of training children in such skills. Some writers are especially worried about children using computers for fear they will become socially stunted, isolated, or otherwise damaged by unknown effects of the equipment on both psychological and physical development. So far there is little evidence to answer such questions.
Computer-Assisted Instruction. Although students may use CAI, the teacher should be careful to explain the purpose of using software at school. Children should not think that computer use is for entertainment, even in a game format, and especially their parents should be made to understand this distinction. This does not mean that students should not enjoy using the computer, but its use in most classroom activities, most of the time, will be educational and not recreational. If popular games are played, children and parents may get the notion that the teacher is wasting time in frivolous pursuits. There are some excellent educational programs designed in game formats, but everyone should know the difference between these and those that have no substance other than pure entertainment. Students should be given a review and demonstration of the types of software, such as drill, tutorial, simulation, problem solving, and games, and receive an overview of their purposes.
Other Uses of Computers for Students
Subject Matter
The curriculum subjects of American education are Mathematics, Science, Social Studies, Language Arts, and Fine Arts. At the elementary level, mathematics, language arts (reading and writing), and fine arts are emphasized. At the Kindergarten and 1-3 grade levels, reading software is the most prominent, followed closely by mathematics software. At the 4-6, 7-8, and 9-12 grade levels, mathematics software is the most predominant category. In the last few years, the WorldWideWeb (WWW) has made it possible to provide a wide range of learning activities and resources for teachers and students. In the past, the emphasis was on specific commercial software packages for use in the classroom, but the WWW has expanded the horizons far beyond individual software and CD-ROM applications.
Science and social studies are introduced in the middle grades, and gradually students are introduced to highly specialized content in each area. Mathematics is ultimately divided into geometry, algebra, and pre-calculus. Science is split between the physical sciences and biology. Reading drops out as a subject, except for occasional reference to study skills, and students may become immersed in English ranging from parsing sentences to writing themes and studying literary greats. Social studies focuses on history, and there is now a trend to reemphasize geography. Fine arts becomes an elective for most high school students who may play in the orchestra or the band and engage in specialized visual arts.
Mathematics and Science
The computer was originally a device to "crunch" numbers, thus it seemed to fall within the domain of mathematicians. Mathematics is increasingly important to the future of American technology, and the computer can be both an instructional device for teaching mathematics as well as a tool for engaging in mathematics study and applications to real problems. Currently the entire mathematics curriculum is being changed at the university level, as professors of mathematics and education deal with ways to make it more attractive and interesting to students.
Although most students are able to demonstrate competency in computational skills, the overwhelming majority are incapable of solving problems requiring several successive steps (Dossey et al. 1988). This has caused a closer examination of teaching and the school curriculum, with recommendations for changes in curricula, teaching methodologies, and assessment techniques (Steen, 1989). Metacognition strategies are emphasized by new reformers, meaning that students must be active participants in their own learning rather than passive receivers of knowledge. This requires interactivity and feedback, something that cannot be accomplished by classroom instructional techniques alone for each student.
Mathematics is dependent upon feedback and corrective learning, more so than subjects dependent upon reading and memorization, although teaching strategies in mathematics often emphasize teaching by telling, rote, and memorization of rules (Cooney, 1988). If students miss key concepts in mathematics and sufficient practice in applications, failure may be certain because the foundation for future learning is absent. There have been many recommendations to reform how mathematics is taught (e.g. McKnight, 1987; Alliance of Business, 1987).
The computer can become a very useful tool in the elementary curriculum and at higher grade levels to enhance and improve achievement. Also, there is a trend toward integrated instruction of science and math, and the computer can serve this role as a multimedia device. Results of computer-assisted instruction in mathematics has been very positive. Children who use the computer as a tutor make great gains in mathematics achievement. Even drill programs give children a lot more interaction with math concepts and problems.
Programming Instruction
Early in the computer movement, there was an emphasis on computer literacy, which was interpreted to mean programming instruction for students of all ages. The main reasons for this were:
(1) schools could not afford to buy many computers, so the few they purchased were housed in labs;
(2) most software was poor, and teachers had difficulty incorporating lessons in the lab with classroom activities; and
(3) the only effective way to use a computer was to program it.
The Office of Technology Assessment ( http://www.ota.nap.edu/ reported that results of research on programming instruction are mixed, and there is no overwhelming evidence to believe that programming improves mathematics achievement. In this respect, LOGO and BASIC, two popular programming languages used in schools, have not been shown to improve thinking skills in general, as hoped by many practitioners (Palumbo, 1990).
In the 1940s, E. L. Thorndike, the "father" of educational psychology, challenged the theory that the brain is a muscle and, through a series of investigations, was able to demonstrate that mental discipline training did not actually exercise various mental faculties. Students who completed courses in Latin or Geometry were no better at solving logical problems than students who had not taken these courses. The emphasis was shifted to transfer of learning, the theory that the knowledge bases must be specifically applied to problems and that those who are well-grounded in a knowledge base will more easily solve novel problems.
Computer programming languages do not apparently teach, either specifically or incidentally, the language of mathematics, logic or thinking skills. Children may be able to make computer programs but not be able to demonstrate transfer to other types of problems where thinking is required for solutions and planning. du Boulay (1980) reported that students who experience difficulty learning mathematical concepts also have difficulty learning programming concepts. The conclusion was that learning to program required a lot of time, time that could be devoted to learning mathematics directly.
Math and Science Software
The percentage of software for mathematics by areas is skewed in favor of basic skills. Science software is more abundant at the high school. Secondary schools are reluctant to use software. However, where such software is used, there have been good results. High school students who used computer simulations to learn Newtonian laws of motion achieved significantly more than students who did not use the program (White, 1984). Microcomputer-based laboratories (MBL) have been used to provide students with discovery tools for measuring natural phenomena, such as properties of light, heat, and sound . If children are permitted to use an inquiry-based approach with such tools, they apparently learn much. However, if the teacher forces the children to watch a demonstration rather than experiment, the value is far less. Mokros and Tinker (1987) and Thornton (1985) reported that children were able to reveal an understanding of distance and velocity after using graphing programs on computers. One of the problems with inquiry-based or discovery approaches is that they take time and do not fit neatly into the school day and into lesson plans.
Language Arts
No subject in American public schools has received more attention and resources than reading (Haberman, 1989). But it is worth noting that computers will not interfere with reading nor with interest in books. In many ways, the computer can support and even create an interest in reading about many topics.
Except for math, the majority of software packages have been developed for language arts activities. Those who benefit the most from reading software are low-achieving and minority children. Many studies have shown the computer to be highly effective with these pupils. Roth and Beck (1987) reported on success with low-achieving, poor black children using reading recognition programs. Olson and Wise (1987) report on successful gains of poor readers who used a computer program with audio feedback.
Vocabulary, grammar, and spelling have received far less attention from software developers, but computers are useful indirectly, at least. The computerized spell checker and Thesaurus have apparently benefited many writers of all ages. There are also some grammar checkers. Expanded use of word processing programs has apparently had a beneficial effect in education for motivating children to write. Some schools teach keyboarding at an early age and introduce word processing. Many secondary teachers use word processing, especially in English classes. Some particularly useful sites for writing instruction are these:
Adaptive and Assistive Technology
There are many, diverse applications of specialized software and hardware for disabled
children and adults. These include positioning, mobility, and ergonomics, which is
particularly important for the classroom. Augmentative and alternative
communication systems that enable people with speech and language disabilities to
communicate with others more effectively.
There are numerous devices for sensory disabilities (blindness, visual impairment, low
vision) and auditory (deafness and hearing impairment, hard-of-hearing) impairments.
Many of these systems are also helpful with students who have learning disabilities.
Software Evaluation
One of the early concerns about educational software was quality. The original intent of software evaluation was to determine if a product waseffectiveor the extent to which it matched or surpassed traditional instruction as measured by achievement or gain scores on tests. In a research design students can be carefully matched with others in order that two or more groups might learn the same content but under different treatments. Very often software evaluation is based on expert opinion. Using an instrument or set of criteria, a professional educator reviews a piece of software and makes a subjective evaluation about its quality. Research and expert opinion are highly different approaches to software evaluation. Obviously research takes time and costs money; expert opinion is easier to obtain. With rapid expansion of the WWW, many are now concerned with evaluation of web sites. It is a practical impossibility to evaluate millions of web sites and hundreds of thousands that are added each year. As a result, there is now greater emphasis on teach "media literacy" to students so they can be better consumers.
Importance of evaluation
Evaluation is important to be certain that available resources for software are used wisely. Textbooks and other materials purchased in the school are approved for use, sometimes at the state and local levels, by various committees. The tremendous growth of the software industry has made evaluation at the classroom level even more important. In the past, with fewer options, the best software was easier to identify. Teachers must be certain that software they use in the classroom matches the curriculum goals of the school and is also correlated with the needs of students at various levels.
Evaluation Approaches. The principal goal of software evaluation is to determine those software programs that could be used in classrooms with particular students. Most software in education is evaluated by expert opinion using private or explicit criteria. Unlike a book or video tape which can receive a cursory overview, software requires more effort. The evaluator must load the program and work through the lessons in order to make judgments. Many teachers do not have the time to do this. Therefore teachers often rely on evaluations done by others which can be found in various places as printed information or on-line. A number of computer magazines and professional journals publish reviews of software, some school districts and states have provided software evaluation data, and professional groups have been established for the purpose of evaluating software. It should be remembered that "bad" software may be effective software, and "good" software may be ineffective because experts have rated them rather than actually testing them with learners to determine effectiveness.
Evaluation Criteria
In the final analysis, software is only acceptable if it meets local educational needs of students. The following aspects must be considered.
Content Accuracy. The content should be current, free of factual errors, improper use of statistics or inaccurate graphical displays. If content does not fit with a particular theoretical approach of the reviewer, it should be noted as such but not necessarily criticized. The content should have educational value; it should meet the needs of a common school curriculum or that of a specific school or classroom in question. It should be free of racial, ethnic, or sexual stereotypes.
Documentation. Although many programs have increasingly included help and other informational features on the software itself, it is desirable that documentation be provided in some source, usually most useful in a booklet or manual. The manual should provide clear, important information. The goals, objectives, and warranty statements should be prominent. In some cases, lesson plans and associated activities may be provided, enhancing the software to teachers.
Use. The software should be easy to operate, but this should be judged from both the teacher's perspective and that of the student. For example, the directions and other information should be easy for students to understand and use, without the need for too much supervision from the teacher. Most software will operate from a menu, which may or may not use icons. Menu based systems should not have too many sub-levels, where students get lost. For children in general, and younger children in particular, responses required should be logical and limited to a few function keys. If a particular set of keys are used for responses in one part and then changed later, confusion and frustration can result. It is also desirable to be able to bypass directions and informational screens.
Instructional Characteristics. The following should be considered:
Technology has been and will continue to play a large part in instructional management. Computer software has already been developed for many areas of instructional management including computer managed instruction; grade reporting; test generation and reporting; Individual Education Programs (IEPs); student reports for students, parents, teachers, and administrators; computer-based testing; and integrated learning systems (ILS).
Computer-Managed Instruction (CMI). This category refers to any type of program that records instructional events for educators: school, class, and student records; generating test items; scoring tests; performing statistical analyses on test scores; making diagnostic/prescriptive recommendations; and monitoring student progress. In actuality, CMI programs incorporate features of word processing, spreadsheets, and databases, and may be combined with specific kinds of linkages to create reports. A particular CMI program may have one or a combination of these features: the computer may provide tests, print reports, keep frequent records on student responses/progress, generate recommended materials or activities, and print reports on the proper forms.
Recordkeeping. One aspect of CMI that technology is especially suited for is recordkeeping. Electronic gradebooks have been available for many years. Advantages of using electronic gradebooks also were discussed by Vockell and Schwartz. One of the main advantages is that once scores are entered, it is relatively simple to perform additional functions (weighing, averages, etc.) on those scores. Other advantages including saving time, computer generated report cards, and recalculation of grades when changes are made. One of the main disadvantages or shortcomings of electronic gradebooks is inflexibility. Many of the electronic gradebooks are designed to record and average scores, and prepare reports.
Prescriptive Learning. Computer creation of the Individual Education Program (IEP) is representative of this type of program. Most schools will not rely upon this system strictly, because if test analyses are involved, a psychologist and special teachers must be involved in making decisions about test profiles.
Computer-based Testing. Many schools, especially in large districts, use computerized testing for tracking student progress and achievement. Teachers may develop and enter their own test items into a test generation program, but the validity (the extent to which measurements correspond with criteria) and reliability (same results over repeated administrations) must be established first. At the very least, the teacher should develop sampling domains for test items, regulate the number of items from a particular domain according to the extent they relate to outcomes and the opportunity to learn, and coordinate them with objectives.
In some districts, tests are kept on computer or students take tests which are "scanned" (optical scanning) and scored by the computer, with reports sent to the teacher. Reports can provide complete information about the statistical properties of the test, such as the mean, mode, median, standard deviation, standard scores, percentile ranks, standard error of measurement, and other properties. As computers become more available in classrooms, teachers will use them for assistance with paperwork and testing. The cost of test generation programs runs from very inexpensive shareware to expensive programs that generate a multitude of statistics including item response theory.
Integrated Learning System (ILS). An ILS is a special type of program developed by less than a dozen companies in the United States. ILS programs are developed primarily for the elementary level. Designed to work on a network, usually on equipment installed by the company, they combine computer-managed instruction with lessons in the basic skills (reading, math, writing, and science). Systems vary, from presenting lessons and generating reports for the teacher to examining and revising instruction as students interact with the programs.
The major producers of ILS are Jostens Learning Corporation. These programs are not common in public schools because of the expense, but a sufficient number of districts purchase such programs, usually with federal funds, making it a profitable segment of the industry.
The problem confronting schools using ILS is to establish congruence between lessons in the computer curriculum and the approved school curriculum, and to involve teachers in the process. Ultimately, comprehensive programs of this type will be very useful in all subject matter of the curriculum, especially in the higher grades. However, the prices will have to become more competitive, especially in education where resources will be limited.
Performance-Based Assessment. In performance-based assessment the examinee performs some task that requires an in-depth understanding of a skill rather than just reciting knowledge or recalling facts. Performance-based assessment is not new; it has been used in business and management for many years, and has recently received a lot of attention in educational areas. One area of interest is the use of technology in performance-based assessment.
Computer simulations have been used in assessment, but most allow the teacher to see only a finished product, not how the examinee arrived at that product. Information on the student's decision-making process would provide valuable information for teachers. Video-taping is another use of technology in assessment which has been widely used.
One of the most widely used types of performance-based assessment is portfolios. Many of the schools using portfolios do not manage them with technology, which could ease the physical burden of dealing with and storing large amounts of information. Some schools do use technology in the management of portfolio.
Bibliography
- Aitken, G. (1997). Music technology for the 21st century. In L. Enghagen (Ed.) Technology and higher education (pp.57-74). Washington, DC: National Education Association.
- Allen, W. H. (1974). Media stimulus and types of learning. In H. Hitchens (Ed.), Audiovisual instruction (pp. 7-12). Washington, DC: Association for Educational Communications and Technology.
- Anderson, J. R. (1983a). The architecture of cognition. Cambridge, Massachusetts: Harvard University Press.
- Anderson, J. R. (1983b). Retrieval of information from long-term memory. Science, 220, 25-30.
- Anderson, J. R. (1993). Rules of the mind. Hillsdale, NJ: Lawrence Erlbaum Associates.
- Anderson, J. R., & Reder, L. M. (1979). An elaborative processing explanation of depth of processing. In L. S.
- Arens, Y. (1992). Multimedia presentation planning as an extension of text planning. In R. Dale, E. Hovy, D.
- Arens, Y., Miller, L., Shapiro, S. C., & Sondheimer, N. K. (1988). Automatic construction of user-interfacedisplays. In Proceedings of the 7th AAAI (American Association for Artificial Intelligence) conference (pp. 808-813). San Mateo, CA: Morgan Kaufman.
- Baddeley, A. D. (1983). Working memory. Philosophical Transactions of the Royal Society of London B, 302, 311-324.
- Baddeley, A. D. (1988). The uses of working memory. In P. R. Solomon, G. R. Goethals, C. M. Kelley, & B. R. Stephens (Eds.), Memory: Interdisciplinary approaches. New York: Springer-Verlag.
- Baggett, P. (1979). Structurally equivalent stories in movie and text and the effect of the medium on recall. Journal of Verbal Learning and Verbal Behavior, 18, 333-356.
- Bahrick, H. P., & Gharrity, K. (1976). Interaction among pictorial components in the recall of picture captions. Journal of Experimental Psychology: Human Learning and Memory, 2, 103-111.
- Baker, E. L., Gearhart, M., & Herman, J. L. (1994). Evaluating the apple classrooms of tomorrow.
- Bangert-Drowns, R.L., Kulik, J.A. and Kulik, C-L.C. (1985). Effectiveness of Computer-Based Education in Secondary Schools. Journal of Computer-Based Instruction. 12(3). 59-68.
- Barrow, L. C., & Westley, B. H. (1959). Comparative teaching effectiveness of radio and television. Audio Visual Communication Review, 7, 14-23.
- Barry, M., & Runyan, G. (1995). A review of distance-learning studies in the U. S. military. The American Journal of Distance Education, 9 (3), 37-47.
- Bartram, D. J. (1980). Comprehending spatial information: The relative efficiency of different methods of presenting information about bus routes. Journal of Applied Psychology, 65, 103-110.
- Beagles-Roos, J., & Gat, I. (1983). Specific impact of radio and television on children's story comprehension. Journal of Educational Psychology, 75, 128-137.
- Bell, D., & Johnson, P. (1992). Support for the authors of multimedia tutorials. In L. Kjelldahl (Ed.), Multimedia: Systems, interaction and applications (pp. 307-323). New York: Springer-Verlag.
- Bieger, G. R., & Glock, M. D. (1986). Comprehending spatial and contextual information in picture-text instructions. Journal of Experimental Education, 54, 181-188.
- Blake, T. (1977). Motion in instructional media: Some subject-display mode interactions. Perceptual and Motor Skills, 44, 975-985.
- Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956). Taxonomy of educational objectives: The classification of educational goals. New York: David McKay.
- Bosco, J. (1986). An analysis of evaluations of interactive video. Educational Technology, 25, 7-16.
- Bransford, J. D., & Johnson, M. K. (1972). Contextual prerequisites for understanding: Some investigations of comprehension and recall. Journal of Verbal Learning and Verbal Behavior, 11, 717-726.
- Bronner, E. (1998, September 30). Computers Help Math Learning, Study Finds. The New York Times on the Web.
- Bryant, J., Brown, D., Silberberg, A., & Elliot, S. M. (1980). Humorous illustrations in textbooks: Effects on
- Campeau, P.L. (1966). Selective Review of Literature on Audiovisual Media of Instruction. In Briggs, L.J., Campeau, P.L., Gagn , R.M. and May, M.A. (Eds.), Instructional Media: A Procedure for the Design of Multi-Media Instruction and Suggestions for Future Research. Monograph 2. Pittsburgh, PA: American Institutes for Research.
- Cermak & F. I. M. Craik (Eds.), Levels of processing in human memory (pp. 385-403). Hillsdale, NJ: Erlbaum.
- Chu, G.C. and Schramm, W. (1968). Learning from Television: What the Research Says. Stanford, CA: Stanford University. Institute for Communication Research
- Clark, J. M., & Paivio, A. (1991). Dual coding theory and education. Educational Psychology Review, 3, 149-210.
- Clark, R. (1994). Media will never influence learning. Educational Technology Research and Development, 42(2), 21-29.
- Clark, R. E. (1983). Reconsidering research on learning from media. Review of Educational Research, 53, 445-459.
- Clark, R. E. (1985). Evidence for confounding in computer-based instruction studies: Analyzing the meta-analyses. Educational Communication and Technology Journal, 33, 249-263.
- Clark, R. E., & Craig, T. G. (1992). Research and theory on multi-media learning effects. In M. Giardina (Ed.),
- Clark, R., & Sugrue, B. (1995). Research in instructional media, 1978-1988. In G. Anglin (Ed.), Instructional technology (pp 348-364). Englewood, CO: Libraries Unlimited.
- Clark, R.E. (1983). Reconsidering Research on Learning from Media. Review of Educational Research. 53. 445-459.
- Coburn, P., Kelmer, P., Roberts, N., Snyder, T., Watt, D., & Weiner, C. (1985). Practical guide to computers in education (2nd ed.). Reading, MA: Addison-Wesley.
- Cohen, P.A., Ebeling, B. and Kulik, J.A. (1981). A Meta-Analysis of the Outcome Studies of Visual-Based Instruction. Educational Communication and Technology Journal. 29(1). 26-36
- Cohen, P.A., Kulik, J.A. and Kulik, C.C. (1982). Educational Outcomes of Tutoring: A Meta-Analysis of Findings. American Educational Research Journal. 19. 237-248.
- Conrad, R. (1964). Acoustic confusion in immediate memory. British Journal of Psychology, 55, 75-84.
- Cooper, H.M. (1982). Scientific Guidelines for Conducting Integrative Research Reviews. Review of Educational Research. 52(2). 291-302.
- Cooper, H.M. (1984). The Integrative Research Review: A Social Science Approach. Beverly Hills, CA: Sage.
- Cooper, H.M. and Hedges, L.V. (Eds.) (1994). The Handbook of Research Synthesis. Russell Sage Foundation, NY, NY.
- Department of Education. ERIC DIGEST - ED364220. ERIC Clearinghouse on Information Resources, Syracuse, N.Y.
- Dobrin, J. (1999). Who's teaching online? ITPE News 2 (12), pp. 6-7.
- Dwyer, F. M. (1967). Adapting visual illustrations for effective learning. Harvard Educational Review, 37, 250-263.
- Dwyer, F. M. (1968). The effectiveness of visual illustrations used to complement programmed instruction. Journal of Psychology, 70, 157-162.
- Ehrmann, S. (1995). Asking the right questions: What does research tell us about technology and higher learning? Change, 27 (2), 20-27.
- Elhadad, M., Seligmann, D. D., Feiner, S., & McKeown, K. R. (1989). A common intention description language for interactive multi-media systems. In A new generation of intelligent interfaces (proceedings of the IJCAI89 workshop on intelligent interfaces) (pp. 46-51). Available from Steven Feiner, Department of Computer Science, Columbia University, New York, NY 10027 or feiner@cs.columbia.edu.
- Ellsworth, J. (1997). Technology and change for the information age. Microsoft in Higher Education, [Newspaper, selected stories on-line]. Retrieved October 7, 1997 from the World Wide Web: http://www.microsoft.com/ education/hed/vision.htm
- Evans, T., & Denney, M. R. (1978). Emotionality of pictures and the retention of related and unrelated phrases. Bulletin of the Psychonomic Society, 11, 149-152.
- Feiner, S. K., & McKeown, K. R. (1990). Coordinating text and graphics in explanation generation. In AAAI-90 proceedings (pp. 442-449). Menlo Park, CA: AAAI (American Association for Artificial Intelligence) Press.
- Feiner, S. K., & McKeown, K. R. (1991a). Automating the generation of coordinated multimedia explanations. Computer, 24(10), 33-41.
- Feiner, S. K., & McKeown, K. R. (1991b). COMET: Generating coordinated multimedia explanations. In S. P.
- Fletcher, D. (1989). The effectiveness and cost of interactive videodisc instruction. Machine-Mediated Learning, 3, 361-385.
- Fletcher, D. (1990). The effectiveness and cost of interactive videodisc instruction in defense training and education (IDA Paper P-2372). Alexandria, VA: Institute for Defense Analyses.
- Fletcher, J. D. (1990). Computer-based instruction: Costs and effectiveness. In A. P. Sage (Ed.), Concise Encyclopedia of Information Processing in Systems and Organizations. Elmsford, NY: Pergamon Press.
- Fletcher, J. D. (1990). Effectiveness and cost of interactive videodisc instruction in defense training and education. Alexandria, VA: Institute for Defense Analyses.
- Fletcher, J. D. (1992). Cost-effectiveness of interactive courseware. UTP-2. The Technical Cooperation Program. Sub Group U. Human Resources and Performance.
- Fletcher, J. D. (1996). Does this Stuff Work ? Some Findings from Applications of technology to Education and training. Proceedings of Conference on Teacher Education and the Use of Technology Based Learning Systems. Warrenton VA: Society for Applied Learning.
- Fletcher, J.D. (1990). Computer-Based Instruction: Costs and Effectiveness. In A.P. Sage (Ed.), Concise Encyclopedia of Information Processing in Systems and Organizations. Elmsford, NY: Pergamon Press.
- Fletcher, J.D. (1990). Effectiveness and Cost of Interactive Videodisc Instruction in Defense Training and Education. (IDA P-2372). Alexandria, VA: Institute for Defense Analyses.
- Fletcher, J.D. (1992). Cost-Effectiveness of Interactive Courseware. UTP-2. The Technical Cooperation Program. Sub Group U. Human Resources and Performance.
- Fletcher, J.D. and Orlansky, J. (1986). Recent Studies on the Cost-Effectiveness of Military Training in TTCP Countries (IDA Paper P-1896) Alexandria, VA: Institute for Defense Analyses, March 1986.
- Fletcher, J.D., Hawley, D.E., and Piele, P.K. (1990) Costs, effects, and utility of microcomputer assisted instruction in the classroom. American Educational Research Journal, 27, 783-806.
- Fowler, B. T. (1980). The effectiveness of computer-controlled videodisc-based training. Unpublished doctoral dissertation, University of Iowa, Iowa City.
- Gagne, R. (1962). Introduction. In R. M. Gagne (Ed.), Psychological principles in system development. (pp.1-10). New York: Holt, Rinehart, & Winston.
- Garrison, W. T. (1978). The context bound effects of picture-text amalgams: Two studies (Doctoral dissertation,Cornell University). Dissertation Abstracts International, 39, 4137A.
- Ghilardi, F. (1997). Getting to real-time knowledge management: From knowledge management to knowledge generation. Online, 21(5), 99-102.
- Gifford, B. (1992). Where is the knowledge? Knowledge management, research and pedagogy in the electronic age. Education Libraries, 16(3), 14-22.
- Gilbert, S., & Green, K. (1997). Moving information technology into the classroom. In L. Enghagen (Ed.) Technology and higher education(pp. 25-56). Washington, DC: National Education Association.
- Glaser, R. (1962). Psychology and instructional technology. In R. Glaser (Ed.), Training research and education (pp.1-30). Pittsburgh: University of Pittsburgh Press.
- Glass, G.V. (1976). Primary, Secondary, and Meta-Analysis of Research. Educational Researcher. 5. 3-8.
- Glass, G.V. (1977). Integrating Findings: The Meta-Analysis of Research. Review of Research in Education. 5. 351-379.
- Glass, G.V. and McGaw, B. (1980). Choice of the Metric for Effect Size in Meta- Analysis. American Educational Research Journal. 17. 325-327.
- Glass, G.V., McGaw, B. and Smith, M.L. (1981). Meta-Analysis in Social Research. Sage Publications. NY, NY.
- Grimes, P. W., Neilsen, J. E. & Niss, J. F. (1988). The performance of nonresident students in the "Economics USA" telecourse. The American Journal of Distance Education 2(2), 36-41.
- Hagler, P., & Knowlton, J. (1988). Invalid implicit assumption in CBI comparison research. Journal of Computer-Based Instruction, 14(3), 84-88.
- Hancock, V. (1997). Creating the information age school. Educational Leadership, 55 (3), 60-61.
- Haynes, K. and C. Dillon. 1992. Distance education: Learning outcomes,interaction, and attitudes. Journal of Education for Library and Information Science 33(1): 35-45.
- Hays, R.T., Jacobs, J.W., Prince, C. and Salas, E. (1992). Flight Simulator Training Effectiveness: A Meta-Analysis. Military Psychology. 4 (2). 63-74
- Hays, R.T., Jacobs, J.W., Prince, C. and Salas, E. (1992). Requirements fir Future Research in Flight Simulation Training: Guidance Based on a Meta-Analytic Review. The International Journal of Aviation Psychology. 2 (2) 143-158. Hedges, L.V. and Olkin, I. (1985). Statistical Methods for Meta-Analysis. Academic Press, Inc. NY, NY.
- Hedges, L.V. (1981). Distribution Theory for Glass's Estimator of Effect Size and Related Estimators. Journal of Educational Statistics. 6. 107-128.
- Hedges, L.V. (1982). Estimation of Effect Size from a Series of Independent Experiments. Psychological Bulletin. 7. 119-137.
- Hedges, L.V. and Olkin, I. (1980). Vote-Counting Methods in Research Synthesis. Psychological Bulletin. 88. 359-369.
- Hobbs, V. M. (1990). Distance learning in North Dakota: A cross-technology study of the schools, administrators, coordinators, instructors, and students. Two-way interactive television, audiographic tele-learning, and instruction by satellite. Denver, CO: Mid-Continent Regional Educational Lab., Inc. (ERIC Document Reproduction Service No. ED 328 225).
- Hofstetter, F. T. (1994). Is multimedia the next literacy? Educators' Tech Exchange, 2(3), 6-13.
- Holliday, W. G., Brunner, L. L., & Donais, E. L. (1977). Differential cognitive and affective responses to flow diagrams in science. Journal of Research in Science Teaching, 14, 129-138.
- In E. L. Baker, and H. F. O'Neil, Jr. (Eds.). Technology assessment in education and training. Hillsdale, NJ: Lawrence Erlbaum.
- information acquisition, appeal, persuasability and motivation. Paper presented at the Speech Communication Association Convention, New York. (ERIC Document Reproduction Service No. ED 196 071)
- Interactive multimedia learning environments: Human factors and technical considerations on design issues (pp. 19-30). New York: Springer-Verlag.
- Jacoby, L. L., Craik, F. I. M., & Begg, I. (1979). Effects of decision difficulty on recognition and recall. Journal of Verbal Learning and Verbal Behavior, 18, 585-600.
- Johnston, B.R. and Fletcher, J.D. (1996) Effectiveness of Computer Based Instruction in Military Training. Alexandria, VA: Institute for Defense Analyses.
- Khalili, A., & Shashaani, L. (1994). The effectiveness of computer applications: A meta-analysis. Journal of Research on Computing in Education, 27, 48-61.
- Kieras, D. E. (1984). A simulation model for procedural inference from a mental model for a simple device(Technical Report No. 15, UARZ/DP/TR-84/ONR-15). Tucson, AZ: University of Arizona, Department of Psychology.
- Kieras, D. E., & Bovair, S. (1983). The role of a mental model in learning how to operate a device (Technical Report No. 13, UARZ/DP/TR-83/ONR-13). Tucson, AZ: University of Arizona, Department of Psychology.
- Kieras, D. E., & Bovair, S. (1984). The role of a mental model in learning to operate a device. Cognitive Science, 8, 255-273.
- Kosslyn, S. M. (1973). Scanning visual images: Some structural implications. Perception & Psychophysics, 14, 90-94.
- Kosslyn, S. M. (1975). Information representation in visual images. Cognitive Psychology, 7, 341-370.
- Kosslyn, S. M. (1976). Can imagery be distinguished from other forms of internal representation? Evidence from studies of information retrieval times. Memory & Cognition, 4, 291-297.
- Kosslyn, S. M., Ball, T. M., & Reiser, B. J. (1978). Visual images preserve metric spatial information: Evidence from studies of image scanning. Journal of Experimental Psychology: Human Perception and Performance, 4, 47-60.
- Kozma, R. B. (1991). Learning with media. Review of Educational Research, 61, 179-211.
- Kulik J.A.& Kulik C. Computer based instruction: What 200 evaluations say? Centre for Research and Teaching, University of Michigan, 1988.
- Kulik, C. and Kulik, J.A. (1987). Computer-Based Instruction: What 200 Evaluations Say. Paper Presented at the Annual Convention of the Association for Educational Communications and Technology.
- Kulik, C. and Kulik, J.A. (Winter/Spring 1986). Effectiveness of Computer-Based Education in Colleges. AEDS Journal. 81-108.
- Kulik, C., Chen-Lin C., & Kulik, J. (1991). Effectiveness of computer-based instruction: An updated analysis. Computers in Human Behavior, 7 (1-2), 75-94.
- Kulik, C., Kulik, J. A., & Bangert-Drowns, R. L. (1990).Effectiveness of mastery learning programs: A meta- analysis. Review of Educational Research, 60(2), pp. 265-299.
- Kulik, C., Kulik, J., & Cohen, P. (1980). Instructional technology and college teaching. Teaching of Psychology, 7 (4), 199-205.
- Kulik, C., Kulik, J.A. and Shwalb, B.J. (1986). Effectiveness of Computer-Based Adult Education: A Meta-Analysis. Journal of Educational Computing Research. 2(2). 235-252.
- Kulik, C., Kulik, J.A., and Shwalb, B. (1986) Effectiveness of computer-based instruction in adult education. Journal of Educational Computing Research, 2, 235-252.
- Kulik, J. (1985). The importance of outcome studies: A reply to Clark. Educational Communications and Technology Journal, 34 (1), 381-386.
- Kulik, J. (1994). Meta-analytic studies of findings on computer-based instruction. In Baker, E. L. & O'Neil, H. F. (Eds.) Technology Assessment in Education and Training. Hillsdale, NJ: LEA Publishers.
- Kulik, J. A. (1994). Meta-analytic studies of findings on computer-based instruction. In E. L. Baker,and H. F. O'Neil, Jr. (Eds.). Technology assessment in education and training. Hillsdale, NJ: Lawrence Erlbaum.
- Kulik, J., Bangert, R., & Williams, G. (1983). Effects of computer-based teaching on secondary school students. Journal of Educational Psychology, 75, 19-26.
- Kulik, J.A. (1994) Meta-Analytic Studies of Findings on Computer-Based Instruction. In E.L. Baker and H.F. O'Neil, Jr. (Eds.) Technology Assessment in Education and Training. Hillsdale, NJ: Lawrence Erlbaum Associates.
- Kulik, J.A. (1994). Meta-Analytic Studies of Findings on Computer-Based Instruction. In Baker, E.L. and O'Neil, H.F. (Eds.) Technology Assessment in Education and Training. Hillsdale, NJ: LEA Publishers.
- Kulik, J.A. , Bangert, R.L., & Williams, G.W. (1983). Effects of computer based teaching on secondary school students. Journal of Educational Psychology, 75, 19-26.
- Kulik, J.A., & Kulik, C. (1986) Effectiveness of computer-based education in colleges. AEDS Journal, 19, 81-108.
- Kulik, J.A., Kulik, C. and Bangert-Drowns, R.L. (1985). Effectiveness of Computer-Based Education in Elementary schools. Computers in Human Behavior. 1. 59-74.
- Kulik, J.A., Kulik, C. and Cohen, P.A. (1979). Research on Audio-Tutorial Instruction: A Meta-Analysis of Comparative Studies. Research in Higher Education. 11(4). 321-341.
- Kulik, J.A., Kulik, C., & Bangert-Drowns, R.L. (1985) Effectiveness of computer-based education in elementary schools. Computers in Human Behavior, 1, 59-74.
- Levie, W. H., & Lentz, R. (1982). Effects of text illustrations: A review of research. Educational Communication and Technology Journal, 30, 195-232.
- Levin, J. R., & Lesgold, A. M. (1978). On pictures in prose. Educational Communication and Technology Journal, 26, 233-243.
- Levin, J. R., Bender, B. G., & Lesgold, A. M. (1976). Pictures, repetition, and young children's oral prose learning. AV Communication Review, 24, 367-380.
- Mann, D., Shakeshaft, C., Becker, J., & Kottkamp, R. (1999). West Virginia's Basic Skills/Computer Education Program: An Analysis of Student Achievement. Santa Monica, CA: Milken Family Foundation.
- Martin, E. D., & Rainey, L. (1993). Student achievement and attitude in a satellite-delivered high school science course. The American Journal of Distance Education, 7 (1).
- Mayer, R. E. (1993). Illustrations that instruct. In R. Glaser (Ed.), Advances in instructional psychology. Hillsdale, NJ: Lawrence Erlbaum Associates.
- Mayer, R. E., & Anderson, R. B. (1991). Animations need narrations: An experimental test of a dual-coding hypothesis. Journal of Educational Psychology, 83, 484-490.
- Mayer, R. E., & Anderson, R. B. (1992). The instructive animation: Helping students build connections between words and pictures in multimedia learning. Journal of Educational Psychology, 84, 444-452.
- McCleary, I. D., & Egan, M. W. (1995). Program design and evaluation: Two-way interactive television. Readings in Distance Education (4).
- McNeil, D. R. 1991. Computer conferencing project. Final report. Washington, D.C.: Academy for Educational Development, Inc.
- Means, Barbara et al. (1993). Using technology to support education reform. Washington, DC: Office of Educational Research and Improvement, U.S.
- Navarro, P. & Shoemaker, J. (1999). The power of cyberlearning: An empirical test. Journal of Computing in Higher Education.
- Neal, E. (1998). Does Using Technology in Instruction Enhance Learning? or, The Artless State of Comparative Research Technology Source, http://horizon.unc.edu/ts/commentary/1998-06.asp
- Niemiec, R., Blackwell, M., and Walberg, H.J. (1986). CAI can be doubly effective, Phi Delta Kappan, June, pp. 750-751.
- Nugent, G. (1982). Pictures, audio, and print: Symbolic representation and effect on learning. Educational Communication and Technology Journal, 30, 163-174.
- Orlansky, J. & String, J. (1977). Cost effectiveness of computer-based instruction in military training (IDA Paper P-1375). Arlington, VA: Institute for Defense Analyses.
- Orlansky, J. & String, J. (1979). Cost-effectiveness of computer-based instruction in military training. Alexandria, VA: Institute for Defense Analyses.
- Orlansky, J. (1983). Effectiveness of CBI: A Different Finding. Electronic Learning. 6. 59-60.
- Orlansky, J. (1985). The Cost-Effectiveness of Military Training. Proceedings of the Symposium on the Military Value and Cost-Effectiveness of Training. Brussels, Belgium: NATO.
- Orlansky, J. and String, J. (1979). Cost-Effectiveness of Computer-Based Instruction in Military Training. (IDA P-1375). Alexandria, VA: Institute for Defense Analyses. Phelps, R.H., Wells, R.A., Ashworth, R.L. and Hahn, H.A. (1991). Effectiveness and Costs of Distance Education Using Computer-Mediated Communication. The American Journal of Distance Education. 5 (3). 7-19.
- Orlansky, J., & String, J. (1979). Cost-Effectiveness of Computer Based Instruction in Military Training. (IDA Paper P-1375). Institute for Defense Analyses, Alexandria, Virginia.
- Orlansky, J., Dahlman, C.J., Hammon, C.P., Metzo, J., Taylor, H.L. and Youngblut, C. (1994). The Value of Simulation for Training. (IDA P-2982). Alexandria, VA: Institute for Defense Analyses.
- Owston, R. (1997). The World Wide Web: A technology to enhance teaching and learning? Educational Researcher, 26 (2), 27-33.
- Panel on Educational Technology for the President's Committee of Advisors on Science and Technology (1997). Report to the President on the use of Technology. Retrieved January 14, 1998 from the World Wide Web: http://www.whitehouse.gov/WH/EOP/OSTP/NSTC/PCAST/k-12ed.html
- Pett, D., & Grabinger, S. (1995). Instructional media production. In G. J. Anglin (Ed.), Instructional technology: Past, present, and future (pp. 305-313). Englewood, CO: Libraries Unlimited., Inc..
- Plowman, T. (1997). The information superhighway: Democracy or capitalism?Techtrends, 42 (5), 23-27.
- Quiñones, S. & Kirshstein, R. (1998). An Educator's Guide to Evaluating The Use of Technology in Schools and Classrooms. Washington, D.C.: U.S. Department of Education, Office of Educational Research and Improvement.
- Riel, M. (1994). Educational change in a technology-rich environment. Journal of Research on Computing in Education, 26, 452-474.
- Robertson, G. M. Olson, & J. S. Olson (Eds.), CHI'91 conference proceedings (pp. 449-450). Reading, MA: Addison-Wesley.
- Rosner, & O. Stock (Eds.), Aspects of automated natural language generation: Proceedings of sixth international workshop on natural language generation (pp. 278-280). New York: Springer-Verlag.
- Russell, T. (1999). The "no significant difference" phenomenon. Retrieved August 25, 1999 from the World Wide Web: http://cuda.teleeducation.nb.ca/nosignificantdifference/
- Scardamalia, M., & Bereiter, C. (1996). Computer support for knowledge-building communities.In T. Koschmann, (Ed.). CSCL: Theory and practice of an emerging paradigm. Mahwah, NJ: Erlbaum.
- Sivin-Kachala, J. (1998). Report on the effectiveness of technology in schools, 1990-1997.Software Publisher's Association.
- Skinner, B. F. 1953). Science and human behavior. New York: Macmillan.
- Slee, E. (1989, February). A review of the research on interactive video. Paper presented at the meeting of the Association for Educational Communications and Technology, Dallas, TX.
- Smeaton, A. & Keogh, G. (1999). An analysis of the use of virtual delivery of undergraduate lectures. Computers and Education 32, pp. 83-94.
- Spencer, K. (1991). Modes, Media and Methods: The Search for Educational Effectiveness. British Journal of Educational Technology. 22, (1). 12-22.
- Trinkle, D. A. (1999, August). Distance education: A means to an end, no more, no less. The Chronicle of Higher Education, A60.
- Wenglinsky, H. (1998). Does it compute? The relationship between educational technology and student achievement in mathematics. Educational Testing Service Policy Information Center.
- Wilson, E., & Marsh, G. (1995). Social studies and the Internet revolution. Social Education, 59, 198-202.
Wright, V. H. (1999). A comparison of the achievement and perceived satisfaction of graduate students in synchronous and asynchronous courses. Unpublished doctoral dissertation, University of Alabama, Tuscaloosa, AL.Anderson, J. R. (1976). Language, memory, and thought. Hillsdale, NJ: Lawrence Erlbaum Associates.
Back to home page
Back to table of contents