Online Learning Environments Research
Scott L. Walker

Abstract
While a surplus of literature on distance education is available, original research on distance education is limited. Distance education evaluation is concentrated primarily in 1) student outcomes (achievement, grades, test scores); 2) attitudes of students and instructors; and 3) satisfaction of students and instructors. What is conspicuously missing is research on learning environments in distance education.

Introduction - Learning Environments Research

Learning environments research, just over three decades old, is firmly established (Tobin & Fraser, 1998) among a variety of education research and evaluation methods dominated by academic achievement assessment of students (Fraser, 1998b). While quantitative measures of classroom effectiveness are often based on "narrow testable, standardized, superficial, and easily forgotten outcomes," other areas of schooling are less emphasized (Kyle, 1997, p. 851) and a complete image of the process of education is not formed within the research. In the early 1960s, Bloom pointed to measurements of educational environments as a decisive component for prediction and successful learning manipulation (Anderson & Walberg, 1974). Since then, numerous studies have demonstrated that students' perceptions of their educational environments can be measured with survey instruments and the results serve as valid predictors of learning (Anderson & Walberg, 1974; Fraser, 1997, 1998a, 1998b), turning evaluation away from individual student achievement and toward the effectiveness of the environment of the learning organization (Walberg, 1974). Moreover, variables within learning environments themselves can be manipulated to achieve different learning outcomes (Anderson & Walberg, 1974).

In addition to approaching learning environment research to enhance teaching and learning in the individual classroom, there are increasingly strong indicators of the need to accommodate tertiary education students in a globalised economy in order to create, distribute, and exploit knowledge for international competitive advantages (Commonwealth, 2000; Hinde, 2000; OECD, 2000; Salmi, 2000; Wagner, 1998). Given that many universities are marketing globally (Hinde, 2000; Salmi, 2000), assurances of quality in education move to the forefront and must be addressed (Olsen, 2000). Learning environment research can provide some of these assurances in the form of addressing what factors shape effective learning environments.

Learning Environments Research Background

Learning environments research can be traced to Lewin's classic human behaviour definition (Fraser, 1998b) represented by B=f(P,E), whereby B represents behaviour, f is function, P is person, and E is person's environment (Lewin, 1936). Lewin noted, "every scientific psychology must take into account whole situations, i.e., the state of both person and environment" (1936, p. 12). Thus, determinants of B are describable by composite measures of P and E (Stern, 1974). Lewin's purpose for this definition was to conceptualise human behaviour with new strategies in psychological research where functional relationships and states of interaction are emphasized over those of correlation of disjointed responses derived from isolated stimuli—the prevailing psychological trend of the time (Stern, 1974).

Through the study of educational environments, students and teachers define their environment based upon their perceptions. Students, with their distinctive frame of reference generated from spending numerous hours as learners, have a large interest in what is going on around them in their educational environments "and their reactions to and perceptions of school experiences are significant" (Fraser, 1998b, p. 527) given that environments, like people, take on distinctive personalities (Insel & Moos, 1974; Kiritz & Moos, 1974). Likewise, there is an association between students' "psychosocial characteristics of their classrooms" (Fraser, 1998a, p. 17) and their learning achievements and viewpoints. Teachers, on the other hand, can utilize learning environments research to discover differences between their perceptions and those of their students and then attempt to make improvements in the actual classroom environment based upon the preferences of students.

Distance Education Research

Currently, research on distance education is narrow. According to Merisotis and Olsen (2000), while a plethora of literature on the distance education phenomenon is available, original research on distance education is limited. Distance education evaluation is concentrated primarily 1) student outcomes (achievement, grades, test scores); 2) attitudes of students and instructors; and 3) satisfaction of students and instructors (Diaz & Cartnal, 1999; IHEP, 1999; Harnar, Brown & Mayall, 2000; Olsen, 2000; Lane, n.d.). Postulated in the context of distance education system evaluation, Harnish and Reeves (2000) discovered the emergence of distance education evaluation in terms of:

1)       Training (programming skills, barriers, availability, identification of needs, costs);

2)       Implementation (administration, costs, fees course credits, institutional ownership, priority for use, integration, coordination);

3)       System Usage (information collection, electronic data collection, accuracy);

4)       Communication (information sharing around internal, local, and regional issues of concern regarding distance education); and

5)       Support (fiscal, staff, faculty, instructional, administrative resource allocation).

What is conspicuously missing from evaluations and research related to the broader body of distance education evaluation are issues related to learning environments.

Learning Environments Research and Distance Education

Learning environment research and associated survey instruments have been developed related to computer use in classrooms or laboratories, telecomputing, and computer-mediated communication. Related research includes studies of perspectives of computer-mediated learning environments specific to teacher education (Admiraal, Lockhorst, Wubbels, Korthagen & Veen 1998; Goh & Tobin, 1999), computer-facilitated learning environments in higher education (Bain, McNaught, Mills & Lueckenhausen, 1998), and collaborative distance learning environment design (Spector, Wasson & Davidson, 1999). However, only one study and related instrument, the Distance and Open Learning Environment Scale (DOLES), developed in 1995, appears to focus exclusively on distance education among college students (Fraser, 1998a; Jegede, Fraser & Fisher, 1998).

Study Objective

The learning environments study presented below was designed to assess the learning environments of two online education technology graduate classes. The study used the DOLES, a validated survey instrument, to assess 1) student/student interaction, 2) student/instructor interactions, 3) student expectations, and 4) course content/structure.

Study Method

Preferred Form
Graduate students in two online classes were asked to complete a web-based form of the DOLES at the beginning of the semester. The scale was composed of items related to the students’ preferred online class characteristics with the scaled responses of ‘Strongly Agree,’ ‘Agree,’ ‘Neither Agree or Disagree,’ ‘Disagree,’ and ‘Strongly Disagree.’

Examples of the preferred form given initially included:

Student/student interaction - “I should be able to develop friendships with other students in this class.”

Student/instructor interaction – “If I have a study related inquiry, the professor should be able to find time to respond.”

Upon completion of the web-based form, students submitted it electronically to a research assistant who compiled the data. The course instructor did not view the students’ submissions or the data that were compiled.

Actual Form
Near the end of the semester, students were again asked to complete a web-based form of the DOLES. This form of the instrument the same items, yet they were posed from the point of view of how the class was actually being taught. For example:

Student/student interaction - “I was able to develop friendships with other students in this class.”

Student/instructor interaction – “When I had a study related inquiry, the professor found time to respond.”

Upon completion of these surveys, the results were electronically submitted to a research assistant who compiled the data.

Instructor Form
During the same period students were responding to their second (actual form) survey, the instructor completed a survey and submitted it to the research assistant. Examples of the survey items for the instructor included:

Student/student interaction - “Students are able to develop friendships with other students in this class.”

Student/instructor interaction – “If students have a study related inquiry, I am able to find time to respond.”

Results Summary

The results of the three instruments were compiled by the graduate research assistant and then submitted to the instructor after final grades had been posted in the two online classes. Ideally, what should occur is that students’ preferred form of a class is met and the actual form survey results should represent that students’ preferences were met or exceeded, or at least improved upon. Likewise, the instructor’s form should reflect awareness of what students prefer and actually meet their preferences or nearly meet their preferences. What readers will note however, is that the instructor often did not meet student preferences. The results are presented in line charts comparing means of each item in the preferred, actual, and instructor forms of the scale.

Student/Student Interaction [Link to line graph]

Students in these two classes preferred to be able to make friends with one another, but what actually happened is that they did not. However, it appears they did get to know one another as preferred, although apparently they did not consider themselves friends. Students’ ability to organize themselves into work groups appears to be in sync early in the classes, as well as later, in keeping with the instructor’s perception of the classes. Students preferred to be able to contact one another by fax, yet did not. The instructor did not expect students to contact one another by this method, considering these were online classes. Students appear to not have been concerned with developing likes and dislikes of one another, yet actually they later disagreed that they were able to develop these distinctions.

Student/Professor Interaction [Link to line graph]

For the most part, students’ preferences for interaction with the professor and the professor’s perception of his interaction with students was nearly the same throughout. However, while the professor thought he was meeting students’ preferences, he did so only in part—the distinction between students “strongly agreeing” as preferred, yet simply “agreeing” in actuality. 

Course Content/Structure [Link to line graph

In this case, the primary class environment characteristic of note is the difference between the instructor considering the students working at their own pace and the actuality of the students ‘strongly disagreeing’ that they were able to work at their own pace. As for students being expected to cover the same material as one another (not necessarily a positive point) and students being able to follow areas of their own interest, the instructor again slightly assumed he was meeting the preferences of the students when in reality he was not.

Student Expectations [Link to line graph]

This is likely the most telling graph in the disparity of what a professor believes he is doing and what students perceive him as doing. Students appear to have understood more about what was expected of them than the instructor thought they understood—not necessarily a negative disparity. However, where the professor thought he was carefully planning student activities, the students perceived otherwise. Likewise, where the instructor fully agreed he was providing materials meeting student’s needs, the students maintained a more neutral point of view.

Conclusion

The data and graphs above indicate several areas in the socio-psycho realm of a classroom were this professor was meeting students’ preferences toward their online classroom environment. It also indicates a variety of disparities where the professor can make improvements upon his work, not in catering to student wishes, but being aware of what is really going on in an online class and focusing in bridging gaps.

If higher education in an online environment is to accommodate tertiary education in a worldwide market, addressing factors shaping effective learning environments is of importance. This cursory study of two classes provides only a snapshot of one instructor’s ability to meet these needs, however, a larger study of an online degree or series of online classes can uncover aspects of learning not found in assessment of student outcomes, student and instructor attitudes or low-level evaluations of student satisfaction.

Moreover, improvements can be made in the study of online learning environments with improvement and validation of better-defined instruments. The DOLES, used in this study, was developed in the mid-1990s. Numerous changes in technology and the way higher education faculty use technology for the delivery of distance education has occurred. Improved distance education instruments that can be widely distributed and given in the online environment will improve our evaluation of teaching and learning in the future.

 

Scott Walker holds a masters degree from Southwest Texas State University. He is a visiting instructor in the Education Department at Our Lady of the Lake University in San Antonio, Texas. Scott is currently undertaking a doctoral study at Curtin University of Technology in Perth, Australia in which he will develop and validate an improved distance education learning environments instrument focused on constructivism in distance education. Scott also works as an international distance education and science education consultant and serves on the Technology Leadership Academy steering committee in Austin, Texas. Scott may be reached at walks@lake.ollusa.edu and via his web portfolio at http://www.itouch.net/~swalker.

References

 Admiraal, W. F., Lockhorst, D., Wubbels, T., Korthagen, F., & Veen, W. (1998). Computer-mediated communication environments in teacher education: Computer conferencing and the supervision of student teachers. Learning Environment Research, 1 (1), 59-74.

Anderson, G. J., & Walberg, H. J. (1974). Learning environments. In H. J. Walberg (Ed.), Evaluating educational performance: A sourcebook of methods, instruments and examples (pp. 81-98). Berkeley: McCutchan Publishing.

Bain, J. D. McNaught, C., Mills, C., & Lueckenhausen, G. (1998). Describing computer-facilitated Learning environments in higher education. Learning Environments Research, 1 (2), 163-180.

Commonwealth Department of Education, Training, & Youth Affairs. (2000). The way forward: Higher education action plan for the information economy. In Learning for the knowledge society: An education and training action plan for the information economy (DETYA Publication No 6465SCHP00A). Canberra: AusInfo. Available: http://www.deet.gov.au/schools/publications/reports/learning/learning.htm

Diaz, D. P., & Cartnal, R. B. (1999). Students' learning styles in two classes: Online distance learning and equivalent on-campus. College Teaching, 47 (4), 130-135.

Fraser, B. J. (1997). Classroom environments. In H. J. Walberg and G. D. Haertel (Eds.), Psychology and educational practice (pp. 323-341). Berkeley: McCutchan Publishing.

Fraser, B. J. (1998a). Classroom environment instruments: Development, validity and application. Learning Environments Research, 1, 7-33.

Fraser, B. J. (1998b). Science learning environments: Assessment, effects and determinants. In B. J. Fraser and K.G. Tobin (Eds.), International handbook of science education (pp. 527-564). London: Kluwer Academic Publishers.

Harnar, M. A., Brown, S. W., & Mayall, H. J. (2000). Measuring the effects of distance education on the learning experience: Teaching accounting via PictureTel. International Journal of Instructional Media, 27 (1), 37-49.

Harnish, D., & Reeves, P. (2000). Issues in the evaluation of large-scale two-way interactive distance learning systems. International Journal of Educational Telecommunications, 6 (3), 267-281.

Hinde, J. (2000, November). Made in Australia. University Business, 3 (9), pp. 31-35, 80.

Insel, P. M., & Moos, R. H. (1974). The social environment. In P. M. Insel and R. H. Moos (Eds.), Health and the social environment (pp.3-12). Lexington, MA: D.C. Heath and Company.

Institute for Higher Education Policy (IHEP). (1999). What's the difference? A review of contemporary research on the effectiveness of distance learning in higher education. Washington D.C.: The Institute for Higher Education Policy. Available: http://www.ihep.com/PUB.htm  

Jegede, O., Fraser, B. J., & Fisher, D. L. (1998, April). The distance and open learning environment scale: Its development, validation and use. Paper presented at the 69th Annual Meeting of the National Association for Research in Science Teaching, San Diego, CA.

Kiritz, S., & Moos, R. H. (1974). Physiological effects of the social environment. In P. M. Insel and R. H. Moos (Eds.), Health and the social environment (pp.13-35). Lexington, MA: D.C. Heath and Company.

Kyle, W. C. (1997). Editorial: Assessing students' understanding of science. Journal of Research in Science Teaching, 34 (9), 851-852.

Lane, C. (n.d.). Research in distance education. In Distance Learning Resource Network’s technology resource guide. Available: http://www.dlrn.org/library/dl/guide.html  

Lewin, K. (1936). Principles of Topological Psychology (F. Heider & G. M. Heider, Trans.). New York: McGraw-Hill.

Merisotis, J. P., & Olsen, J. K. (2000). The 'effectiveness' debate: What we know about the quality of distance learning in the U.S. TechKnowLogia, 2 (1), 42-44.

Olsen, J. K. (2000 January/February). Is virtual education for real?: Issues of quality and accreditation. TechKnowLogia, 2(1), 16-18.

Organisation for Economic Co-operation & Development (OECD). (2000, September). Science, technology and innovation in the new economy. OECD Policy Brief. Available: http://www.oecd.org/publications/Pol_brief/2000/2000_04.pdf

Salmi, J. (2000, January/February). Higher education: Facing the challenges of the 21st century. TechKnowLogia, 2(1), 7-10. Available: http://www.techknowlogia.org/TKL_active_pages2/CurrentArticles/main.asp?IssueNumber=3&FileType=HTML&ArticleID=56

Spector, M. J., Wasson, B., & Davidson, P. I. (1999). Designing collaborative distance learning environments for complex domains. In B. Collis and R. Oliver (Eds.), Proceedings of Ed-Media 1999: World Conference on Educational Multimedia, Hypermedia, and Telecommunications, Seattle, Washington, June 19-24, 1999. (pp. 323-329). Charlottesville, VA: Association for the Advancement of Computing in Education.

Stern, G. G. (1974). B=f(P,E). In R. H. Moos and P. M. Insel (Eds.), Issues in social ecology: Human milieus (pp. 559-568). Palo Alto, CA: National Press Books.  

Tobin, K., & Fraser, B. J. (1998). Qualitative and quantitative landscapes of classroom learning environments. In B. J. Fraser and K.G. Tobin (Eds.), International handbook of science education (pp. 623-640). London: Kluwer Academic Publishers.

Wagner, A. (1998, October/November). Redefining tertiary education. The OECD Observer No. 214. Available: http://www.oecd.org/publications/observer/214/article4-eng.htm

Walberg, H. J. (1974). Evaluating education performance. In H.J. Walberg (Ed.), Evaluating educational performance: A sourcebook of methods, instruments, and examples (pp. 1-9). Berkeley: McCutchan Publishing.

 

 

 

last updated: 03/17/01