What’s All the Talk About? Examining EVALTALK,an Evaluation Listserv

Abstract

Listservs have become a popular computer-mediated method for communicating with others who share a common interest. They offer subscribers quick feedback and provide a forum for ideas and beliefs to be exchanged, discussed, and modified. Although rarely studied, in some practical fields listserves have been shown to increase communication of best practices. EVALTALK is an online evaluation discussion forum, and the official listserv of the American Evaluation Association. The current study examined EVALTALK exchanges generated over a one-year period in order to better understand how the listserv is used by its members. Results from our analysis suggest that a significant proportion of the EVALTALK listserv postings are not directly related to evaluation; however, when lengthy discussions ensue, they are most likely to be evaluation related. Additionally, much of the EVALTALK activity centers on requests for evaluation examples, procedures, and experiences. We also found that the typical subscriber is more likely to be a “lurker” than an active participant.

Get full access to this article

View all access options for this article.

References

Alexander, L. , & Newsom, R. (1998). Internet Listservs: A follow-up to faculty development at two-year colleges. Community College Review, 25(4), 61-74.

Caverly, D. C. , & Broderick, B. (1994). Techtalk: Advanced Internet for developmental education. Journal of Developmental Education, 17(3), 52-53.

Christie, C. A. , & Rose, M. (2003). Learning about evaluation through dialogue: Lessons from an informal discussion group. American Journal of Evaluation, 24, 235-243.

Descy, D. E. (1993). The Internet/school connection. Tech Trends, 38, 15.

Galegher, J. , Sproull, L. , & Kiesler, S. (1998). Legitimacy, authority, and community in electronic support groups. Written Communication, 15, 493-530.

Haney, W. , Russell, M. , Gulek, C. , & Fierros, E. (1998). Drawing on education: Using student drawings to promote middle school improvement. Schools in the middle, 7(3), 38-43.

Hinds, P. , & Kiesler, S. (Eds.). (2002). Distributed work. Cambridge, MA: MIT Press.

Joint Committee on Standards for Educational Evaluation . (1994). The Program Evaluation Standards (2nd ed.). Thousand Oaks, CA: Sage.

King, J. (2003). The challenge of studying evaluation theory. In C. A. Christie (Ed.), The practice-theory relationship (New Directions for Program Evaluation, No. 97). San Francisco, CA: Jossey-Bass.

10.

Lippert, R. M. , Plank, O. , & Radhakrishna, R. (2000). Beyond perception: A pretest and posttest evaluation of a regional internet extension in service training. Journal of Extension, 2(38). Available: http://joe.org/joe/2000april/a2.html.

11.

List Archives at BAMA.UA.EDU. Retrieved April 21, 2003, from http://bama.ua.edu/archives/index.html.

12.

Madison, S. , Deng, M. , & Gifford, J. (1999, February). Creating gender equitable computer classrooms: A model project. Paper presented at the Society for Information Technology & Teacher Education International Conference, San Antonio, TX.

13.

Marcinko, R. (1998). Listservs: The good news and the bad news. Searcher, 6(10), 34-39.

14.

Mark, M. M. (2000). On the role of dialogue in evaluation. American Journal of Evaluation, 21, 205-206.

15.

Martin, K. , & Bearden, D. (1998). Listserv learning. Learning and Leading with Technology, 26(3), 39-41.

16.

Medley, M. D. (1999). The potential of Listservs for continuing professional education. Journal of Continuing Higher Education, 47(2), 25-31.

17.

Monty, V. , & Warren-Wenk, P. (1994). Using the internet as a professional development tool: An analysis. Education Libraries, 18(1), 7-10.

18.

Osborne, J. (1998). Internet basics for early childhood educators. Dimensions of Early Childhood, 26(1), 5-8.

19.

Stemler, S. (2001). An overview of content analysis. Practical Assessment, Research & Evaluation, 7(17). Available: http://ericae.net/pare/getvn.asp?v=7&n=17.