The primary goal of this study was to present the summative evaluation findings of an initial implementation to investigate the impact, effectiveness and perceived benefits of the Electronic Performance Support System (EPSS) on the performance of Crime Scene Investigation (CSI) officers in Turkey. A sequential explanatory strategy as a procedure of mixed method design was used to collect data through a survey, interviews, and computer logs. While 191 CSI officers participated in the quantitative part of the study, the researchers also conducted interviews with 12 officers. Data was analyzed by using descriptive statistics and content analysis. The results showed that intrinsic support made a major contribution to officers’ performance with positive reactions. It revealed also that generating reports and establishing standardization were one of the main factors providing impacts on society. This study provides a viable application of Kirkpatrick’s Four Levels of Evaluation model for the CSI Unit; however, the model’s extended adaptations should also be carried out in different workplace settings for further studies.
AltalibH (2002) ROI calculations for electronic performance support systems. Performance Improvement41(10): 12–22.
2.
BinderC (1995) Promoting HPT innovation: A return to our natural science roots. Performance Improvement Quarterly8(2): 95–113.
3.
BrethowerD (2007) Performance Analysis: Knowing what to do and how. Amherst: HRD Press.
4.
BroadM (2000) Ensuring transfer of learning to the job. In: PiskurichEMBeckeshiPHallB (eds.) The ASTD Handbook of Training Design and Delivery. New York: McGraw-Hill, pp. 430–452.
5.
BrownLA (1996) Designing and Developing Electronic Performance Support Systems. Newton, MA: Digital Press
6.
BurnerK J (2010) From performance analysis to training needs assessment. In: SilberKHFoshayWR (eds.) Handbook of Improving Performance in the Workplace, Vol. 1: Instructional design and training delivery. San Francisco: International Society for Performance Improvement, pp. 144–183.
7.
ChangCC (2004) The relationship between the performance and the perceived benefits of using an electronic performance support system (EPSS). Innovations in Education and Teaching International41(3): 343–364.
8.
ChevalierR (2006) Leadership in performance consulting. In: PershingJA (ed.) The Handbook of Human Performance Technology (3rd. ed.). San Francisco: Pfeiffer, pp. 964–985.
9.
ChyungSY (2008) Foundations of Instructional Performance Technology. Amherst, MA: HRD Press Inc.
10.
DessingerJCMoseleyJL (2004) Confirmative Evaluation: Practical strategies for valuing continuous improvement. San Francisco: Pfeiffer.
11.
DessingerJCMoseleyJL (2006) The full scoop on fıll-scope evaluation. In: PershingA (ed.) The Handbook of Human Performance Technology (3rd. ed.). San Francisco: Pfeiffer, pp. 312–330.
12.
DickWJohnsonB (2007) Evaluation in instructional design: The impact of Kirkpatrick’s four-level training evaluation model. In: ReiserRADempseyJV (eds.) Trends and Issues in Instructional Design and Technology. Upper Saddle River, NJ: Merrill Education/Prentice-Hall, pp. 94–103.
13.
FraenkelJR.WallenNEHyunHH (2012) How to Design and Evaluate Research in Education (8th. ed.) New York: McGraw-Hill.
14.
GeryGJ (1991) Electronic Performance Support Systems: How and why to remake the workplace through the strategic application of technology. Cambridge, MA: Ziff Communications Company.
15.
GeryG (1995) Attributes and behaviors of performance-centered systems. Performance Improvement Quarterly8(1): 47–93.
16.
GeryG (2002) Achieving performance and learning through performance-centered systems. Advances in Developing Human Resources4(4): 464–478.
17.
HumphressRBergeZL (2006) Justifying human performance improvement interventions. Performance Improvement45(7): 13–22.
18.
KaufmanR (2006) Mega planning and thinking. Defining and achieving measurable success. In: PershingJA (ed.) The Handbook of Human Performance Technology (3rd. ed.) San Francisco: Pfeiffer, pp. 138–154.
19.
KirkpatrickDL (1994) Evaluating Training Programs: The four levels. San Francisco: Berrett-Koehler.
20.
KirkpatrickDL (2000) Evaluating training programs: The four levels. In: PiskurichEMBeckeshiPHallB (eds.) The ASTD Handbook of Training Design and Delivery. New York: McGraw-Hill, pp. 133–146.
21.
KirkpatrickDLKirkpatrickJD (2006) Evaluating Training Programs: The four levels (3rd. ed.) San Francisco, CA: Berrett-Koehler Publishers.
22.
KorthSJLevya-GardnerBS (2006) Rapid reflection throughout the performance-improvement process. In: PershingJA (ed.) The Handbook of Human Performance Technology (3rd. ed.) San Francisco: Pfeiffer, pp. 1122–1146.
23.
LessardLMowatJ (1998) Chapter 15: An EPSS design and development process. In: DeanPRipleyD (eds.) Performance Improvement Interventions: Performance technologies in the workplace. Washington, DC: International Society for Performance Improvement, pp. 321–334.
24.
MainRE (2000) Leveraging technology for human performance improvement. In: PiskurichEMBeckeshiPHallB (eds.) The ASTD Handbook of Training Design And Delivery. New York: McGraw-Hill, pp. 453–472.
25.
MaoJY (2004) Electronic performance support: An end-user training perspective. Journal of Information Technology Theory and Application5(4): 51–67.
26.
MarthandanGMengTC (2010) Thirst for business value of information technology. International Journal of Technology Diffusion1(1): 28–40.
27.
MaughanGR (2005) Electronic performance support systems and technological literacy. Journal of Technology Studies31(1): 49–56.
28.
MarkerAHuglinLJohnsenL (2006) Empirical research on performance improvement: An update. Performance Improvement Quarterly19(4): 7–22.
29.
McGrawK (1994a) Performance support systems: integrated AI, hypermedia, and CBT to enhance user performances. Journal of Artificial Intelligence in Education5(1): 3–16.
McKayJWagerWW (2007) Electronic performance support systems: Visions and viewpoints. In: ReiserRADempseyJV (eds.) Trends and Issues in Instructional Design and Technology. Upper Saddle River, NJ: Merrill Education/Prentice-Hall, pp. 147–155.
32.
MilesDH (2003) The 30-second Encyclopedia of Learning and Performance: A trainer’s guide to theory, terminology, and practice. New York: American Management Association.
33.
MoseleyJLDessingerJC (2007) Training Older Workers and Learners: Maximizing the performance of an aging workforce. San Francisco: Pfeiffer.
34.
NguyenF (2006) What you already know does matter: Expertise and electronic performance support systems. Performance Improvement45(4): 9–12.
35.
NguyenFKleinJDSullivanH (2005) A comparative study of electronic performance support systems. Performance Improvement Quarterly18(4): 71–86.
36.
NguyenFWollCA (2006) A practitioner’s guide for designing performance support systems. Performance Improvement45(9): 37–45.
37.
NguyenFHanzelM (2007) Linking versus searching: A case study of performance support use. Performance Improvement46(10): 40–44.
38.
PearlsteinRB (2010) How to use Kirkpatrick’s taxonomy effectively in the workplace. In: MoseleyJLDessingerJC (eds.) Handbook of Improving Performance in the Workplace, vol. 3: Measurement and evaluation. San Francisco: International Society for Performance Improvement, pp. 142–160.
39.
RosenbergMJ (2006) Beyond E-learning: Approaches and technologies to enhance organizational knowledge, learning, and performance. San Francisco: Pfeiffer.
40.
RossettA (2006) Analysis and more. In: PershingJA (ed.) The Handbook of Human Performance Technology (3rd. ed.) San Francisco: Pfeiffer: pp. 208–222.
41.
RothwellWJ (1996) Beyond Training and Development: State-of-the-art strategies for enhancing human performance. New York: American Management Association.
42.
RothwellW J (2005) Beyond Training and Development. (2nd. ed.) New York: AMACOM.
43.
RuyleKE (2005) Electronic performance support systems. In: SandersES (ed.) Performance Intervention Maps: 39 strategies for solving your organization’s problems. Alexandria, VA: ASTD Press: pp. 25–31.
44.
SchwenTMKalmanHKHaraNKislingEL (1998) Potential knowledge management contributions to human performance technology research and practice. Education Technology Research and Development46(4): 73–89.
45.
SpitzerDR (2007) Performance Measurement: Rethinking the way we measure and drive organizational success. New York: AMACOM.
46.
StoneDEndicottJ (2000) Overview of electronic performance support systems. In: PiskurichEMBeckeshiPHallB (eds.) The ASTD Handbook of Training Design And Delivery. New York: McGraw-Hill, pp. 342–355.
47.
Van TiemDMMoseleyJLDessingerJC (2001) Performance Improvement Interventions: Enhancing people, process, and organizations through performance technology. Silver Spring, MD: International Society for Performance Improvement.
48.
Van TiemDMMoseleyJLDessingerJC (2004) Fundamentals of Performance Technology: A guide to improving people, process, and performance (2nd. ed.) Silver Spring, MD: International Society for Performance Improvement.
49.
Van TiemDMDessingerJCMoseleyJL (2006) Six sigma: Increasing human performance technology value and results. In: PershingJA (ed.) The Handbook of Human Performance Technology (3rd. ed.) San Francisco: Pfeiffer, pp. 692–716.
50.
VillachicaSWStoneDLEndicottJ (2006) Performance support systems. In: PershingJA (ed.) The Handbook of Human Performance Technology (3rd. ed.) San Francisco: Pfeiffer, pp. 539–566.
51.
WangQNieveenNAkkerJ (2007) Designing a computer support system for multimedia curriculum development in Shanghai. Education Technology Research and Development55(3): 275–295.
52.
WilliamsSW (2000) Performance support systems and job aids. In: PiskurichEmBeckeshiPHallB (eds.) The ASTD Handbook of Training Design and Delivery. New York: McGraw-Hill, pp. 415–429.
