Although ecological momentary assessment and experience sampling methods have been in use in other areas of the social and medical sciences for many years, organizational researchers have not taken advantage of these techniques. To rectify this situation, the authors examine the benefits and difficulties of ecological momentary assessment and offer suggestions for how it can be used effectively in organizations. In addition, the authors discuss the analysis of these data from a multilevel framework and place particular emphasis on procedures that examine the temporal nature of momentary data.
Get full access to this article
View all access options for this article.
References
1.
Alliger, G. M., & Williams, K. J. (1993). Using signal-contingent experience sampling methodology to study work in the field: A discussion and illustration examining task perceptions and mood. Personnel Psychology, 46, 525-549.
2.
Barrett, L. F., & Barrett, D. J. (2001). An introduction to computerized experience sampling in psychology. Social Science Computer Review, 19, 175-185.
3.
Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
4.
Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579-616.
5.
Chan, D., & Schmitt, N. (2000). Interindividual differences in intraindividual changes in proactivity during organizational entry: A latent growth modeling approach to understanding newcomer adaptation. Journal of Applied Psychology, 85, 190-210.
6.
Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
7.
Côté, S., & Moskowitz, D. S. (1998). On the dynamic covariation between interpersonal behavior and affect: Prediction from neuroticism, extraversion, and agreeableness. Journal of Personality & Social Psychology, 75, 1032-1046.
8.
Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience-sampling method. Journal of Nervous & Mental Disease, 175, 526-536.
9.
Csikszentmihalyi, M., Larson, R., & Prescott, S. (1977). The ecology of adolescent activity and experience. Journal of Youth & Adolescence, 6, 281-294.
10.
Csikszentmihalyi, M., & LeFevre, J. (1989). Optimal experience in work and leisure. Journal of Personality & Social Psychology, 56, 815-822.
11.
Deadrick, D. L., Bennett, N., & Russell, C. J. (1997). Using hierarchical linear modeling to examine dynamic performance criteria over time. Journal of Management, 23, 745-757.
12.
Deadrick, D. L., & Madigan, R. M. (1990). Dynamic criteria revisited: A longitudinal study of performance stability and predictive validity. Personnel Psychology, 43, 717-744.
13.
DeNisi, A. S., & Shaw, J. B. (1977). Investigation of the uses of self-reports of abilities. Journal of Applied Psychology, 62, 641-644.
14.
Diener, E., Larsen, R. J., Levine, S., & Emmons, R. A. (1985). Intensity and frequency: Dimensions underlying positive and negative affect. Journal of Personality & Social Psychology, 48, 1253-1265.
15.
Diggle, P., & Kenward, M. G. (1994). Informative drop-out in longitudinal data analysis. Journal of the Royal Statistical Society: Series C, Applied Statistics, 43, 49-93.
16.
Eid, M., & Langeheine, R. (1999). The measurement of consistency and occasion specificity with latent class models: A new model and its application to the measurement of affect. Psychological Methods, 4, 100-116.
17.
Fabes, R. A., & Eisenberg, N. (1997). Regulatory control and adults' stress-related responses to daily life events. Journal of Personality & Social Psychology, 73, 1107-1117.
18.
Fisher, C. D. (2000). Mood and emotions while working: Missing pieces of job satisfaction? Journal of Organizational Behavior, 21, 185-202.
19.
Fleeson, W. (2001). Toward a structure-and process-integrated view of personality: Traits as density distributions of states. Journal of Personality & Social Psychology, 80, 1011-1027.
20.
Goldstein, H. (2003). Multilevel statistical models (3rd ed.). London: Edward Arnold.
21.
Gottman, J. M. (1981). Time-series analysis: A comprehensive introduction for social scientists. London: Cambridge University Press.
22.
Henry, R. A., & Hulin, C. L. (1987). Stability of skilled performance across time: Some generalizations and limitations on utilities. Journal of Applied Psychology, 72, 457-462.
23.
Hoffman, C. C., Nathan, B. R., & Holden, L. M. (1991). A comparison of validation criteria: Objective versus subjective performance measures and self- versus supervisor ratings. Personnel Psychology, 44, 601-619.
24.
Hofmann, D. A., & Gavin, M. B. (1998). Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management, 24, 623-641.
25.
Hofmann, D. A., Griffin, M. A., & Gavin, M. B. (2000). The application of hierarchical linear modeling to organizational research. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions. San Francisco, CA: Jossey-Bass.
26.
Hofmann, D. A., Jacobs, R., & Baratta, J. E. (1993). Dynamic criteria and the measurement of change. Journal of Applied Psychology, 78, 194-204.
27.
Hofmann, D. A., Jacobs, R., & Gerras, S. J. (1992). Mapping individual performance over time. Journal of Applied Psychology, 77, 185-195.
28.
Jaccard, J., & Wan, C. K. (1993). Statistic alanalysis of temporal data with many observations: Issues for behavioral medicine data. Annals of Behavioral Medicine, 15, 41-50.
29.
Karney, B. R., & Bradbury, T. N. (1995). Assessing longitudinal change in marriage: An introduction to the analysis of growth curves. Journal of Marriage & the Family, 57, 1091-1108.
30.
Kane, J. S., & Lawler, E. E. (1979). Performance appraisal effectiveness: Its assessment and determinants. In B. Staw (Ed.), Research in organizational behavior (Vol. 1). Greenwich, CT: JAI.
31.
Kenny, D. A., Kashy, D. A., & Bolger, N. (1998). Data analysis in social psychology. In D. T. Gilbert, S. T. Fiske, & G. Lindzey (Eds.), The handbook of social psychology, (4th ed., Vol. 1, pp. 233-265). New York: Oxford University Press.
32.
Kenny, D. A., & Zautra, A. (1995). The trait-state-error model for multiwave data. Journal of Consulting & Clinical Psychology, 63, 52-59.
33.
Kreft, I., & de Leeuw, J. (1998). Introducing multilevel modeling. London: Sage.
34.
Kurek, K. E., Le, B., & Weiss, H. M. (2001, April). Studying affective climates using Web-based experience sampling methods. In H. M. Weiss (Chair), Experience sampling methods (ESM) in organizational research. Symposium conducted at the meeting of the Society for Industrial and Organizational Psychology, San Diego, CA.
35.
Larson, R. W., & Almeida, D. M. (1999). Emotional transmission in the daily lives of families: A new paradigm for studying family process. Journal of Marriage & the Family, 61, 5-20.
36.
Larson, R., Dworkin, J., & Verma, S. (2001). Men's work and family lives in India: The daily organization of time and emotion. Journal of Family Psychology, 15, 206-224.
37.
Litt, M. D., Cooney, N. L., & Morse, P. (1998). Ecological momentary assessment (EMA) with treated alcoholics: Methodological problems and potential solutions. Health Psychology, 17, 48-52.
38.
Mabe, P. A., & West, S. G. (1982). Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology, 67, 280-296.
39.
Miner, A. G. (2001). Experience sampling events, moods, behaviors, and performance at work. Unpublished doctoral dissertation, University of Illinois, Urbana-Champaign.
40.
Moskowitz, D. S., & Côté, S. (1995). Do interpersonal traits predict affect? A comparison of three models. Journal of Personality & Social Psychology, 69, 915-924.
41.
Moskowitz, D. S., & Hershberger, S. L. (2001). Modeling intraindividual variability with repeated measures data: Methods and applications. Mahwah, NJ: Lawrence Erlbaum.
42.
Nesselroade, J. R., McArdle, J. J., Aggen, S. H., & Meyers, J. M. (2002). Dynamic factor analysis models for representing process in multivariate time-series. In D. S. Moskowitz & S. L. Hershberger (Eds.), Modeling intraindividual variability with repeated measures data: Methods and applications. Mahwah, NJ: Lawrence Erlbaum.
43.
Nezlek, J. B. (2001). Multilevel random coefficient analyses of event- and interval-contingent data in social and personality psychology research. Personality & Social Psychology Bulletin, 27, 771-785.
44.
Ostroff, C. (1993). Comparing correlations based on individual-level and aggregated data. Journal of Applied Psychology, 78, 569-582.
45.
Raudenbush, S. W. (1995). Hierarchical linear models to study the effects of social context on development. In J. M. Gottman (Ed.), The analysis of change. Mahwah, NJ: Lawrence Erlbaum.
46.
Raudenbush, S. W., & Bryk, A. S. (1987). Examining correlates of diversity. Journal of Educational Statistics, 12, 241-269.
47.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
48.
Reis, H. T., & Gable, S. L. (2000). Event-sampling and other methods for studying everyday experience. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology. New York: Cambridge University Press.
49.
Robinson, M. D., & Clore, G. L. (2002). Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 128, 934-960.
50.
Rogosa, D., & Saner, H. (1995). Longitudinal data analysis examples with random coefficient models. Journal of Educational & Behavioral Statistics, 20, 149-170.
51.
Schwartz, J. E., & Stone, A. A. (1998). Strategies for analyzing ecological momentary assessment data. Health Psychology, 17, 6-16.
52.
Shiffman, S. (2000). Real-time self-report of momentary states in the natural environment: Computerized ecological momentary assessment. In A. A. Stone, J. S. Turkkan, & C. Bachrach (Eds.), The science of self-report: Implications for research and practice. Mahwah, NJ: Lawrence Erlbaum.
53.
Stone, A. A., Shiffman, S. S., & DeVries, M. W. (1999). Ecological momentary assessment. In D. Kahneman, E. Diener, & N. Schwarz (Eds.), Well-being: The foundations of hedonic psychology. New York: Russell Sage Foundation.
54.
Tesser, A. (1988). Toward a self-evaluation maintenance model of social behavior. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 21, pp. 181-227). New York: Academic Press.
55.
Teuchmann, K., Totterdell, P., & Parker, S. K. (1999). Rushed, unhappy, and drained: An experience sampling study of relations between time pressure, perceived control, mood, and emotional exhaustion in a group of accountants. Journal of Occupational Health Psychology, 4, 37-54.
56.
Thorndike, E. L. (1939). On the fallacy of imputing the correlations found for groups to the individuals or smaller groups composing them. American Journal of Psychology, 52, 122-124.
57.
Vancouver, J. B., Thompson, C. M., Tischner, E. C., & Putka, D. J. (2002). Two studies examining the negative effect of self-efficacy on performance. Journal of Applied Psychology, 87, 506-516.
58.
Vinchur, A. J., Schippmann, J. S., Smalley, M. D., & Rothe, H. F. (1991). Productivity consistency of foundry chippers and grinders: A 6-year field study. Journal of Applied Psychology, 76, 134-136.
59.
Weiss, H. M., Nicholas, J. P., & Daus, C. (1999). An examination of the joint effects of affective experiences and job beliefs on job satisfaction and variations in affective experiences over time. Organizational Behavior and Human Decision Processes, 78, 1-24.
60.
West, S. G., & Hepworth, J. T. (1991). Statistical issues in the study of temporal data: Daily experience. Journal of Personality, 59, 609-662.
61.
Wheeler, L., & Reis, H. T. (1991). Self-recording of everyday life events: Origins, types, and uses. Journal of Personality, 59, 339-354.
62.
Williams, K. J., Suls, J., Alliger, G. M., Learner, S. M., & Wan, C. K. (1991). Multiple role juggling and daily mood states in working mothers: An experience sampling study. Journal of Applied Psychology, 76, 664-674.
