The recent growth in diary and experience sampling research has increased research attention on how people change over time in natural settings. Often however, the measures in these studies were originally developed for studying between-person differences, and their sensitivity to within-person changes is usually unknown. Using a Generalizability Theory framework, the authors illustrate a procedure for developing reliable measures of change using a version of the Profile of Mood States (POMS; McNair, Lorr, & Droppleman, 1992) shortened for diary studies. Analyzing two data sets, one composed of 35 daily reports from 68 persons experiencing a stressful examination and another composed of daily reports from 164 persons over a typical 28-day period, we demonstrate that three-item measures of anxious mood, depressed mood, anger, fatigue, and vigor have appropriate reliability to detect within-person change processes.
Get full access to this article
View all access options for this article.
References
1.
Almeida, D. M. (2005). Resilience and vulnerability to daily stressors assessed via diary methods. Current Directions in Psychological Science, 14, 64-68.
2.
Barrett, L. F. (1997). The relationships among momentary emotion experiences, personality descriptions, and retrospective ratings of emotion. Personality and Social Psychology Bulletin, 23, 1100-1110.
3.
Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579-616.
4.
Bolger, N., DeLongis, A., Kessler, R. C., & Schilling, E. A. (1989). Effects of daily stress on negative mood. Journal of Personality and Social Psychology, 57, 808-818.
5.
Bolger, N., & Eckenrode, J. (1991). Social relationships, personality, and anxiety during a major stressful event. Journal of Personality and Social Psychology61, 440-449.
6.
Bolger, N., & Shrout, P. E. (in press). Accounting for statistical dependency in longitudinal data on dyads. In T. D. Little, J. A. Bovaird, & N. A. Card (Eds.), Modeling ecological and contextual effects in longitudinal studies of human development. Mahwah, NJ: Lawrence Erlbaum.
7.
Bolger, N., & Zuckerman, A. (1995). A framework for studying personality in the stress process. Journal of Personality and Social Psychology69, 890-902.
8.
Bolger, N., Zuckerman, A., & Kessler, R. C. (2000). Invisible support and adjustment to stress. Journal of Personality and Social Psychology, 79, 953-961.
9.
Brennan, R. L. (2001). Generalizability theory. New York: Springer.
10.
Clark, L. A., & Watson, D. (1988). Mood and the mundane: Relations between daily life events and self-reported mood. Journal of Personality and Social Psychology54, 296-308.
11.
Cochran, W. G. (1977). Sampling techniques (3rd ed.). New York: John Wiley.
12.
Collins, L. M. (1996). Is reliability obsolete? A commentary on “Are Simple Gain Scores Obsolete?” Applied Psychological Measurement20, 289-292.
13.
Cranford, J. A. (2004). Stress-buffering or stress-exacerbation? Social support and social undermining as moderators of the relationship between perceived stress and depressive symptoms among married people. Personal Relationships, 11, 23-40.
14.
Cronbach, L. J., & Furby, L. (1970). How should we measure “change”—or should we? Psychological Bulletin74, 68-80.
15.
Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: John Wiley.
16.
Fredrickson, B. L., & Joiner, T. (2002). Positive emotions trigger upward spirals toward emotional well-being. Psychological Science13, 172-175.
17.
Gable, S. L., Reis, H. T., & Elliot, A. J. (2000). Behavioral activation and inhibition in everyday life. Journal of Personality and Social Psychology78, 1135-1149.
18.
Gleason, M. E. J., Iida, M., Bolger, N., & Shrout, P. E. (2003). Daily supportive equity in close relationships. Personality and Social Psychology Bulletin29, 1036-1045.
19.
Green, A. S., Rafaeli, E., Bolger, N., Shrout, P. E., & Reis, H. T. (in press). Paper or plastic? Data equivalence in paper and electronic diaries. Psychological Methods.
20.
Hamaker, E. L., & Molenaar, P. C. M. (2004, June). The integrated statetrait model. Paper presented at the annual meeting of the Psychometric Society, Pacific Grove, CA.
21.
Humphreys, L. G. (1996). Linear dependence of gain scores on their components imposes constraints on their use and interpretation: Comment on “Are Simple Gain Scores Obsolete?” Applied Psychological Measurement20, 293-294.
22.
Kenny, D. A., & Zautra, A. (1995). The trait-state-error model for multiwave data. Journal of Consulting and Clinical Psychology63, 52-59.
23.
Kenny, D. A., & Zautra, A. (2001). Trait-state models for longitudinal data. In L. M. Collins & A. G. Sayer (Eds.), New methods for the analysis of change (pp. 243-263). Washington, DC: American Psychological Association.
24.
Kennedy, J. K., Bolger, N., & Shrout, P. E. (2002). Witnessing interparental psychological aggression in childhood: Implications for daily conflict in adult intimate relationships. Journal of Personality, 70, 1051-1077.
25.
Larsen, R. J., & Kasimatis, M. (1990). Individual differences in entrainment of mood to the weekly calendar. Journal of Personality and Social Psychology, 58, 164-171.
26.
Litt, M. D., Cooney, N. D., & Morse, P. (1998). Ecological momentary assessment (EMA) with treated alcoholics: Methodological problems and potential solutions. Health Psychology, 17, 48-52.
27.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
28.
McNair, D. M., Lorr, M., & Droppleman, L. F. (1992). EdITS manual for the Profile of Mood States. San Diego, CA: Educational and Industrial Testing Service.
29.
Rafaeli, E., Cranford, J. A., Green, A. S., Bolger, N., & Shrout, P. E. (2003, February). The good and bad of relationships: Effects of social hindrance and social support on relationship moods in daily life. Poster session presented at the annual meeting of the Society for Personality and Social Psychology, Los Angeles.
30.
Rao, C. R. (1971). Estimation of variance and covariance components—MINQUE theory. Journal of Multivariate Analysis1, 257-275.
31.
Reid, S., Towell, A. D., & Golding, J. F. (2000). Seasonality, social zeitgebers and mood variability in entrainment of mood: Implications for seasonal affective disorder. Journal of Affective Disorders, 59, 47-54.
32.
Reis, H. T., & Gable, S. L. (2000). Event-sampling and other methods for studying everyday experience. In H. T. Reiss & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology(pp. 190-222). Cambridge, UK: Cambridge University Press.
33.
Reis, H. T., Sheldon, K. M., Gable, S. L., Roscoe, J., & Ryan, R. M. (2000). Daily well-being: The role of autonomy, competence, and relatedness. Personality and Social Psychology Bulletin, 26, 419-435.
34.
Rogosa, D. R. (1988). Myths about longitudinal research. In K. W. Schaie, R. T. Campbell, W. Meredith, & S. C. Rawlings (Eds.), Methodological issues in aging research (pp. 171-209). New York: Springer.
35.
Rogosa, D. R., & Willett, J. B. (1983). Demonstrating the reliability of the difference score in the measurement of change. Journal of Educational Measurement20, 335-343.
36.
Rushton, J. P., Brainerd, C. J., & Pressley, M. (1983). Behavioral development and construct validity: The principle of aggregation. Psychological Bulletin, 94, 18-38.
37.
Ryan, R. M. (1995). Psychological needs and the facilitation of integrative processes. Journal of Personality, 63, 397-427.
38.
SAS Institute. (1997). SAS/STAT software: Changes and enhancements through release 6.12. Cary, NC: Author.
39.
SAS Institute. (2004). SAS/STAT 9.1 user's guide. Cary, NC: Author.
40.
Schimmack, U. (2003). Affect measurement in experience sampling research. Journal of Happiness Studies, 4, 79-106.
41.
Scollon, C. N., Kim-Prieto, C., & Diener, E. (2003). Experience sampling: Promises and pitfalls, strengths and weaknesses. Journal of Happiness Studies, 4, 5-34.
42.
Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
43.
Shavelson, R. J., Webb, N. M., & Rowley, G. L. (1989). Generalizability theory. American Psychologist, 44, 922-932.
44.
Shrout, P. E., Herman, C., & Bolger, N. (in press). The costs and benefits of practical and emotional support on adjustment: A daily diary study of couples experiencing acute stress. Personal Relationships.
45.
Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. Oxford, UK: Oxford University Press.
46.
Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 12, 102-111.
47.
Steyer, R., Majcen, A. M., Schwenkmezger, P., & Buchner, A. (1989). A latent state-trait anxiety model and its application to determine consistency and specificity coefficients. Anxiety Research1, 281-299.
48.
Steyer, R., Schmitt, M., & Eid, M. (1999). Latent state-trait theory and research in personality and individual differences. European Journal of Personality13, 398-408.
49.
Stone, A. A., Hedges, S. M., Neale, J. M., & Satin, M. S. (1985). Prospective and cross-sectional mood reports offer no evidence of a blue Monday phenomenon. Journal of Personality and Social Psychology49, 129-134.
50.
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2002). Patient non-compliance with paper diaries. British Medical Journal, 324, 1193-1194.
51.
Suls, J., Martin, R., & David, J. P. (1998). Person-environment fit and its limits: Agreeableness, neuroticism, and emotional reactivity to interpersonal conflict. Personality and Social Psychology Bulletin, 24, 88-98.
52.
Tennen, H., & Affleck, G. (2002). The challenge of capturing daily processes at the interface of social and clinical psychology. Journal of Social and Clinical Psychology, 21, 610-627.
53.
Thompson, A., & Bolger, N. (1999). Emotional transmission in couples under stress. Journal of Marriage and the Family, 61, 38-48.
54.
Watson, D. (2000). Mood and temperament. New York: Guilford.
55.
Watson, D., & Vaidya, J. (2003). Mood measurement: Current status and future directions. In J. A. Schinka, W. F. Velicar, & I. B. Weiner (Eds.), Handbook of psychology, Vol. 2: Research methods in psychology(pp. 351-375). New York: John Wiley.
56.
Winer, B. J. (1971). Statistical principles in experimental design. New York: McGraw-Hill.
