Collecting Repeated Data Over Time: Applying Experience Sampling Methodology to the Hospitality Management Context

Abstract

While organizational and management research has implemented the use of experience sampling methods (ESM), hospitality management research has yet to reap the benefits of this method and design. ESM involves collecting data at several time points from participants as they experience organizational phenomena, measuring the variations and oscillations in attitudes, behaviors, and performance. This article seeks to define ESM for hospitality research, highlight the strengths, outline the challenges of ESM, and offer best practices by using ESM data from three hospitality industry examples. Each example compares cross-sectional data collection methods and analyses to ESM data collection methods and analyses to compare the different results of the data collection methods.

Keywords

experience sampling method research methods organizational behavior

Get full access to this article

View all access options for this article.

References

Bass

B. M.

Riggio

R. E.

(2006). Transformational leadership. Psychology Press.

Bauer

D. J.

Preacher

K. J.

Gil

K. M.

(2006). Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: New procedures and recommendations. Psychological Methods, 11(2), 142–163.

Beal

D. J.

(2015). ESM 2.0: State of the art and future potential of experience sampling methods in organizational research. Annual Review of Organizational Psychology and Organizational Behavior, 2(1), 383–407.

Beal

D. J.

Gabriel

A. S.

(2019). Looking within: An examination, combination, and extension of within-person methods across multiple levels of analysis. In Humphrey

S. E.

LeBreton

J. M.

(Eds.), The handbook of multilevel theory, measurement, and analysis (pp. 305–327). American Psychological Association.

Bird

B. J.

(1992). The operation of intentions in time: The emergence of the new venture. Entrepreneurship Theory and Practice, 17(1), 11–20.

Bliese

P. D.

Halverson

R. R.

(1998). Group size and measures of group-level properties: An examination of eta-squared and ICC values. Journal of Management, 24(2), 157–172.

Bolger

Laurenceau

J.-P.

(2013). Intensive longitudinal methods: An introduction to diary and experience sampling research. Guilford Press.

Buhi

E. R.

Goodson

Neilands

T. B.

(2008). Out of sight, not out of mind: Strategies for handling missing data. American Journal of Health Behavior, 32(1), 83–92.

Burke

R. J.

(2018). Human resource management in the hospitality and tourism sector. In Burke

R. J.

Hughes

J. C.

(Eds.), Handbook of human resource management in the tourism and hospitality industries (pp. 3–39). Edward Elgar.

10.

Castro

S. L.

(2002). Data analytic methods for the analysis of multilevel questions: A comparison of intraclass correlation coefficients, rwg (j), hierarchical linear modeling, within-and between-analysis, and random group resampling. The Leadership Quarterly, 13(1), 69–93.

11.

Csikszentmihalyi

Larson

(2014). Validity and reliability of the experience-sampling method. In Csikszentmihalyi

(Ed.), Flow and the foundations of positive psychology: The collected works of Mihaly Csikszentmihalyi (pp. 35–54). Springer.

12.

Dhanani

L. Y.

LaPalme

M. L.

(2019). It’s not personal: A review and theoretical integration of research on vicarious workplace mistreatment. Journal of Management, 45(6), 2322–2351.

13.

Ellis

M. V.

(1999). Repeated measures designs. The Counseling Psychologist, 27(4), 552–578.

14.

Enders

C. K.

Bandalos

D. L.

(2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling, 8(3), 430–457.

15.

Fitzgerald

L. F.

Swan

Magley

V. J.

(1997). But was it really sexual harassment? Legal, behavioral, and psychological definitions of the workplace victimization of women. In O’Donohue

(Ed.), Sexual harassment: Theory, research, and treatment (pp. 5–28). Allyn & Bacon.

16.

Gabriel

A. S.

Podsakoff

N. P.

Beal

D. J.

Scott

B. A.

Sonnentag

Trougakos

J. P.

Butts

M. M.

(2019). Experience sampling methods: A discussion of critical trends and considerations for scholarly advancement. Organizational Research Methods, 22(4), 969–1006.

17.

Geng

Liu

Feng

(2014). The effects of emotional labor on frontline employee creativity. International Journal of Contemporary Hospitality Management, 26(7), 1046–1064.

18.

Grandey

A. A.

(2000). Emotional regulation in the workplace: A new way to conceptualize emotional labor. Journal of Occupational Health Psychology, 5(1), 95–110.

19.

Han

S. J.

Bonn

M. A.

Cho

(2016). The relationship between customer incivility, restaurant frontline service employee burnout and turnover intention. International Journal of Hospitality Management, 52, 97–106.

20.

Harris

L. C.

Ogbonna

(2006). Service sabotage: A study of antecedents and consequences. Journal of the Academy of Marketing Science, 34(4), 543–558.

21.

Harris

L. C.

Reynolds

K. L.

(2004). Jaycustomer behavior: An exploration of types and motives in the hospitality industry. Journal of Services Marketing, 18(5), 339–357.

22.

Hayes

A. F.

(2012). PROCESS: A versatile computational tool for observed variable mediation, moderation, and conditional process modeling. http://www.afhayes.com/public/process2012.pdf

23.

Heck

R. H.

Thomas

S. L.

Tabata

L. N.

(2013). Multilevel and longitudinal modeling with IBM SPSS. Routledge.

24.

Hoffman

Stawski

R. S.

(2009). Persons as contexts: Evaluating between-person and within-person effects in longitudinal analysis. Research in Human Development, 6(2–3), 97–120.

25.

Hülsheger

U. R.

Schewe

A. F.

(2011). On the costs and benefits of emotional labor: A meta-analysis of three decades of research. Journal of Occupational Health Psychology, 16(3), 361–389.

26.

Hur

W. M.

Won Moon

Jun

J. K.

(2013). The role of perceived organizational support on emotional labor in the airline industry. International Journal of Contemporary Hospitality Management, 25(1), 105–123.

27.

Ineson

E. M.

Yap

M. H.

Whiting

(2013). Sexual discrimination and harassment in the hospitality industry. International Journal of Hospitality Management, 35, 1–9.

28.

Judge

T. A.

Woolf

E. F.

Hurst

(2009). Is emotional labor more difficult for some than for others? A multilevel, experience-sampling study. Personnel Psychology, 62(1), 57–88.

29.

Jung

H. S.

Yoon

H. H.

(2014). Moderating role of hotel employees’ gender and job position on the relationship between emotional intelligence and emotional labor. International Journal of Hospitality Management, 43, 47–52.

30.

Kammeyer-Mueller

J. D.

Rubenstein

A. L.

Long

D. M.

Odio

M. A.

Buckman

B. R.

Zhang

Halvorsen-Ganepola

M. D.

(2013). A meta-analytic structural model of dispositional affectivity and emotional labor. Personnel Psychology, 66(1), 47–90.

31.

Larson

Csikszentmihalyi

(2014). The experience sampling method. In Csikszentmihalyi

(Ed.), Flow and the foundations of positive psychology: The collected works of Mihaly Csikszentmihalyi (pp. 21–34). Springer.

32.

Lee

J. J.

Hwang

(2016). An emotional labor perspective on the relationship between customer orientation and job satisfaction. International Journal of Hospitality Management, 54, 139–150.

33.

Lee

J. J.

C. M.

(2014). Understanding hotel employees’ service sabotage: Emotional labor perspective based on conservation of resources theory. International Journal of Hospitality Management, 36, 176–187.

34.

Lee

Madera

J. M.

(2019). A systematic literature review of emotional labor research from the hospitality and tourism literature. International Journal of Contemporary Hospitality Management, 31, 2808–2826.

35.

Little

R. J.

(1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202.

36.

Maas

C. J.

Hox

J. J.

(2005). Sufficient sample sizes for multilevel modeling. Methodology, 1(3), 86–92.

37.

Madera

J. M.

(2018). When targets blame their organization for sexual harassment: A multilevel investigation of within-person appraisals. Cornell Hospitality Quarterly, 59(1), 49–60.

38.

Madera

J. M.

Dawson

Guchait

Belarmino

A. M.

(2017). Strategic human resources management research in hospitality and tourism: A review of current literature and suggestions for the future. International Journal of Contemporary Hospitality Management, 29, 48–67.

39.

Madera

J. M.

Lee

Dawson

(2019). Sexual harassment and sexual assault training: Consider the industry. Industrial and Organizational Psychology, 12(1), 96–99.

40.

Maxwell

S. E.

Cole

D. A.

(2007). Bias in cross-sectional analyses of longitudinal mediation. Psychological Methods, 12(1), 23–44.

41.

McLean

D. C.

Nakamura

Csikszentmihalyi

(2017). Explaining system missing: Missing data and experience sampling method. Social Psychological & Personality Science, 8(4), 434–441.

42.

Min

Park

Kim

H. J.

(2016). Common method bias in hospitality research: A critical review of literature and an empirical study. International Journal of Hospitality Management, 56, 126–135.

43.

Nooraee

Molenberghs

Ormel

Van den Heuvel

E. R.

(2018). Strategies for handling missing data in longitudinal studies with questionnaires. Journal of Statistical Computation and Simulation, 88(17), 3415–3436.

44.

Preacher

K. J.

Selig

J. P.

(2010, July). Monte Carlo method for assessing multilevel Mediation: An interactive tool for creating confidence intervals for indirect effects in 1-1-1 multilevel models [Computer software]. http://quantpsy.org/

45.

Preacher

K. J.

Zyphur

M. J.

Zhang

(2010). A general multilevel SEM framework for assessing multilevel mediation. Psychological Methods, 15(3), 209–233.

46.

Robinson

M. D.

Clore

G. L.

(2002). Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 128(6), 934–960.

47.

Scott

B. A.

Barnes

C. M.

Wagner

D. T.

(2012). Chameleonic or consistent? A multilevel investigation of emotional labor variability and self-monitoring. Academy of Management Journal, 55(4), 905–926.

48.

Seber

G. A.

Lee

A. J.

(2012). Linear regression analysis (Vol. 329). John Wiley.

49.

Shiffman

Stone

A. A.

Hufford

M. R.

(2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4, 1–32.

50.

Song

Liu

Wang

Lanaj

Johnson

R. E.

Shi

(2018). A social mindfulness approach to understanding experienced customer mistreatment: A within-person field experiment. Academy of Management Journal, 61(3), 994–1020.

51.

Torres

E. N.

van Niekerk

Orlowski

(2017). Customer and employee incivility and its causal effects in the hospitality industry. Journal of Hospitality Marketing & Management, 26(1), 48–66.

52.

Tracey

J. B.

(2014). A review of human resources management research: The past 10 years and implications for moving forward. International Journal of Contemporary Hospitality Management, 26, 679–705.

53.

M. A.

Foo

M. D.

Aguinis

(2010). Using experience sampling methodology to advance entrepreneurship theory and research. Organizational Research Methods, 13(1), 31–54.

54.

Van Jaarsveld

D. D.

Walker

D. D.

Skarlicki

D. P.

(2010). The role of job demands and emotional exhaustion in the relationship between customer and employee incivility. Journal of Management, 36(6), 1486–1504.

55.

Walker

D. D.

van Jaarsveld

D. D.

Skarlicki

D. P.

(2014). Exploring the effects of individual customer incivility encounters on employee incivility: The moderating roles of entity (in) civility and negative affectivity. Journal of Applied Psychology, 99(1), 151–161.

56.

Wang

L. P.

Maxwell

S. E.

(2015). On disaggregating between-person and within-person effects with longitudinal data using multilevel models. Psychological Methods, 20(1), 63–83.

57.

Willness

C. R.

Steel

Lee

(2007). A meta-analysis of the antecedents and consequences of workplace sexual harassment. Personnel Psychology, 60(1), 127–162.

58.

Woltman

Feldstain

MacKay

J. C.

Rocchi

(2012). An introduction to hierarchical linear modeling. Tutorials in Quantitative Methods for Psychology, 8(1), 52–69.

59.

S. T.

Cao

Z. C.

Huo

(2020). Antecedents and outcomes of emotional labour in hospitality and tourism: A meta-analysis. Tourism Management, 79, 104099.

60.

Shi

(2020). Applications of the experience sampling method: A research agenda for hospitality management. International Journal of Contemporary Hospitality Management, 32, 1625–1641.

61.

Zhu

Lyu

(2019). Workplace sexual harassment, workplace deviance, and family undermining. International Journal of Contemporary Hospitality Management, 31(2), 594–614.