Sage Journals: Discover world-class research

Abstract

Despite calls to conceptualize credibility as three separate concepts—source credibility, message credibility, and media credibility—there exists no scale that exclusively measures message credibility. To address this gap, the current study constructs and validates a new scale. Results from a confirmatory factor analysis suggest that message credibility, specifically in the context of news, can be measured by asking participants to rate how well three adjectives describe content: accurate, authentic, and believable. Validity and reliability tests are reported, and contributions to credibility research are discussed.

Keywords

credibility message credibility news media journalism research methods scale construction measurement formative indicators reflective indicators confirmatory factor analysis (CFA)

Get full access to this article

View all access options for this article.

References

Bagozzi

(2012). Specification, evaluation, and interpretation of structural equation models. Journal of the Academy of Marketing Science, 40, 8-34. doi:10.1007/s11747-011-0278-x

Becker

(1998). Effect size calculators. Retrieved from http://www.uccs.edu/~lbecker/

Bledow

Frese

(2009). A situational judgment test of personal initiative and its relationship to performance. Personnel Psychology, 62, 229-258. doi:10.1111/j.1744-6570.2009.01137.x

Bollen

K. A.

(1989). Structural equations with latent variables. New York, NY: John Wiley.

Borah

(2013). Interactions of news frames and incivility in the political blogosphere: Examining perceptual outcomes. Political Communication, 30, 456-473. doi:10.1080/10584609.2012.737426

Brown

T. A.

(2003). Confirmatory factor analysis of the Penn State Worry Questionnaire: Multiple factors or method effects? Behaviour Research and Therapy, 41, 1411-1426. doi:10.1016/S0005-7967(03)00059-7

Brown

T. A.

(n.d.). Examples of unidentified and identified models with formative indicators. Retrieved from http://people.bu.edu/tabrown/Figure83.pdf

Carter

R. F.

Greenberg

B. S.

(1965). Newspapers or television: Which do you believe? Journalism & Mass Communication Quarterly, 42, 29-34. doi:10.1177/107769906504200104

Castillo

Mendoza

Poblete

(2013). Predicting information credibility in time-sensitive social media. Internet Research, 23, 560-588. doi:10.1108/IntR-05-2012-0095

10.

Chaffee

(1991). Communication concepts 1: Explication. Newbury Park, CA: SAGE.

11.

Chung

Nam

Stefanone

(2012). Exploring online news credibility: The relative influence of traditional and technological factors. Journal of Computer-Mediated Communication, 17, 171-186. doi:10.1111/j.1083-6101.2011.01565.x

12.

Cole

J. T.

Greer

J. D.

(2013). Audience response to brand journalism: The effect of frame, source, and involvement. Journalism & Mass Communication Quarterly, 90, 673-690. doi:10.1177/1077699013503160

13.

Cunningham

Bright

L. F.

(2012). The Tweet is in your court: Measuring attitude towards athlete endorsements in social media. International Journal of Integrated Marketing Communications, 4, 73-87.

14.

Devellis

R. F.

(2012). Scale development: Theory and application. Thousand Oaks, CA: SAGE.

15.

Diamantopoulos

Winklhofer

(2001). Index construction with formative indicators: An alternative to scale development. Journal of Marketing Research, 38, 269-277. doi:10.1509/jmkr.38.2.269.18845

16.

Dochterman

Stamp

(2010). Part 1: The determination of web credibility: A thematic analysis of web user’s judgments. Qualitative Research Reports in Communication, 11, 37-43. doi:10.1080/17459430903514791

17.

Edwards

Spence

P. R.

Gentile

C. J.

Edwards

(2013). How much Klout do you have . . . A test of system generated cues on source credibility. Computers in Human Behavior, 29(5), 12-16. doi:10.1016/j.chb.2012.12.034

18.

Gaziano

McGrath

(1986). Measuring the concept of credibility. Journalism Quarterly, 63, 451-462.

19.

Hayes

A. F.

Glynn

C. J.

Shanahan

(2005). Willingness to self-censor: A construct and measurement tool for public opinion research. International Journal of Public Opinion Research, 17, 298-323. doi:10.1093/ijpor/edh073

20.

Helm

(2005). Designing a formative measure for corporate reputation. Corporate Reputation Review, 8, 95-109. doi:10.1057/palgrave.crr.1540242

21.

Hoe

S. L.

(2008). Issues and procedures in adopting structural equation modeling technique. Journal of Applied Quantitative Methods, 3, 76-83.

22.

Holbert

R. L.

Stephenson

M. T.

(2008). Commentary on the uses and misuses of structural equation modeling in communication research. In Hayes

A. F.

Slater

M. D.

Snyder

L. B.

(Eds.), The SAGE sourcebook of advanced data analysis methods for communication research (pp. 185-218). Thousand Oaks, CA: SAGE.

23.

Hovland

Weiss

(1951). The influence of source credibility on communication effectiveness. Public Opinion Quarterly, 15, 635-650. doi:10.1086/266350

24.

Hovland

C. I.

Janis

I. L.

Kelley

H. H.

(1953). Communication and Persuasion. New Haven, CT: Yale University Press.

25.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118

26.

Hwang

(2013). The effect of Twitter use on politicians’ credibility and attitudes toward politicians. Journal of Public Relations Research, 25, 246-258. doi:10.1080/1062726X.2013.788445

27.

Kang

Yang

(2011, May). Measuring social media credibility: A study on a measure of blog credibility. Paper presented at the 61st annual conference of the International Communication Association, Boston, MA.

28.

Kline

R. B.

(2011). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press.

29.

Kohring

Matthes

(2005, May). Trust in news media. Development and validation of a multidimensional scale. Paper presented at the annual meeting of the International Communication Association, New York, NY.

30.

Lang

(2000). The limited capacity model of mediated message processing. Journal of Communication, 50, 46-70. doi:10.1111/j.1460-2466.2000.tb02833.x

31.

Lee

Ahn

(2013). Interaction effects of perceived sponsor motives and Facebook credibility on willingness to visit social cause Facebook page. Journal of Interactive Advertising, 13, 41-52. doi:10.1080/15252019.2013.768056

32.

Mayo

Leshner

(2000). Assessing the credibility of computer-assisted reporting. Newspaper Research Journal, 21(4), 68-82.

33.

McCroskey

(1966). Scales for the measurement of ethos. Speech Monographs, 33, 65-72. doi:10.1080/03637756609375482

34.

McCroskey

Teven

(1999). Goodwill: A reexamination of the construct and its measurement. Communication Monographs, 66, 90-103. doi:10.1080/03637759909376464

35.

Metzger

M. J.

Flanagin

A. J.

Eyal

Lemus

Mccann

(2003). Credibility for the 21st century: Integrating perspectives on source, message, and media credibility in the contemporary media environment. Communication Yearbook, 27, 293-335.

36.

Metzger

M. J.

Flanagin

A. J.

Medders

R. B.

(2010). Social and heuristic approaches to credibility evaluation online. Journal of Communication, 60, 413-439. doi:10.1111/j.1460-2466.2010.01488.x

37.

Paolacci

Chandler

(2014). Inside the Turk: Understanding mechanical Turk as a participant pool. Current Directions in Psychological Science, 23, 184-188. doi:10.1177/0963721414531598

38.

Paolacci

Chandler

Ipeirotis

P. G.

(2010). Running experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5, 411-419.

39.

Park

Xiang

Josiam

Kim

(2014). Personal profile information as cues of credibility in online travel reviews. Anatolia: An International Journal of Tourism and Hospitality Research, 25, 13-23. doi:10.1080/13032917.2013.820203

40.

Perloff

(2010). The dynamics of persuasion: Communication and attitudes in the 21st century. New York, NY: Routledge.

41.

Schmierbach

Oeldorf-Hirsch

(2012). A little bird told me, so I didn’t believe it: Twitter, credibility, and issue perceptions. Communication Quarterly, 60, 317-337. doi:10.1080/01463373.2012.688723

42.

Shen

Condit

Wright

(2008, May). The psychometric property and validation of a fatalism scale. Paper presented at the annual meeting of the International Communication Association, Montreal, Québec, Canada.

43.

Streiner

D. L.

Kottner

(2014). Recommendations for reporting the results of studies of instrument and scale development and testing. Journal of Advanced Nursing, 70, 1970-1979. doi:10.1111/jan.12402

44.

Sundar

S. S.

(1999). Exploring receivers’ criteria for perception of print and online news. Journalism & Mass Communication Quarterly, 76, 373-386. doi:10.1177/107769909907600213

45.

Sundar

S. S.

(2008). The MAIN model: A heuristic approach to understanding technology effects on credibility. In Metzger

Flanagin

(Eds.), Digital media, youth, and credibility (pp. 73-100). Cambridge, MA: MIT Press.

46.

Sundar

S. S.

Nass

(2001). Conceptualizing sources in online news. Journal of Communication, 51, 52-72. doi:10.1111/j.1460-2466.2001.tb02872.x

47.

Wang

Senecal

(2007). Measuring perceived website usability. Journal of Internet Commerce, 6(4), 97-112. doi:10.1080/15332860802086318

Measuring Message Credibility

Abstract

Keywords

Get full access to this article

References