Social media (SM) assessments are a new type of selection procedure. Their frequency of use in hireability decision-making is substantial, encompassing both utilitarian (e.g., LinkedIn) and hedonic (e.g., Facebook) platforms. Yet, there is limited evidence of SM assessment validity (prediction of job performance). This mismatch (use vs. lack of validity evidence) motivated our study of why decision-makers embrace such information. We used (i) the unified technology acceptance model and (ii) organizational justice theory to list positively framed facets of SM assessments (e.g., provide information about applicant skills, used consistently, fun to use). Decision-makers were assigned to one of three conditions—information retrieved from Facebook, LinkedIn, or structured interviews (as a baseline)—and were asked to rate how well these explanatory facets characterized information from those SM (and comparison) sources. Empirical composites (principal components) of these facets were developed. We found that all composites were positively related to use of SM across all conditions. These findings are disconcerting given the equivocal validity of SM assessments (and potential for much extraneous, non-job-related information). We urge continued research on reasons for frequent use of SM assessments, as well as implications of that use. Such research for other predictors is also encouraged.
AcquistiA.FongC. (2019). An experiment in hiring discrimination via online social networks. Management Science, 66, 1005–1024. https://doi.org/10.1287/mnsc.2018.3269
2.
Al-QaysiN.Mohamad-NordinN.Al-EmranM. (2020). Employing the technology acceptance model in social media: A systematic review. Education and Information Technologies, 25, 4961–5002. https://doi.org/10.1007/s10639-020-10197-1
3.
ArthurWJrHagenE.GeorgeFJr (2021). The lazy or dishonest respondent: Detection and prevention. Annual Review of Organizational Psychology and Organizational Behavior, 8, 105–137. https://doi.org/10.1146/annurev-orgpsych-012420-055324
4.
BauerT. N.TruxilloD. M.SanchezR. J.CraigJ. M.FerraraP.CampionM. A. (2001). Applicant reactions to selection: Development of the Selection Procedural Justice Scale (SPJS). Personnel Psychology, 54, 388–420. https://doi.org/10.1111/j.1744-6570.2001.tb00097.x
5.
BaumertA.BeierleinC.SchmittM.KemperC.KovalevaA.LiebigS.RammstedtB. (2014). Measuring four perspectives of justice sensitivity with two items each. Journal of Personality Assessment, 96, 380–390. https://doi.org/10.1080/00223891.2013.836526
6.
BeaneD.PonnapalliA.ViswesvaranC. (2017). Workplace religious displays and perceptions of organization attractiveness. Employee Responsibilities and Rights Journal, 29, 73–88. https://doi.org/10.1007/s10672-016-9286-9
BerkelaarB. L. (2014). Cybervetting, online information, and personnel selection: New transparency expectations and the emergence of a digital social contract. Management Communication Quarterly, 28, 479–506. https://doi.org/10.1177/0893318914541966
9.
BerkelaarB. L. (2017). Different ways new information technologies influence conventional organizational practices and employment relationships: The case of cybervetting for personnel selection. Human Relations, 70, 1115–1140. https://doi.org/10.1177/0018726716686400
10.
BerkelaarB. L.BirdsellJ. L.ScaccoJ. M. (2016). Storying the digital professional: how online screening shifts the primary site and authorship of workers’ career stories. Journal of Applied Communication Research, 44, 275–295. https://doi.org/10.1080/00909882.2016.1192287
11.
BerkelaarB. L.BuzzanellP. M. (2015). Online employment screening and digital career capital: Exploring employers’ use of online information for personnel selection. Management Communication Quarterly, 29, 84–113. https://doi.org/10.1177/0893318914554657
12.
BiesR. J. (2005). Are procedural justice and interactional justice conceptually distinct? In GreenbergJ.ColquittJ. A. (Eds.), Handbook of organizational justice (pp. 85–112). Lawrence Erlbaum Associates.
13.
BlackS. L.StoneD. L.JohnsonA. F. (2015). Use of social networking websites on applicants’ privacy. Employee Responsibilities and Rights Journal, 27, 115–159. https://doi.org/10.1007/s10672-014-9245-2
14.
BlutM.ChongA. Y. L.TsigaZ.VenkateshV. (2022 (January)). Meta-analysis of the unified theory of acceptance and use of technology (UTAUT): Challenging its validity and charting a research agenda in the red ocean. Journal of the Association for Information Systems, 23, 13–95. https://doi.org/10.17705/1jais.00719
15.
BobkoP.RothP. L. (2013). An analysis of the level of standardized Black-White mean differences on predictors of job performance: Verifying some perceptions and correcting others. Personnel Psychology, 66, 91–126. https://doi.org/10.1111/peps.12007
16.
BobkoP.RothP.BusterM. (2007). The usefulness of unit-weights in creating composite scores: A literature review, application to content validity, and meta-analysis. Organizational Research Methods, 10, 689–709. https://doi.org/10.1177/1094428106294734
17.
BrechtF.EckhardtA.BergerC.GuentherO. (2012, May). Corporate career presences on social network sites: An analysis of hedonic and utilitarian value. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2441–2450).
18.
BrownV. R.VaughnE. D. (2011). The writing on the (Facebook) wall: The use of social networking sites in hiring decisions. Journal of Business & Psychology, 26, 219–225. https://doi.org/10.1007/s10869-011-9221-x
19.
CarrC. T.KatreebM. C.GodinezE. P. (2023). Temporal impacts of problematic social media content on perceived employee hirability. Media Psychology, 27, 76–105. https://doi.org/10.1080/15213269.2023.2222529
20.
CarrC. T.WaltherJ. B. (2014). Increasing attributional certainty via social media: Learning about others one bit at a time. Journal of Computer-Mediated Communication, 19, 922–937. https://doi.org/10.1111/jcc4.12072
ColquittJ. A. (2001). On the dimensionality of organizational justice: A construct validation of a measure. Journal of Applied Psychology, 86, 386–400. https://doi.org/10.1037/0021-9010.86.3.386
23.
ColquittJ. A.ConlonD. E.WessonM. J.PorterC. O. L. H.NgK. Y. (2001). Justice at the millennium: A meta-analytic review of 25 years of justice research. Journal of Applied Psychology, 86, 425–445. https://doi.org/10.1037/0021-9010.86.3.425
24.
ColquittJ. A.LongD. M.RodellJ. B.Halvorsen-GanepolaM. D. K. (2015). Adding the “in” to justice: A qualitative and quantitative investigation of the differential effects of justice rule adherence and violation. Journal of Applied Psychology, 100, 278–297. https://doi.org/10.1037/a0038131
*Crosstab. (2010). Online reputation in a connected world. Report prepared for Microsoft. www.cross-tab.com
27.
CubrichM.KingR. T.MracekD. L.StrongJ. M. G.HassenkampK.VaughnD.DudleyN. M. (2021). Examining the criterion-related validity evidence of LinkedIn profile elements in an applied sample. Computers in Human Behavior, 120, 1–8. https://doi.org/10.1016/j.chb.2021.106742
28.
CurranP. G. (2016). Methods for the detection of carelessly invalid responses in survey data. Journal of Experimental Social Psychology, 66, 4–19. https://doi.org/10.1016/j.jesp.2015.07.006
29.
DavisF. D.GranicA.MarangunićN. (2024). The technology acceptance model: 30 years of TAM. Springer International Publishing AG.
30.
DavisonH. K.MaraistC. C.HamiltonR. H.BingM. N. (2012). To screen or not to screen? Using the Internet for selection decisions. Employee Responsibilities and Rights Journal, 24, 1–21. https://doi.org/10.1007/s10672-011-9178-y
31.
DeSimoneJ. A.HarmsP. D.DeSimoneA. J. (2015). Best practice recommendations for data screening. Journal of Organizational Behavior, 36, 171–181. https://doi.org/10.1002/job.1962
32.
DrouinM.O'ConnorK. W.SchmidtG. B.MillerD. A. (2015). Facebook fired: Legal perspectives and young adults’ opinions on the use of social media in hiring and firing decisions. Computers in Human Behavior, 46, 123–128. https://doi.org/10.1016/j.chb.2015.01.011
33.
EberlyM. B.HolleyE. C.JohnsonM. D.MitchellT. R. (2017). It’s not me, it’s not you, it’s us! An empirical examination of relational attributions. Journal of Applied Psychology, 102, 711–731. https://doi.org/10.1037/apl0000187
34.
El OuirdiM.PaisI.SegersJ.El OuirdiA. (2016). The relationship between recruiter characteristics and applicant assessment on social media. Computers in Human Behavior, 62, 415–422. https://doi.org/10.1016/j.chb.2016.04.012
35.
EvuleochaS. U.UgbahS. D. (2018). Profiling: The efficacy of using social networking sites for job screening. Journal of Employment Counseling, 55, 48–57. https://doi.org/10.1002/joec.12074
36.
FrantzN.PearsE.VaughnE.FerrellJ.DudleyN. (2016). Is John Smith really John Smith? Misrepresentations and misattributions of candidates using social media and social networking sites. In LandersR.SchmidtG. (Eds.), Social media in employee selection and recruitment: Theory, practice, and current challenges (pp. 307–339). Springer International Publishing.
37.
GatewoodR. D.FeildH. S.BarrickM. (2015). Human resource selection (8th ed.). South-Western.
38.
GeorgeD.GreenM.NavarroA.StazykK.ClarkM. (2014). Medical student views on the use of Facebook profile screening by residency admissions committees. Postgraduate Medical Journal, 90, 251–253. https://doi.org/10.1136/postgradmedj-2013-132336
39.
GerowJ. E.AyyagariR.ThatcherJ. B.RothP. L. (2013). Can we have fun@ work? The role of intrinsic motivation for utilitarian systems. European Journal of Information Systems, 22, 360–380. https://doi.org/10.1057/ejis.2012.25
40.
GibbsC.MacDonaldF.MacKayK. (2015). Social media usage in hotel human resources: Recruitment, hiring and communication. International Journal of Contemporary Hospitality Management, 27, 170–184. https://doi.org/10.1108/IJCHM-05-2013-0194
41.
GillilandS. W. (1993). The perceived fairness of selection systems: An organizational justice perspective. The Academy of Management Review, 18, 694–734. https://doi.org/10.2307/258595
42.
GillilandS. W.SteinerD. D. (2012). Applicant reactions to testing and selection. In SchmittN. (Ed.), The Oxford handbook of personnel assessment and selection (pp. 629–666). Oxford University Press.
*HartwellC. J. (2015). The use of social media in employee selection: Prevalence, content, perceived usefulness, and influence on hiring decisions. Purdue University. https://docs.lib.purdue.edu/dissertations/AAI3735185/
50.
HartwellC. J.CampionM. A. (2019). Getting social in selection: How social networking website content is perceived and used in hiring. International Journal of Selection and Assessment, 1–151. https://doi.org/10.1111/ijsa.12273
HedenusA.Christel BackmanC.HåkanssonP. (2021). Whom do you know? Recruiters’ motives for assessing jobseekers’ online networks. The International Journal of Human Resource Management, 32, 1754–1777. https://doi.org/10.1080/09585192.2019.1579245
JeskeD.ShultzK. S. (2016). Using social media content for screening in recruitment and selection: Pros and cons. Work, Employment and Society, 30, 535–546. https://doi.org/10.1177/0950017015613746
KaplanA. M.HaenleinM. (2010). Users of the world, unite! The challenges and opportunities of social media. Business Horizons, 53, 59–68. https://doi.org/10.1016/j.bushor.2009.09.003
KluemperD. H. (2013). Social network screening: pitfalls, possibilities, and parallels in employment selection. In BondaroukT.Olivas-LujanM. (Eds.), Advanced Series in Management (pp. 1–21). Emerald Group Publishing Ltd.
66.
KluemperD. H.DavisonH. K.CaoX.WuB. (2015). Social networking websites and personnel selection: A call for academic research. In NikolaouI.OostromJ. K. (Eds.), Employee recruitment, selection, and assessment: Contemporary issues for theory and practice (pp. 61–79). Routledge/Taylor & Francis Group.
67.
KluemperD. H.RosenP. A. (2009). Future employment selection methods: Evaluating social networking web sites. Journal of Managerial Psychology, 24, 567–580. https://doi.org/10.1108/02683940910974134
68.
KluemperD. H.RosenP. A.MossholderK. (2012). Social networking websites, personality ratings, and the organizational context: More than meets the eye. Journal of Applied Social Psychology, 42, 1143–1172. https://doi.org/10.1111/j.1559-1816.2011.00881.x
69.
LievensF.De PaepeA. (2004). An empirical investigation of interviewer-related factors that discourage the use of high structure interviews. Journal of Organizational Behavior, 25, 29–46. https://doi.org/10.1002/job.246
70.
LimayemM.HirtS. G.CheungC. M. (2007). How habit limits the predictive power of intention: The case of information systems continuance. MIS Quarterly, 31, 705–737. https://doi.org/10.2307/25148817
71.
ManroopL.MalikA.CampR.SchulzE. (2022). Applicant reactions to social media assessment: A review and conceptual framework. Human Resource Management Review, 32, 1–17. https://doi.org/10.1016/j.hrmr.2021.100853
72.
McChesneyJ.FosterL. (2024). Is it #okaytosay I have anxiety and depression? Evaluations of job applicants who disclose mental health problems on LinkedIn. Journal of Business and Psychology, 39, 779–795. https://doi.org/10.1007/s10869-023-09907-6
73.
McFarlandL. A.PloyhartR. E. (2015). Social media: A contextual framework to guide research and practice. Journal of Applied Psychology, 100, 1653–1677. https://doi.org/10.1037/a0039244
74.
MeadeA. W.CraigS. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17, 437–455. https://doi.org/10.1037/a0028085
75.
MelãoN.ReisJ. (2021). Social networks in personnel selection: profile features analyzed and issues faced by hiring professionals. Proceedings Computer Science, 181, 42–50. https://doi.org/10.1016/j.procs.2021.01.097
76.
MonkeF.RoulinN.LievensF.BartossekM.SchäpersP. (2024). Validity of social media assessments in personnel selection. European Journal of Psychological Assessment, 40, 445–460. https://doi.org/10.1027/1015-5759/a000835
77.
MönkeF. W.SchäpersF. (2022). Too early to call: What we do (not) know about the validity of cybervetting. Industrial and Organizational Psychology, 15, 334–341. https://doi.org/10.1017/iop.2022.51
Phillips-WrenG.DoranR.MerrillK. (2016). Creating a value proposition with a social media strategy for talent acquisition. Journal of Decision Systems, 25, 450–462. https://doi.org/10.1080/12460125.2016.1187398
80.
PikeJ. C.BatemanP. J.ButlerB. (2013). Dialectic tensions of information quality: Social networking sites and hiring. Journal of Computer-Mediated Communication, 19, 56–77. https://doi.org/10.1111/jcc4.12031
81.
PolitesG. L.KarahannaE. (2012). Shackled to the status quo: The inhibiting effects of incumbent system habit, switching costs, and inertia on new system acceptance. MIS Quarterly, 36, 21–42. https://doi.org/10.2307/41410404
*RisavyS. D.FisherP. A.RobieC.KönigC. J. (2019). Selection tool use: A focus on personality testing in Canada, the United States, and Germany. Personnel Assessment and Decisions, 5, 62–72. https://doi.org/10.25035/pad.2019.01.004
85.
RootT.McKayS. (2014). Student awareness of the use of social media screening by prospective employers. Journal of Education for Business, 89, 202–206. https://doi.org/10.1080/08832323.2013.848832
86.
RothP. L.BobkoP.Van IddekingeC. H.ThatcherJ. B. (2016). Social media in employee-selection-related decisions: A research agenda for uncharted territory. Journal of Management, 42, 269–298. https://doi.org/10.1177/0149206313503018
87.
RothP. L.ThatcherJ. B.BobkoP.MatthewsK. D.EllingsonJ. E.GoldbergC. B. (2020). Political affiliation and employment screening decisions: The role of similarity and identification processes. Journal of Applied Psychology, 105, 472–486. https://doi.org/10.1037/apl0000422
88.
RoulinN.LevashinaJ. (2019). LinkedIn as a new selection method: Psychometric properties and assessment approach. Personnel Psychology, 72, 185–211. https://doi.org/10.1111/peps.12296
SackettP. R.EllingsonJ. E. (1997). The effects of forming multi-predictor composites on group differences and adverse impact. Personnel Psychology, 50, 707–721. https://doi.org/10.1111/j.1744-6570.1997.tb00711.x
91.
*SameenS.CorneliusS. (2015). Social networking sites and hiring: How social media profiles influence hiring decisions. Journal of Business Studies Quarterly, 7, 27–35.
92.
SchmidtF. L.HunterJ. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262–274. https://doi.org/10.1037/0033-2909.124.2.262
93.
SchmidtF. L.HunterJ. E. (2015). Methods of meta-analysis: Correcting error and bias in research findings (3rd ed.). Sage Publications.
94.
SchmittN.ChanD. (1998). Personnel selection: A theoretical approach. Sage.
95.
Shahani-DenningC.PatelV.ZideJ. (2017). Recruiter and applicant use of LinkedIn: A spotlight on India. The Psychologist-Manager Journal, 20, 90–105. https://doi.org/10.1037/mgr0000052
96.
ShawJ. D.ErtugG. (2017). The suitability of simulations and meta-analyses for submissions to Academy of Management Journal. Academy of Management Journal, 60, 2045–2049. https://doi.org/10.5465/amj.2017.4006
97.
SIOP Principles for the Validation and Use of Personnel Selection Procedures. (2018). Society for Industrial and Organizational Psychology, Bowling Green, OH. https://doi.org/10.1017/iop.2018.195
StamperC. (2010). Common mistakes companies make using social media tools in recruiting efforts. CMA Management, 84, 12–14.
102.
StoughtonJ. W.ThompsonL. F.MeadeA. W. (2015). Examining applicant reactions to the use of social networking websites in pre-employment screening. Journal of Business and Psychology, 30, 73–88. https://doi.org/10.1007/s10869-013-9333-6
103.
Uniform Guidelines from U.S. (1978). Equal Employment Opportunity Commission, U.S. Civil Service Commission, U.S. Department of Labor, & U.S. Department of Justice. Uniform Guidelines on Employee Selection Procedures. Federal Register, 43, 38295–38309.
104.
van der ZeeK. I.BakkerA. B.BakkerP. (2002). Why are structured interviews so rarely used in personnel selection?Journal of Applied Psychology, 87, 176–184. https://doi.org/10.1037/0021-9010.87.1.176
105.
*Van IddekingeC. H.LanivichS. E.RothP. L.JuncoE. (2016). Social media for selection? Validity and adverse impact potential of a Facebook-based assessment. Journal of Management, 42, 1811–1835. https://doi.org/10.1177/0149206313515524
106.
VenkateshV. (2000). Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model. Information Systems Research, 11, 342–365. https://doi.org/10.1287/isre.11.4.342.11872
VenkateshV.DavisF. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46, 186–204. https://doi.org/10.1287/mnsc.46.2.186.11926
109.
VenkateshV.MorrisM. G.DavisG. B.DavisF. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27, 425–478. https://doi.org/10.1287/mnsc.46.2.186.11926
110.
VenkateshV.ThongJ. Y. L.XuX. (2012). Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Quarterly, 36, 157–178. https://doi.org/10.2307/41410412
111.
ViechtbauerW. (2010). Conducting meta-analyses in R with the metaphor package. Journal of Statistical Software, 36, 1–48. https://doi.org/10.18637/jss.v036.i03
112.
ViechtbauerW.CheungM. W. L. (2010). Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods, 1, 112–125. https://doi.org/10.1002/jrsm.11
113.
VosenE. (2021). Social media screening and procedural justice: Towards fairer use of social media in selection. Employee Responsibilities and Rights Journal, 33, 281–309. https://doi.org/10.1007/s10672-021-09372-4
114.
WadeJ. T.RothP. L.ThatcherJ. B.DingerM. (2020). Social media and selection: Political issue similarity, liking, and the moderating effect of social media platform. MIS Quarterly, 44, 1301–1357. https://doi.org/10.25300/MISQ/2020/14119
115.
WilcoxA.DamarinA. K.McDonaldS. (2022). Is cybervetting valuable?Industrial and Organizational Psychology, 15, 315–333. https://doi.org/10.1017/iop.2022.28
WoodJ. (2008). Methodology for dealing with duplicate study effects in a meta-analysis. Organizational Research Methods, 11, 79–95. https://doi.org/10.1177/1094428106296638
118.
ZhangL.Van IddekingeC. H.ArnoldJ. D.RothP. L.LievensF.LanivichS. E.JordanS. L. (2020). What’s on job seekers’ social media sites? A content analysis and effects of structure on recruiter judgments and predictive validity. Journal of Applied Psychology, 105, 1530–1546. https://doi.org/10.1037/apl0000490.supp
119.
ZickarM. J. (2018). Using social media for assessment. In ScottJ. C.BartramD.ReynoldsD. H. (Eds.), Next generation technology-enhanced assessment: Global perspectives on occupational and workplace testing (pp. 217–238). Cambridge University Press.
120.
ZideJ. B.Shahani-DenningC. (2014). LinkedIn and recruitment: how profiles differ across occupations. Employee Relations, 36, 583–604. https://doi.org/10.1108/ER-07-2013-0086
