The affective nature of emojis makes them suited for anchoring scales to measure the affective preferences of vocational interest. In Study 1, we conducted a content analysis to identify the five images that best represent a bipolar continuum from strongly like to strongly dislike. In Study 2, we compared the psychometric properties of traditional lexical anchors to those of the emoji anchors identified in Study 1 and tested the predictive validity of emoji-anchored scales. Results show emoji-anchored scales possess similar psychometric properties as lexical-anchored scales. Importantly, the interest-fit using contextualized emoji scales predicts job satisfaction better compared to lexical scales (remoji (226) = .41 versus rlexical (226) = .13). Overall, this article (1) provides researchers with a validated public-domain emoji anchors, (2) demonstrates that emoji anchors possess the same the robust psychometric properties as lexical anchors, and (3) illustrates how emoji-anchored scales can be potentially better for measuring vocational interests.
AndersonJ. C.GerbingD. W. (1991). Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. Journal of Applied Psychology, 76, 732–740. doi:10.1037/0021-9010.76.5.732
2.
ArmstrongP. I.HubertL.RoundsJ. (2003). Circular unidimensional scaling: A new look at group differences in interest structure. Journal of Counseling Psychology, 50, 297–308. doi:10.1037/0022-0167.50.3.297
3.
AronsonZ. H.ReillyR. R. (2006). Personality validity: The role of schemas and motivated reasoning. International Journal of Selection and Assessment, 14, 372–380. doi:10.1111/j.1468-2389.2006.00358.x
4.
AssoulineM.MeirE. I. (1987). Meta-analysis of the relationship between congruence and well-being measures. Journal of Vocational Behavior, 31, 319–332. doi:10.1016/0001-8791(87)90046-7
5.
BehrendT. S.SharekD. J.MeadeA. W.WiebeE. N. (2011). The viability of crowdsourcing for survey research. Behavior Research Methods, 43, 800–813. doi:10.3758/s13428-011-0081-0
6.
BingM. N.WhangerJ. C.DavisonH. K.VanHookJ. B. (2004). Incremental validity of the frame-of-reference effect in personality scale scores: A replication and extension. Journal of Applied Psychology, 89, 150–157. doi:10.1037/0021-9010.89.1.150
7.
BrecklerS. J.WigginsE. C. (1989). Affect versus evaluation in the structure of attitudes. Journal of Experimental Social Psychology, 25, 253–271. doi:10.1016/0022-1031(89)90022-X
8.
BrownS. D.PaulA. G.Jr. (1994). An evaluation of interest congruence indices: Distribution characteristics and measurement properties. Journal of Vocational Behavior, 45, 310–327. doi:10.1006/jvbe.1994.1038
9.
CritesS. L.FabrigarL. R.PettyR. E. (1994). Measuring the affective and cognitive properties of attitudes: Conceptual and methodological issues. Personality and Social Psychology Bulletin, 20, 619–634. doi:10.1177/0146167294206001
10.
DawisR. V. (2001). Vocational interests, values, and preferences. In BaltesN. J. S. B. (Ed.), International encyclopedia of the social and behavioral sciences (pp. 16299–16302). Oxford, England: Pergamon Press. Retrieved fromhttp://www.sciencedirect.com/science/article/pii/B0080430767013954
11.
DerksD.BosA. E. R.von GrumbkowJ. (2008). Emoticons and online message interpretation. Social Science Computer Review, 26, 379–388. doi:10.1177/0894439307311611
Feldman BarrettL.RussellJ. A. (1998). Independence and bipolarity in the structure of current affect. Journal of Personality and Social Psychology, 74, 967–984. doi:10.1037/0022-3514.74.4.967
16.
FisherC. D. (2000). Mood and emotions while working: Missing pieces of job satisfaction?Journal of Organizational Behavior, 21, 185–202. doi:10.1002/(SICI)1099-1379(200003)21:2<185::AID-JOB34>3.0.CO;2-M
17.
FrijdaN. H. (1993). The place of appraisal in emotion. Cognition and Emotion, 7, 357–387. doi:10.1080/02699939308409193
18.
FryerD. (1930). The objective and subjective measurement of interests—an acceptance-rejection theory. Journal of Applied Psychology, 14, 549–556. doi:10.1037/h0073774
19.
FryerD. (1931). The measurement of interests in relation to human adjustment. Oxford, England: Holt.
20.
GibbsM.MeeseJ.ArnoldM.NansenB.CarterM. (2015). #Funeral and instagram: death, social media, and platform vernacular. Information, Communication & Society, 18, 255–268. doi:10.1080/1369118X.2014.987152
21.
HollandJ. L. (1997). Making vocational choices: A theory of vocational personalities and work environments (3rd ed., Vol. xiv). Odessa, FL: Psychological Assessment Resources.
22.
HubertL.ArabieP.MeulmanJ. (1997). Linear and circular unidimensional scaling for symmetric proximity matrices. British Journal of Mathematical and Statistical Psychology, 50, 253–284. doi:10.1111/j.2044-8317.1997.tb01145.x
23.
HunthausenJ. M.TruxilloD. M.BauerT. N.HammerL. B. (2003). A field study of frame-of-reference effects on personality test validity. Journal of Applied Psychology, 88, 545–551. doi:10.1037/0021-9010.88.3.545
24.
IachanR. (1990). Some extensions of the Iachan congruence index. Journal of Vocational Behavior, 36, 176–180. doi:10.1016/0001-8791(90)90025-W
25.
JudgeT. A.HulinC. L.DalalR. S. (2012). Job satisfaction and job affect. In KozlowskiS. W. J. (Ed.), The Oxford handbook of organizational psychology (Vol. 1, pp. 496–525, Chap. xviii, 1427 Pages). New York, NY: Oxford University Press.
26.
KaplanS. A.WarrenC. R.BarskyA. P.ThoresenC. J. (2009). A note on the relationship between affect(ivity) and differing conceptualizations of job satisfaction: Some unexpected meta-analytic findings. European Journal of Work and Organizational Psychology, 18, 29–54. doi:10.1080/13594320701873264
27.
KroustalisC.LewisP.RivkinD. (2010). Linking client assessment profiles to O*NET occupational profiles within the O*NET interest profiler short form. Raleigh, NC: National Center for O*NET Development. Retrieved fromhttp://www.onetcenter.org/reports/IPSF_Linking.html
28.
KuninT. (1998). The construction of a new type of attitude measure. Personnel Psychology, 51, 823–824. doi:10.1111/j.1744-6570.1998.tb00739.x
29.
LandersR. N.BehrendT. S. (2015). An inconvenient truth: Arbitrary distinctions between organizational, Mechanical Turk, and other convenience samples. Industrial and Organizational Psychology: Perspectives on Science and Practice, 8(2), 142–164. doi: 10.1017/iop.2015.13.
30.
LewisP.RivkinD. (1999). Development of the O*NET interest profiler. Raleigh, NC: National Center for O*NET Development.
31.
LiaoH.-Y.ArmstrongP. I.RoundsJ. (2008). Development and initial validation of public domain basic interest markers. Journal of Vocational Behavior, 73, 159–183. doi:10.1016/j.jvb.2007.12.002
32.
LievensF.De CorteW.SchollaertE. (2008). A closer look at the frame-of-reference effect in personality scale scores and validity. Journal of Applied Psychology, 93, 268–279. doi:10.1037/0021-9010.93.2.268
33.
LievensF.SackettP. R. (2017). The effects of predictor method factors on selection outcomes: A modular approach to personnel selection procedures. Journal of Applied Psychology, 102, 43–66. doi:10.1037/apl0000160
34.
LockeE. A. (1969). What is job satisfaction?Organizational Behavior and Human Performance, 4, 309–336. doi:10.1016/0030-5073(69)90013-0
35.
MarkusH. R.KitayamaS. (1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review, 98, 224–253. doi:10.1037/0033-295X.98.2.224
36.
McCloyR.CampbellJ.OswaldF. L.LewisP.RivkinD. (1999). Linking client assessment profiles to O*NET occupational profiles. Raleigh, NC: National Center for O*NET Development. Retrieved fromhttp://www.onetcenter.org/dl_files/LinkingProfiles.pdf
37.
MeyerJ. P.StanleyD. J.HerscovitchL.TopolnytskyL. (2002). Affective, continuance, and normative commitment to the organization: A meta-analysis of antecedents, correlates, and consequences. Journal of Vocational Behavior, 61, 20–52. doi:10.1006/jvbe.2001.1842
38.
National Center for O*NET Development. (n.d.). O*NET OnLine. Retrieved March 8, 2016, fromhttp://www.onetonline.org/
39.
NiklasC. D.DormannC. (2005). The impact of state affect on job satisfaction. European Journal of Work and Organizational Psychology, 14, 367–388. doi:10.1080/13594320500348880
OppenheimerD. M.MeyvisT.DavidenkoN. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45, 867–872. doi:10.1016/j.jesp.2009.03.009
43.
ParkJ.BaekY. M.ChaM. (2014). Cross-cultural comparison of nonverbal cues in emoticons on Twitter: Evidence from big data analysis. Journal of Communication, 64, 333–354. doi:10.1111/jcom.12086
44.
PodsakoffP. M.MacKenzieS. B.LeeJ.-Y.PodsakoffN. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903. doi:10.1037/0021-9010.88.5.879
45.
PrestonC. C.ColmanA. M. (2000). Optimal number of response categories in rating scales: Reliability, validity, discriminating power, and respondent preferences. Acta Psychologica, 104, 1–15. doi:10.1016/S0001-6918(99)00050-5
46.
RoundsJ.ArmstrongP. I.LiaoH.-Y.LewisP.RivkinD. (2008). Second generation occupational interest profiles for the O*NET system: Summary. Raleigh, NC: The National Center for O*NET Development.
47.
RoundsJ.DawisR. V.LofquistL. H. (1987). Measurement of person-environment fit and prediction of satisfaction in the theory of work adjustment. Journal of Vocational Behavior, 31, 297–318. doi:10.1016/0001-8791(87)90045-5
48.
RoundsJ.SuR. (2014). The nature and power of interests. Current Directions in Psychological Science, p. 83, 23, 98–103. doi:10.1177/0963721414522812
49.
RoundsJ.SuR.LewisP.RivkinD. (2010). O*NET® interest profiler short form psychometric characteristics: Summary. Raleigh, NC: National Center for O*NET Development.
50.
RoundsJ.TraceyT. J.HubertL. (1992). Methods for evaluating vocational interest structural hypotheses. Journal of Vocational Behavior, 40, 239–259. doi:10.1016/0001-8791(92)90073-9
51.
RussellJ. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161–1178. doi:10.1037/h0077714
52.
RussellS. S.SpitzmüllerC.LinL. F.StantonJ. M.SmithP. C.IronsonG. H. (2004). Shorter can also be better: The abridged job in general scale. Educational and Psychological Measurement, 64, 878–893. doi:10.1177/0013164404264841
53.
SackettP. R.LievensF.Van IddekingeC. H.KuncelN. R. (2017). Individual differences and their measurement: A review of 100 years of research. Journal of Applied Psychology. doi:10.1037/apl0000151
54.
SavickasM. L.TaberB. J.SpokaneA. R. (2002). Convergent and discriminant validity of five interest inventories. Journal of Vocational Behavior, 61, 139–184. doi:10.1006/jvbe.2002.1878
55.
SchmitM. J.RyanA. M.StierwaltS. L.PowellA. B. (1995). Frame-of-reference effects on personality scale scores and criterion-related validity. Journal of Applied Psychology, 80, 607–620. doi:10.1037/0021-9010.80.5.607
56.
SchutzH. G.RuckerM. H. (1975). A comparison of variable configurations across scale lengths: An empirical study. Educational and Psychological Measurement, 35, 319–324. doi:10.1177/001316447503500210
57.
ShafferJ. A.PostlethwaiteB. E. (2012). A matter of context: A meta-analytic investigation of the relative validity of contextualized and noncontextualized personality measures. Personnel Psychology, 65, 445–494. doi:10.1111/j.1744-6570.2012.01250.x
58.
StaatsA. W.GrossM. C.GuayP. F.CarlsonC. G. (1973). Personality and social systems and attitude-reinforcer-discriminative theory: Interest (attitude) formation, function, and measurement. Journal of Personality and Social Psychology, 26, 251–261. doi:10.1037/h0034399
59.
StrongE. K. (1943). Vocational interests of men and women. Stanford, CA: Stanford University Press.
60.
TauchC.KanjoE. (2016). The roles of emojis in mobile phone notifications. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, Heidelberg, Germany, September 12–16 (pp. 1560–1565). New York, NY: ACM.
61.
ThoresenC. J.KaplanS. A.BarskyA. P.WarrenC. R.de ChermontK. (2003). The affective underpinnings of job perceptions and attitudes: A meta-analytic review and integration. Psychological Bulletin, 129, 914–945. doi: 10.1037/0033-2909.129.6.914
62.
TourangeauR.RipsL. J.RasinskiK. (2000). The psychology of survey response. Cambridge, MA: Cambridge University Press.
63.
TranbergM.SlaneS.EkebergS. E. (1993). The relation between interest congruence and satisfaction: A meta analysis. Journal of Vocational Behavior, 42, 253–264. doi:10.1006/jvbe.1993.1018
64.
TsabariO.TzinerA.MeirE. I. (2005). Updated meta-analysis on the relationship between congruence and satisfaction. Journal of Career Assessment, 13, 216–232. doi:10.1177/1069072704273165
65.
WeissH. M. (2002). Deconstructing job satisfaction: Separating evaluations, beliefs and affective experiences. Human Resource Management Review, 12, 173–194. doi:10.1016/S1053-4822(02)00045-1
