The Soft Skills Inventory: Developmental procedures and psychometric analysis

Abstract

When attending and participating in Higher Education, students face a multitude of personal, social, and work-related challenges, which may increase the risk of developing psychopathological symptomatology. To date, there is no instrument that grasps the non-technical skills that may help prepare students to respond to these challenges. This paper presents the development and psychometric properties of the Soft Skills Inventory (SSI). The inventory was developed based on theoretical and empirical findings on the skills associated with academic and professional success, and on students’ perception. The SSI was tested with 2030 Portuguese students (of which 77.1% were female) using a two-stage approach: item calibration and model generation (n = 1033), followed by model validation (n = 997). Item calibration analyses led to retaining 49 items that were organized into six-factors: self-determination, resilience, empathy, assertiveness, social support, and teamwork. This measurement model was further validated and proved to be an invariant, and thus credible, tool to compare male and female students on those relevant skills. All measures attained good internal consistency, with alphas ranging from .76 to .88. Female students scored significantly higher than males on self-determination, empathy, social support and teamwork. On the other hand, male students scored significantly higher on resilience. No significant differences were found between men and women for assertiveness. Psychometric analysis showed that the SSI is a reliable and valid instrument to evaluate students intra and interpersonal skills. The SSI may help identify gaps in soft skills and guide targeted interventions to support a more positive student experience in Higher Education.

Keywords

Soft skills higher education young adults psychometrics

Get full access to this article

View all access options for this article.

References

Alberti

Emmons

(2008). Your perfect right – Assertiveness and equality in your life and relationships guide to assertive living (9th ed.). Impact Publishers.

Alpay

Walsh

(2008). A skills perception inventory for evaluating postgraduate transferable skills development. Assessment & Evaluation in Higher Education, 33(6), 581–598. https://doi.org/10.1080/02602930701772804

Antonova

N. V.

Ivanova

N. L.

(2016). Gender differences in identity features and self-determination process. IAFOR Journal of Psychology & the Behavioral Sciences, 2(2). https://doi.org/10.22492/ijpbs.2.2.04

Arrindell

W.A.

Sanderman

Vandermolen

Vanderende

Mersch

P.P.

(1988). The structure of assertiveness: A confirmatory approach. Behaviour Research and Therapy, 23(4), 337–339. https://doi.org/10.1016/0005-7967(88)90087-3

Arrindell

W.A.

Bridges

K.R.

van der Ende

St. Lawrence

J.S.

Gray-Shellberg

Harnish

Rogers

Sanderman

(2001). Normative studies with the Scale for Interpersonal (SIB): II. US students: A cross-cutural comparison with Dutch data. Behaviour Research and Therapy, 39(12), 1461–1479. https://doi.org/10.1016/S0005-7967(01)00009-2

Bennett

Dunne

Carré

(1999). Patterns of core and generic skill provision in higher education. Higher Education, 37(1), 71–93.

Boren

Ramey

(2000). Thinking aloud: Reconciling theory and practice. IEEE Transactions on Professional Communication, 43(3), 261–278. https://doi.org/10.1109/47.867942

Braun

Rosseel

Kempenaers

Loas

Linkowski

(2015). Self-report of empathy: A shortened French adaptation of the Interpersonal Reactivity Index (IRI) using two large Belgian samples. Psychological Reports, 117(3), 735–753. https://doi.org/10.2466%2F08.02.PR0.117c23z6

Bridges

Sanderman

Breukers

Ranchor

Arrindell

W.A.

(1991). Sex differences in assertiveness on the U.S. version of the Scalar for Interpersonal Behavior (SIB). Personality and Individual Differences, 12(12), 1239–1243. https://doi.org/10.1016/0191-8869(91)90195-H

10.

Chamorro-Premuzic

Arteche

Bremmer

A.J.

Greven

Furnham

(2010). Soft skills in higher education: Importance and improvement ratings as a function of individual differences and academic performance. Educational Psychology, 30(2), 221–241. https://doi.org/10.1080/01443410903560278

11.

Chen

F. F.

(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

12.

Comoglio

Cardoso

M.A.

(1996). Insegnare e apprendere in gruppo. Il Cooperative Learning [Teaching and learning in groups: Cooperative learning]. LAS. https://www.editricelas.it/prodotto/insegnare-e-apprendere-in-gruppo-il-cooperative-learning/

13.

Day

A. L.

Livingstone

H. A.

(2003). Gender differences in perceptions of stressors and utilization of social support among university students. Canadian Journal of Behavioral Science, 35(2), 72–83. https://doi.org/10.1037/h0087190

14.

De Juan-Vigaray

M. D.

González-Gascón

López-García

J.J.

VallésAmores

M. L.

Martínez-Mora

Carmona-Martínez

Peris-Ferrando

J. E.

Subiza-Martínez

Hernández-Ricarte

Cuevas-Casaña

(2012). The acquisition of transferable skills by university students. A gender approach. Proceedings of EDULEARN12 Conference (pp. 191–198). https://library.iated.org/view/DEJUANVIGARAY2012ACQ

15.

Devedzic

Tomic

Jovanovic

Kelly

Milikic

Dimitrijevic

Djuric

Sevarac

(2018). Metrics for students’ soft skills. Applied Measurement in Education, 31(4), 283–296. https://doi.org/10.1080/08957347.2018.1495212

16.

Direito

Pereira

Duarte

(2014). The development of skills in the ICT sector: Analysis of engineering students’ perceptions about transversal skills. International Journal of Engineering Education, 30(6), 1556–1561

17.

Direito

Tilley

Mitchell

J. E.

(2018). Gender differences in first-year students’ expectations towards a new engineering multidisciplinary curriculum. CISPEE 2018 – 3rd International Conference of the Portuguese Society for Engineering Education (pp. 1–5). Aveiro: SPEE. https://ieeexplore.ieee.org/document/8593409

18.

Dimitrov

D. M.

(2006). Comparing groups on latent variables: A structural equation modeling approach. Work, 26(4), 429–436.

19.

Dimitrov

D. M.

(2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2), 121–149. https://doi.org/10.1177%2F0748175610373459

20.

Edwards

M. C.

(2009). An introduction to item response theory using the need for cognition scale. Social and Personality Psychology Compass, 3(4), 507–529. https://doi.org/10.1111/j.1751-9004.2009.00194.x

21.

European Commission. (2017). ESCO handbook. European skills, competences, qualifications and occupations (1st ed.). European Union. https://doi.org/10.2767/934956

22.

Fabrigar

L. R.

Wegener

D. T.

MacCallum

R. C.

Strahan

E. J.

(1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.apa.org/doi/10.1037/1082-989X.4.3.272

23.

Fallows

Steven

(2000). Integrating key skills in higher education: Employability, transferable skills and learning for life. Kogan Page.

24.

Ferketich

(1991). Focus on psychometrics. Aspects of item analysis. Research in Nursing & Health, 14(2), 165–168. https://doi.org/10.1002/nur.4770140211

25.

Gagné

Deci

(2005). Self-determination theory and work motivation. Journal of Organizational Behavior, 26(4), 331–362. https://doi.org/10.1002/job.322

26.

Ginns

Barrie

(2009). Developing and testing a student-focussed teaching evaluation survey for university instructors. Psychological Reports, 104(3), 1019–1032. https://doi-org.libproxy.ucl.ac.uk/10.2466%2FPR0.104.3.1019-1032

27.

Glorfeld

L.W.

(1995). An improvement on Horn’s parallel analysis methodology for selecting the correct number of factors to retain. Educational and Psychological Measurement, 55(3), 377–393. https://doi.org/10.1177%2F0013164495055003002

28.

Bentler

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

29.

Hansen

M. T.

Ibarra

Peyer

(2010). The best-performing CEOs in the world. Harvard Business Review. https://hbr.org/2010/01/the-best-performing-ceos-in-the-world/ar/1

30.

Heckman

J. J.

Kautz

(2012). Hard evidence on soft skills. Labour Economics 19(4), 451–464. https://doi.org/10.1016/j.labeco.2012.05.014

31.

Jardim

Pereira

(2006). Competências pessoais e sociais: Guia prático para a mudança positiva [Personal and social skills: Practical guide for positive change]. ASA.

32.

Javidan

Bullough

Dibble

(2016). Mind the gap: Gender differences in global leaderships self-efficacies. Academy of Management Perspectives, 30(1), 59–73. https://doi.org/10.5465/amp.2015.0035

33.

Kline

R. B.

(2011). Principles and practice of structural equation modeling (3rd ed.). The Guilford Press.

34.

Korkmaz

Goksuluk ., D. Zararsiz

(2014). MVN: An R package for assessing multivariate normality. The R Journal, 6(2), 151–162.

35.

Lehmann

Denissen

J. J. A.

Alleman

Penke

(2013). Age and gender differences in motivational manifestations of the Big Five from age 16 to 60. Developmental Psychology, 49(3), 365–383. https://doi.org/10.1037/a0028277

36.

Levenson

R. W.

Ruef

A. M.

(1992). Empathy: A physiological substrate. Journal of Personality and Social Psychology, 63(2), 234–246. http://dx.doi.org/10.1037/0022-3514.63. 2.234

37.

León

Finkelsten

Castien

(2011). Gender differences in prosocial behavior: Organizational citizenship behavior. Anales De Psicología / Annals of Psychology, 27(2), 498–502.

38.

C. H.

(2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949. https://doi.org/10.3758/s13428-015-0619-7

39.

Matud

M. P.

(2004). Gender differences in stress and coping styles. Personality and Individual Differences, 37(7), 1401–1415. https://doi.org/10.1016/j.paid.2004.01.010

40.

Muthén

L. K.

, & Muthén

B. O.

(1998–2015). Mplus user’s guide (7th Ed.). Muthén & Muthén.

41.

Nabi

G. R.

Bagley

(1998). Graduates’ perceptions of transferable personal skills and future career preparation in the UK. Career Development International, 3(1), 31–39. https://doi.org/10.1108/13620439810368619

42.

Pereira

A. M. S.

(2005). Para obter sucesso na vida académica: Apoio dos estudantes pares [To achieve success in the academic life: The support of peer students]. Universidade de Aveiro.

43.

Perreault

(2004). Business educators can take a leadership role in character education. Business Education Forum, 59(1), 23–24.

44.

Porter

S.R.

Whitcomb

M.E.

(2005). Non-response in student surveys: The role of demographics, engagement and personality. Research in Higher Education, 46, 127–152. https://doi.org/10.1007/s11162-004-1597-2

45.

Robles

M. M.

(2012). Executive perceptions of the top 10 soft skills needed in today’s workplace. Business and Professional Communication Quartely, 75(4), 453–465.

46.

Rutter

(1993). Resilience: Some conceptual considerations. Journal of Adolescent Health, 21(8), 119–144.

47.

Toland

(2014). Practical guide to conducting an item response theory analysis. Journal of Early Adolescence, 34(1), 120–151.

48.

UNESCO. (2012). Youth and skills: Putting education to work, EFA global monitoring report. UNESCO. http://unesdoc.unesco.org/images/0021/002180/218003e.pdf

49.

Vagos

Pereira

Arrindell

(2014). Validação da versão reduzida da Escala de Comportamento Interpessoal para adolescentes portugueses [Validation of the short version of the scale for interpersonal behavior for Portuguese adolescents]. Psicologia: Reflexão e Critica, 27(3), 452–461. https://doi.org/10.1590/1678-7153.201427305

50.

van de Schoot

Lugtig

Hox

(2012): A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740

51.

Washer

(2007) Revisiting key skills: A practical framework for higher education. Quality in Higher Education, 13(1), 57–67. https://doi-org.libproxy.ucl.ac.uk/10.1080/13538320701272755

52.

Whittle

S. R.

Eaton

D. G.

(2001). Attitudes towards transferable skills in medical undergraduates. Medical Education, 35(2), 148–153. https://doi.org/10.1111/j.1365-2923.2001.00773.x

53.

Woolley

A. W.

Chabris

C. F.

Pentland

Hashmi

Malone

T.W.

(2010). Evidence for a collective intelligence factor in the performance of human groups. Science, 330(6004), 686–688. https://doi.org/10.1126/science.1193147

54.

Wuying

Jiamei

Lianqi

Wenyi

(2014). Gender differences in empathy. Advances in Psychological Science, 22(9), 1423–1434. https://doi.org/10.3724/SP.J.1042.2014.01423