Borrowing from a clinical psychology observational methodology, thin-slice observations were used to assess autism characteristics in toddlers. Thin-slices are short observations taken from a longer behavior stream which are assigned ratings by multiple raters using a 5-point scale. The raters’ observations are averaged together to assign a “thin-slice” value for each observation. In this study, a total of 60 toddlers were selected from a video archive: 20 children with typical development, 20 children with developmental language disorder, and 20 children with autism. In the first part of this study, 20 raters observed small play segments between toddlers and an assessor. Raters assigned scores to each of the 60 toddlers on items related to autism symptomatology. Item analysis and generalizability and decision studies were conducted to determine the factor structure and optimal number of raters to achieve a stable estimate of autism characteristics. In the second part of the study, generalizability and decision studies were conducted to determine the most efficient and optimal combination of raters and naturalistic contexts. This pilot study provides recommendations for optimizing the utility of thin-slice observations for measuring autism symptomatology in young children.
ADEP (2017) Autism diagnosis education project. Ohio Center for Autism and Low Incidence. Available at: http://www.ocali.org/project/adep (accessed 14 November 2017).
2.
AmbadyNGrayHM (2002) On being sad and mistaken: mood effects on the accuracy of thin-slice judgments. Journal of Personality and Social Psychology83(4):947–961.
3.
AmbadyNRosenthalR (1992) Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychological Bulletin111: 256–274.
4.
ArchinardMHaynal-ReymondVHellerM (2000) Doctor’s and patients’ facial expressions and suicide reattempt risk assessment. Journal of Psychiatric Research34(3):261–262.
5.
ArunyanartWFenickAUkritchonSet al. (2012). Developmental and autism screening: A survey across six states. Infants & Young Children25(3): 175–187.
6.
BakemanRMcArthurDQueraVet al. (1997) Detecting sequential patterns and determining their reliability with fallible observers. Psychological Methods2(4): 357–370.
7.
BayleyN (2006) Bayley Scales of Infant and Toddler Development. London: Pearson.
8.
BisgaierJLevinsonDCuttsDBet al. (2011) Access to autism evaluation appointments with developmental-behavioral and neurodevelopmental subspecialists. Archives of Pediatrics & Adolescent Medicine165(7): 673–674.
9.
BishopDVMNorburyCF (2002) Exploring the borderlands of autistic disorder and specific language impairment: a study using standardised diagnostic instruments. Journal of Child Psychology and Psychiatry43(7): 917–929.
10.
BoltonPFGoldingJEmondAet al. (2012) Autism spectrum disorder and autistic traits in the Avon Longitudinal Study of Parents and Children: precursors and early signs. Journal of the American Academy of Child and Adolescent Psychiatry51(3): 249–260.
11.
BonannoGAKeltnerD (1997) Facial expressions of emotion and the course of conjugal bereavement. Journal of Abnormal Psychology106(1): 126–137.
12.
BrettDWarnellFMcConachieHet al. (2016) Factors affecting age at ASD diagnosis in UK: no evidence that diagnosis age has decreased between 2004 and 2014. Journal of Autism and Developmental Disorders46(6): 1974–1984.
13.
CarneyDRColvinCRHallJA (2007) A thin slice perspective on the accuracy of first impressions. Journal of Research in Personality41(5): 1054–1072.
14.
CoxAKleinKCharmanTet al. (1999) Autism spectrum disorders at 20 and 42 months of age: stability of clinical and ADI-R diagnosis. Journal of Child Psychology and Psychiatry and Allied Disciplines40(5): 719–732.
15.
CraneLChesterJWGoddardLet al. (2016) Experiences of autism diagnosis: a survey of over 1000 parents in the United Kingdom. Autism20(2): 153–162.
16.
CronbachLJGleserGCNandaHet al. (1972) The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. New York: John Wiley & Sons.
17.
DavidMMBabineauBAWallDP (2016) Can we accelerate autism discoveries through crowdsourcing?Research in Autism Spectrum Disorders32(Suppl. C): 80–83.
18.
DinnoA (2012) paran: Horn’s test of principal components/factors. R package version 1.5.1.
19.
EduG (2012) EduG (version 6.1-e, generalizability study) [Société Suisse pour la Recherche en Éducation, Groupe de travail Edumétrie—Qualité de l’évaluation en éducation]. Longueuil, QC, Canada: Software Prepared by Maurice Dalois and Léo Laroche.
20.
FusaroMVallottonCDHarrisPL (2014) Beside the point: mothers’ head nodding and shaking gestures during parent-child play. Infant Behavior & Development37(2): 235–247.
21.
Gordon-LipkinEFosterJPeacockG (2016) Whittling down the wait time: exploring models to minimize the delay from initial concern to diagnosis and treatment of autism spectrum disorder. Pediatric Clinics of North America63(5): 851–859.
22.
GottmanJMLevensonRW (1992) Marital processes predictive of later dissolution: behavior, physiology, and health. Journal of Personality and Social Psychology63(2): 221–233.
23.
HatfieldECacioppoJTRapsonRL (1994) Emotional Contagion: Cambridge Studies in Emotion and Social Interaction. Cambridge: Cambridge University Press.
24.
HellerMHaynalV (1997) Depression and suicide faces. In: EkmanPRosenbergEL (eds) What the Face Reveals. Oxford: Oxford University Press, pp.398–407.
25.
HertensteinMJHanselCAButtsAMet al. (2009) Smile intensity in photographs predicts divorce later in life. Motivation and Emotion33(2): 99–105.
26.
HornJL (1965) A rationale and test for the number of factors in factor analysis. Psychometrika30(2): 179–185.
27.
IllingworthDAThomasRPRozgaAet al. (2017) Cue use in distal autism spectrum assessment: a lens model analysis of the efficacy of telehealth technologies. Proceedings of the Human Factors and Ergonomics Society Annual Meeting61(1): 170.
28.
KleimanSRuleNO (2013) Detecting suicidality from facial appearance. Social Psychological and Personality Science4(4): 453–460.
29.
KleinmanJMVentolaPEPandeyJet al. (2008) Diagnostic stability in very young children with autism spectrum disorders. Journal of Autism and Developmental Disorders38(4): 606–615.
30.
KnutsenJWolfeABurkeBLet al. (2016) A systematic review of telemedicine in autism spectrum disorders. Review Journal of Autism and Developmental Disorders3(4): 330–344.
31.
KozlowskiAMMatsonJLHorovitzMet al. (2011) Parents’ first concerns of their child’s development in toddlers with autism spectrum disorders. Developmental Neurorehabilitation14(2): 72–78.
32.
LordCRisiSDiLavorePSet al. (2006) Autism from 2 to 9 years of age. Archives of General Psychiatry63(6): 694–701.
LoucasTCharmanTPicklesAet al. (2008) Autistic symptomatology and language ability in autism spectrum disorder and specific language impairment. Journal of Child Psychology and Psychiatry49(11): 1184–1192.
35.
MasonAESbarraDAMehlMR (2010) Thin-slicing divorce: thirty seconds of information predict changes in psychological adjustment over 90 days. Psychological Science21(10): 1420–1422.
36.
MatsonJLTureckK (2012) Early diagnosis of autism: current status of the Baby and Infant Screen for Children with aUtIsm Traits (BISCUIT-Parts 1, 2, and 3). Research in Autism Spectrum Disorders6(3): 1135–1141.
37.
MillerJF (1981) Assessing Language Production in Children: Experimental Procedures, vol. 1. Baltimore, MD: University Park Press.
38.
NazneenNRozgaASmithCJet al. (2015) A novel system for supporting autism diagnosis using home videos: iterative development and evaluation of system design. JMIR mHealth and uHealth3(2): e68.
39.
PentlandBPitcairnTKGrayJMet al. (1987) The effects of reduced expression in Parkinson’s disease on impression formation by health professionals. Clinical Rehabilitation1(4): 307–312.
40.
PierceKCourchesneEBaconE (2016) To screen or not to screen universally for autism is not the question: why the task force got it wrong. Journal of Pediatrics176: 182–194.
41.
RevelleW (2011) Psych: Procedures for personality and psychological research. Evanston, IL: Northwestern University. Available at: http://personality-project.org/r/psych.manual.pdf (accessed 1 January 2009).
42.
RevelleWRocklinT (1979) Very Simple Structure: an alternative procedure for estimating the optimal number of interpretable factors. Multivariate Behavioral Research14: 403–414.
43.
RobertsMYKaiserAP (2012) Assessing the effects of a parent-implemented language intervention for children with language impairments using empirical benchmarks: a pilot study. Journal of Speech, Language, and Hearing Research55(6): 1655–1670.
44.
RobinXTurckNHainardAet al. (2011) pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics12(1): 77.
45.
RobinsDLFeinDBartonMLet al. (2001) The Modified Checklist for Autism in Toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. Journal of Autism and Developmental Disorders31(2): 131–144.
46.
RouxAMHerreraPWoldCMet al. (2012) Developmental and autism screening through 2-1-1. American Journal of Preventive Medicine43(Suppl. 5): S457–S463.
47.
ShavelsonRJWebbNMRowleyGL (1989) Generalizability theory. American Psychologist44(6): 922–932.
48.
SmithCJRozgaAMatthewsNet al. (2016) Investigating the accuracy of a novel telehealth diagnostic approach for autism spectrum disorder. Psychological Assessment29: 245–252.
49.
SokeGNMaennerMJChristensenDet al. (2017) Brief report: estimated prevalence of a community diagnosis of autism spectrum disorder by age 4 years in children from selected areas in the United States in 2010: evaluation of birth cohort effects. Journal of Autism and Developmental Disorders47(6): 1917–1922.
50.
StoneWLOusleyOY (1997) STAT manual: screening tool for autism in two-year-olds. Unpublished manuscript, Vanderbilt University, Nashville, TN.
51.
StoneWLCoonrodEETurnerLMet al. (2004) Psychometric properties of the STAT for early autism screening. Journal of Autism and Developmental Disorders34(6): 691–701.
52.
SumaKAdamsonLBBakemanRet al. (2016) After early autism diagnosis: changes in intervention and parent-child interaction. Journal of Autism and Developmental Disorders46(8): 2720–2733.
53.
TackettJLSmackAJHerzhoffKet al. (2017) Measuring child personality when child personality was not measured: application of a thin-slice approach. Personality and Mental Health11(1): 4–13.
54.
WaltonKMIngersollBR (2016) The utility of Thin Slice ratings for predicting language growth in children with autism spectrum disorder. Autism20(3): 374–380.
55.
WangEJToosiNRAmbadyN (2009) Nonverbal dialects: culture and person perception. In: WyerRSChiuCYHongYYet al (eds) Understanding Culture: Theory, Research and Application. New York: Psychology Press, pp.289–298.
56.
WebbNMShavelsonRJ (2005) Generalizability theory: overview. In: EverittBSHowellDC (eds) Encyclopedia of Statistics in Behavioral Science, vol. 2. Chichester: John Wiley & Sons, pp.717–719.
57.
WrightJCDrinkwaterM (1997) Rationality vs accuracy of social judgment. Social Cognition15(4): 245–273.
58.
YoderPSymonsF (2010) Observational Measurement of Behavior. New York: Springer Publishing Company.
59.
YoungSGHugenbergK (2010) Mere social categorization modulates identification of facial expressions of emotion. Journal of Personality and Social Psychology99(6): 964–977.
60.
ZimmermanILSteinerVGPondRE (2002) PLS-4: Preschool Language Scale. 4th ed.San Antonio, TX: The Psychological Corporation.
61.
ZinbargRERevelleWYovelIet al. (2005) Cronbach’s α, Revelle’s β, and McDonald’s ω H: their relations with each other and two alternative conceptualizations of reliability. Psychometrika70: 123–133.
62.
ZwaigenbaumLBaumanMLChoueiriRet al. (2015) Early intervention for children with autism spectrum disorder under 3 years of age: recommendations for practice and research. Pediatrics136(Suppl. 1): S60–S81.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
