In this study we seek evidence of validity according to the socio-cognitive framework (Weir, 2005) for a new sentence repetition test (SRT) for young Deaf L1 Swiss German Sign Language (DSGS) users. SRTs have been developed for various purposes for both spoken and sign languages to assess language development in children. In order to address the need for tests to assess the grammatical development of Deaf L1 DSGS users in a school context, we developed an SRT. The test targets young learners aged 6–17 years, and we administered it to 46 Deaf students aged 6.92–17.33 (M = 11.17) years. In addition to the young learner data, we collected data from Deaf adults (N = 14) and from a sub-sample of the children (n = 19) who also took a test of DSGS narrative comprehension, serving as a criterion measure. We analyzed the data with many-facet Rasch modeling, regression analysis, and analysis of covariance. The results show evidence of scoring, criterion, and context validity, suggesting the suitability of the SRT for the intended purpose, and will inform the revision of the test for future use as an instrument to assess the sign language development of Deaf children.
BartlettA. N. (2018). The association between sentence repetition and other cognitive abilities in school-aged children (Unpublished MA thesis). University of Windsor, Canada. https://scholar.uwindsor.ca/etd/7496
3.
BattyA. O. (2014). A comparison of video- and audio-mediated listening tests with many-facet Rasch modeling and differential distractor functioning. Language Testing, 32(1), 3–20. https://doi.org/10.1177/0265532214531254
4.
BattyA. O.HaugT. (forthcoming). Validating the rating scale for a sentence repetition test for Swiss German Sign Language. Unpublished manuscript.
5.
Boyes BraemP. (1995). Einführung in die Gebärdensprache und ihre Erforschung (Vol. 11). Signum-Verlag.
6.
BrunfautT.HardingL.BattyA. O. (2018). Going online: The effect of mode of delivery on performances and perceptions on an English L2 writing test suite. Assessing Writing, 36, 3–18. https://doi.org/10.1016/j.asw.2018.02.003
7.
CohenJ. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum.
8.
Conti-RamsdenG.BottingN.FaragherB. (2001). Psycholinguistic markers for specific language impairment (SLI). Journal of Child Psychology and Psychiatry, 42(6), 741–748. https://doi.org/10.1111/1469–7610.00770
9.
CormierK.AdamR.RowleyK.WollB.AtkinsonJ. R. (2012, March). The British Sign Language Sentence Reproduction Test: Exploring age-of-acquisition effects in British deaf adults. Paper presented at the 34. DGfS Jahrestagung, Frankfurt am Main. http://dgfs.uni-frankfurt.de/dgfs/ag13_07_1800–1830_Cormier.html
10.
CormierK.SmithS.ZwetsM. (2013). Framing constructed action in British Sign Language narratives. Journal of Pragmatics, 55, 119–139. https://doi.org/10.1016/j.pragma.2013.06.002
11.
DevescoviA.CaselliC. (2007). Sentence repetition as a measure of early grammatical development in Italian. International Journal of Language & Communication Disorders, 42(2), 187–208. https://doi.org/10.1080/13682820601030686
EngelhardG. (2009). Using item response theory and model data fit to conceptualize differential item and person functioning for students with disabilities. Educational and Psychological Measurement, 69(4), 585–602. https://doi.org/10.1177/0013164408323240
14.
ErlamR. (2006). Elicited imitation as a measure of L2 implicit knowledge: An empirical validation study. Applied Linguistics, 27(3), 464–491. https://doi.org/10.1093/applin/aml001
15.
ErlenkampS. (2012). Syntax: Aus Gebärden Sätze bilden. In EichmannH.HansenM.HessmannJ. (Eds.), Handbuch Deutsche Gebärdensprache – Sprachwissenschaftliche und anwendungsbezogene Perspektiven (pp. 165–198). Signum-Verlag.
16.
GaillardS.TremblayA. (2016). Linguistic proficiency assessment in second language acquisition research: The elicited imitation task. Language Learning, 66(2), 419–447. https://doi.org/10.1111/lang.12157
17.
GrahamC. R.McGheeJ.MillardB. (2010). The role of lexical choice in elicited imitation item difficulty. In PriorM. T.WatanabeY.LeeS.-K. (Eds.), Selected proceedings of the 2008 second language research forum (pp. 57–72). Cascadilla Press.
18.
HammillD.BrownV.LarsenS.WiederholtJ. L. (1994). Test of Adolescent and Adult Language (3rd ed.). Pro-Ed.
19.
HaugT. (2011). Methodological and theoretical issues in the adaptation of sign language tests: An example from the adaptation of a test to German Sign Language. Language Testing, 29(2), 181–201. https://doi.org/10.1177/0265532211421509
20.
HaugT.PerrollazR. (2015). DSGS-Verständnistest einer Geschichte (DSGS-GV).
21.
HauserP.SupallaT.BavelierD. (2008). American Sign Language sentence reproduction test: Development and implications. In MüllerR.Quadrosde (Ed.), Sign languages: Spinning and unraveling the past, present and future (pp. 160–172). Editora Arara Azul. Petrópolis.
22.
HermanR. (2002). Assessment of BSL development (Unpublished doctoral dissertation). City University London.
23.
IsaacsT.ThomsonR. I. (2013). Rater experience, rating scale length, and judgments of L2 pronunciation: Revisiting research conventions. Language Assessment Quarterly, 10(2), 135–159. https://doi.org/10.1080/15434303.2013.769545
24.
JessopL.SuzukiW.TomitaY. (2007). Elicited imitation in second language acquisition research. Canadian Modern Language Review, 64(1), 215–238. https://doi.org/10.3138/cmlr.64.1.215
25.
JohnstonT.SchembriA. (2007). Australian Sign Language: An introduction to sign language linguistics. Cambridge University Press. https://doi.org/10.1017/CBO9780511607479
26.
JonesR. (1994). Sentence repetition: A useful oral language screening device. Australasian Journal of Special Education, 18(2), 21–27. https://doi.org/10.1017/S1030011200023174
27.
KlemM.Melby-LervågM.HagtvetB.LysterS.-A. H.GustafssonJ.-E.HulmeC. (2015). Sentence repetition is a measure of children’s language skills rather than working memory limitations. Developmental Science, 18(1), 146–154. https://doi.org/10.1111/desc.12202
LeclercqA.-L.QuémartP.MagisD.MaillartC. (2014). The sentence repetition task: A powerful diagnostic tool for French children with specific language impairment. Research in Developmental Disabilities, 35(12), 3423–3430. https://doi.org/10.1016/j.ridd.2014.08.026
30.
LinacreJ. M. (1994). Many-facet Rasch measurement (2nd ed.). MESA Press.
LingG.MollaunP.XiX. (2014). A study on the impact of fatigue on human raters when scoring speaking responses. Language Testing, 3(4) 479–499. https://doi.org/10.1177/0265532214530699
33.
MannW. (2006). Examining German deaf children’s understanding of referential distinction in written German and German Sign Language (DGS) (Unpublished doctoral dissertation). San Francisco State University & University of California, Berkeley, San Francisco, CA.
34.
MarshallC.MasonK.RowleyK.HermanR.AtkinsonJ.WollB.MorganG. (2015). Sentence repetition in deaf children with specific language impairment in British Sign Language. Language Learning and Development, 11(3), 273–251. https://doi.org/10.1080/15475441.2014.917557
35.
MayberryR. I.LockE.KazmiH. (2002). Linguistic ability and early language exposure. Nature, 417(6884), 38–38. https://doi.org/10.1038/417038a
36.
MeirN.WaltersJ.Armon-LotemS. (2016). Disentangling SLI and bilingualism using sentence repetition tasks: The impact of L1 and L2 properties. International Journal of Bilingualism, 20(4), 421–452. https://doi.org/10.1177/1367006915609240
37.
MitchellR. E.KarchmerM. A. (2004). Chasing the mythical ten percent: Parental hearing status of deaf and hard of hearing students in the United States. Sign Language Studies, 4(2), 138–163. https://doi.org/10.1353/sls.2004.0005
38.
MorganG.HermanR.WollB. (2002). The development of complex verb constructions in British Sign Language. Journal of Child Language, 29, 655–675. https://doi.org/10.1017}S0305000902005184
39.
MorganG.WollB. (Eds.). (2002). Directions in sign language acquisition – Trends in language acquisition research. John Benjamins. https://doi.org/10.1075/tilar.2
40.
MyfordC. M.WolfeE. W. (2003). Detecting and measuring rater effects using many-facet Rasch measurement: Part 1. Journal of Applied Measurement, 4(4), 386–422.
41.
OkuraE.LonsdaleD. (2012). Working memory’s meager involvement in sentence repetition tests. In MiyakeN.PeeblesD.CooperR. S. (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (pp. 2132–2137). Cognitive Science Society.
42.
O’SullivanB.WeirC. (2011). Test development and validation. In O’SullivanB. (Ed.), Language testing: Theories and practices (pp. 13–32). Macmillan.
43.
PaddenC. (1990). The relationship between space and grammar in ASL verb morphology. In LucasC. (Ed.), SLR theoretical issues (pp. 118–132). Gallaudet University Press.
44.
PfauR.QuerJ. (2010). Nonmanuals: Their grammatical and prosodic roles. In BrentariD. (Ed.), Sign languages (pp. 381–403). Cambridge University Press. https://doi.org/10.1017/CBO9780511712203.018
45.
PlonskyL.OswaldF. L. (2014). How big is “big”? Interpreting effect sizes in L2 research: Effect sizes in L2 research. Language Learning, 64(4), 878–912. https://doi.org/10.1111/lang.12079
46.
PollG. H.BetzS. K.MillerC. A. (2010). Identification of clinical markers of specific language impairment in adults. Journal of Speech, Language, and Hearing Research, 53, 414–429. https://doi.org/10.1044/1092–4388(2009/08–0016)
47.
RinaldiP.CaselliM. C.LucioliT.LamanoL.VolterraV. (2018). Sign language skills assessed through a sentence reproduction task. The Journal of Deaf Studies and Deaf Education, 23(4), 408–421. https://doi.org/10.1093/deafed/eny021
48.
SarandiH. (2015). Reexamining elicited imitation as a measure of implicit grammatical knowledge and beyond . . .?Language Testing, 32(4), 485–501. https://doi.org/10.1177/0265532214564504
49.
SchönströmK.HolmströmI. (2017, May). Elicited imitation tasks (EITs) as a tool for measuring sign language proficiency in L1 and L2 signers. Paper presented at the 6th International ALTE Conference, Bologna, Italy.
50.
SignMET Consortium. (2016). Deliverable 5.3: Final report that summarizes the results of the study on sign language abilities in children, taking into account the role of specific factors related to deafness. EU project SignMET.
51.
SingletonJ. L.NewportE. L. (2004). When learners surpass their models: The acquisition of American Sign Language from inconsistent input. Cognitive Psychology, 49, 370–407. https://doi.org/10.1016/j.cogpsych.2004.05.001
52.
SpadaN.ShiuJ. L.-J.TomitaY. (2015). Validating an elicited imitation task as a measure of implicit knowledge: Comparisons with other validation studies. Language Learning, 65(3), 723–751. https://doi.org/10.1111/lang.12129
WrightB. D.LinacreJ. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370.
56.
WrightB. D.MastersG. N. (2002). Number of person or item strata. Rasch Measurement Transactions, 16(3), 888.
57.
YanX.MaedaY.LvJ.GintherA. (2016). Elicited imitation as a measure of second language proficiency: A narrative review and meta-analysis. Language Testing, 33(4), 497–528. https://doi.org/10.1177/0265532215594643
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
