Linguistic indicators of text quality in analytical texts: developmental changes and sensitivity to pedagogical work ( Indicadores lingüísticos de la calidad textual en los textos analíticos: cambios evolutivos y sensibilidad al trabajo pedagógico )

Abstract

Spanish

Mastering analytical writing involves the proficient use of varied later-acquired grammatical, lexical and discourse forms and functions. Developmental studies have identified specific linguistic features as diagnostic of increasing proficiency. This study examines how these features change throughout educational levels and before and after the implementation of a set of classroom activities aimed at homogenizing participants’ pedagogical input while raising their awareness of analytical texts’ main functions. Two hundred and twelve Spanish speakers from primary, secondary and university levels participate in the study, each producing two analytical texts. The corpus consists of 424 texts produced on the same topic. Results indicate that not all the features pertaining to the same domain show identical changes across educational levels or are identically sensitive to pedagogical work. Productivity measures increase with educational level and after pedagogical work, except for university students. Most lexical, syntactic and discourse-level measures improve with educational level, though their sensitivity to pedagogical work is not straightforward. Findings suggest the need to evaluate writing quality at a high level of granularity.

Get full access to this article

View all access options for this article.

References

Abbott

R. D.

Berninger

V. W.

(1993). Structural equation modeling of relationships among developmental skills and writing skills in primary and intermediate grade writers. Journal of Educational Psychology, 85(3), 478–508. https://doi.org/10.1037/0022-0663.85.3.478

Alamargot

Chanquoy

(2001). Through the models of writing: With commentaries by Ronald T. Kellogg and John R. Hayes. Kluwer Academic Publishers.

Alonso-Cortés

M. D.

Llamazares

M. T.

Zapico

(2017). La escritura de textos argumentativos: una actividad más satisfactoria gracias a la evaluación compartida. Infancia, Educación y Aprendizaje, 3(2), 350–355. https://doi.org/10.22370/ieya.2017.3.2.747

Anglin

(1993). Vocabulary development: A morphological analysis. Monographs of the Society for Research in Child Development, 58(10), 1–165. https://doi.org/10.2307/1166112

Aparici

(2010). El desarrollo de la conectividad discursiva en diferentes géneros y modalidades de producción [Unpublished doctoral dissertation]. University of Barcelona.

Baratta

(2010). Nominalization development across an undergraduate academic degree program. Journal of Pragmatics, 42(4), 1017–1036. https://doi.org/10.1016/j.pragma.2009.08.007

Bates

Bretherton

Snyder

(1988). From first words to grammar: Individual differences and dissociable mechanisms. Cambridge University Press.

Beers

S. F.

Nagy

W. E.

(2009). Syntactic complexity as a predictor of adolescent writing quality: Which measures? Which genre? Reading and Writing: An Interdisciplinary Journal, 22(2), 185–200. https://doi.org/10.1007/s11145-007-9107-5

Berman

R. A.

Nir-Sagiv

(2009). Cognitive and linguistic factors in evaluating expository text quality: Global versus local? In Evans

Pourcel

(Eds.), New directions in cognitive linguistics (pp. 421–440). John Benjamins.

10.

Berman

R. A.

Nir-Sagiv

(2010). The lexicon in writing-speech differentiation. Developmental perspectives. Written Language and Literacy, 13(2), 183–205. https://doi.org/10.1075/wll.13.2.01ber

11.

Berman

R. A.

Ragnarsdóttir

Strömqvist

(2002). Discourse stance. Written Language and Literacy, 5(2), 253–287. https://doi.org/10.1075/wll.5.2.06ber

12.

Berman

R. A.

Slobin

D. I.

(1994). Relating events in narrative: A crosslinguistic developmental study. Lawrence Erlbaum.

13.

Biber

(1995). Dimensions of register variation: A cross-linguistic comparison. Cambridge University Press.

14.

Chafe

(1994). Discourse, consciousness, and time: The flow and displacement of conscious experience in speaking and writing. University of Chicago Press.

15.

Charles

(2003). A corpus-based study of the use of nouns to construct stance in theses from two contrasting disciplines. Journal of English for Academic Purposes, 2(4), 313–326. https://doi.org/10.1016/S1475-1585(03)00048-1

16.

Choi

(2007). How and when do children acquire the use of discourse markers? CamLing, 2007, 40–47. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.112.1022&rep=rep1&type=pdf

17.

Crossley

S. A.

McNamara

D. S.

(2010). Cohesion, coherence, and expert evaluations of writing proficiency. In Ohlsson

Catrambone

(Eds.), Proceedings of the 32nd annual conference of the cognitive science society (pp. 984–989). Cognitive Science Society.

18.

Crossley

S. A.

Weston

McLain Sullivan

S. T.

McNamara

D. S.

(2011). The development of writing proficiency as a function of grade level: A linguistic analysis. Written Communication, 28(3), 282–311. https://doi.org/10.1177/0741088311410188

19.

Crowhurst

(1983). Syntactic complexity and writing quality: A review. Canadian Journal of Education, 8(1), 1–16. https://doi.org/10.2307/1494403

20.

Cuenca

M. J.

(2013). The fuzzy boundaries between discourse marking and modal marking. In Degand

Cornillie

Pietrandrea

(Eds.), Discourse markers and modal particles. Categorization and description (pp. 191–216). John Benjamins.

21.

Cutillas

Tolchinsky

Rosado

Perera

(2014). Indicators of lexical growth throughout age, genre and modality for a Catalan L1 corpus. In Díaz Negrillo

Díaz Pérez

(Eds.), Specialisation and variation in language corpora (pp. 159–186). Peter Lang.

22.

Driver

Newton

Osborne

(2000). Establishing the norms of scientific argumentation in classrooms. Science Education, 84(3), 287–312 https://doi.org/10.1002/(SICI)1098-237X(200005)84:3<287::AID-SCE1>3.0.CO;2-A.

23.

Flowerdew

Wan

(2010). The linguistic and the contextual in applied genre analysis: The case of the company audit report. English for Specific Purposes, 29(2), 78–93. https://doi.org/10.1016/j.esp.2009.07.001

24.

Gregori

Clavel

(2015). Analysing lexical density and lexical diversity in university students’ written discourse. Procedia - Social and Behavioral Sciences, 198, 546–556. https://doi.org/10.1016/j.sbspro.2015.07.477

25.

Halliday

M. A. K.

Hasan

(1976). Cohesion in English. Longman Publishing.

26.

Hayes

J. R.

(2011). Kinds of knowledge-telling: Modeling early writing development. Journal of Writing Research, 3(2), 74–92. https://doi.org/10.17239/jowr-2011.03.02.1

27.

Hyland

(2005). Metadiscourse: Exploring interaction in writing. Continuum.

28.

Johansson

(2008). Lexical diversity and lexical density in speech and writing: A developmental perspective. Working Papers Lund University, 53, 61–79 https://journals.lub.lu.se/LWPL/article/view/2273/1848.

29.

Katzenberger

Cahana-Amitay

(2002). Segmentation marking in text production. Linguistics, 40(6), 1161–1184. https://doi.org/10.1515/ling.2002.043

30.

Kim

Y.-S.

Al Otaiba

Puranik

Folsom

J. S.

Greulich

Wagner

R. K.

(2011). Componential skills of beginning writing: An exploratory study at the end of kindergarten. Learning and Individual Differences, 21(5), 517–525. https://doi.org/10.1016/j.lindif.2011.06.004

31.

Kline

R. B.

(2011). Principles and practice of structural equation modeling. The Guildford Press.

32.

Langacker

(1999). Grammar and conceptualization. Mouton de Gruyter.

33.

Llauradó

Tolchinsky

(2013). Growth of text-embedded lexicon in Catalan: From childhood to adolescence. First Language, 33(6), 628–653. https://doi.org/10.1177/0142723713508861

34.

MacWhinney

(2000). The CHILDES project: Tools for analyzing talk. Lawrence Erlbaum.

35.

Mair

Wilcox

(2016). Robust statistical methods in R using the WSR2 package. Behavior Research Methods, 33, 1–25. https://doi.org/10.3758/s13428-019-01246-w

36.

Malvern

D. D.

Richards

B. J.

Chipere

Durán

(2004). Lexical diversity and language development. Palgrave MacMillan.

37.

Martín Zorraquino

M. A.

Portolés

(1999). Los marcadores del discurso. In Bosque

Demonte

(Eds.), Gramática Descriptiva de la Lengua Española (Vol. 3, pp. 4051–4213). Espasa Calpe.

38.

Mazur-Palandre

Fayol

Jisa

(2011). Information Flow across Modalities and Text Types. In V. Berninger (Ed.), Past, present, and future contributions of cognitive writing research to cognitive psychology (pp. 423–437). Psychology Press. https://doi.org/10.4324/9780203805312-29

39.

McCarthy

P. M.

Jarvis

(2010). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior Research Methods, 42(2), 381–392. https://doi.org/10.3758/BRM.42.2.381

40.

McNamara

D. S.

Crossley

S. A.

McCarthy

P. M.

(2010). Linguistic features of writing quality. Written Communication, 27(1), 57–86. https://doi.org/10.1177/0741088309351547

41.

Nippold

(2007). Peer conflict explanations in children, adolescents, and adults: Examining the development of complex syntax. American Journal of Speech-Language Pathology, 16(2), 179–188. https://doi.org/10.1044/1058-0360(2007/022)

42.

Penris

Verspoor

(2017). Academic writing development: A complex, dynamic process. In Pfenniger

Navracsics

(Eds.), Future research directions for applied linguistics (pp. 215–242). Multilingual Matters.

43.

Ravid

Berman

R. A.

(2010). Developing Noun Phrase Complexity at School Age: A Text-Embedded Cross-Linguistic Analysis. First Language, 30(1), 3–26. https://doi.org/10.1177/0142723709350531

44.

Ravid

Levie

(2010). Hebrew adjectives in later language text production. First Language, 30(1), 27–55. https://doi.org/10.1177/0142723709350529

45.

Ravid

Rosado

Van Hell

Zamora

(2002). Subject NP patterning in the development of text production: Speech and writing. Written Language and Literacy, 5(1), 69–93. https://doi.org/10.1075/wll.5.1.04rav

46.

Riedemann

(1996). Word-length distribution in English press texts. Journal of Quantitative Linguistics, 3(3), 265–271. https://doi.org/10.1080/09296179608599634

47.

Salas

Llauradó

Castillo

Taulé

Martí

M. A.

(2016). Linguistic correlates of text quality from childhood to adulthood. In Perera

Aparici

Rosado

Salas

(Eds.), Written and spoken language development across the lifespan. Essays in honour of Liliana Tolchinsky (pp. 307–326). Springer.

48.

Sanders

Noordman

L. G.

(2000). The role of coherence relations and their linguistic markers in text processing. Discourse Processes, 29(1), 37–60. https://doi.org/10.1207/S15326950dp2901_3

49.

Schleppegrell

M. J.

(2004). The language of schooling. A functional linguistics perspective. Lawrence Erlbaum.

50.

Scott

C. M.

(2009). A case for the sentence in reading comprehension. Language, Speech, and Hearing Services in Schools, 40(2), 184–191 https://doi.org/10.1044/0161-1461(2008/08-0042).

51.

Slobin

D. I.

(1977). Language change in childhood and in history. In McNamara

(Ed.), Language learning and thought (pp. pp. 185–214). Academic Press.

52.

Snow

C. E.

Uccelli

(2009). The challenge of academic language. In Olson

D. R.

Torrance

(Eds.), The Cambridge handbook of literacy (pp. 112–133). Cambridge University Press.

53.

Tolchinsky

Aparici

Rosado

(2017). Escribir para pensar y persuadir. Textos de didáctica de la lengua y la literatura, 76, 14–21.http://hdl.handle.net/11162/150204

54.

Toulmin

(2002). The uses of argument. Cambridge University Press.

55.

Uccelli

Deng

Phillips Galloway

Qin

(2019). The role of language skills in mid-adolescents’ science summaries. Journal of Literacy Research, 51(3), 357–380. https://doi.org/10.1177/1086296X19860206

56.

Uccelli

Dobbs

Scott

(2012). Mastering academic language: Organization and stance in the persuasive writing of high school students. Written Communication, 30(1), 36–62. https://doi.org/10.1177/0741088312469013

57.

Upton

Cohen

M. A.

(2009). An approach to corpus-based discourse analysis: The move analysis as example. Discourse Studies, 11(5), 585–605. https://doi.org/10.1177/1461445609341006

58.

Vilar

(2019). El desarrollo de la estructura retórica en la escritura analítica . Oral presentation. IX International Conference on Language Acquisition. Madrid (Spain), 4–6 September 2019.

59.

Wagner

R. K.

Puranik

C. S.

Foorman

Foster

Tschinkel

Kantor

P. T.

(2011). Modelling the development of written language. Reading and Writing: An Interdisciplinary Journal, 24(2), 203–220. https://doi.org/10.1007/s11145-010-9266-7

60.

Zipf

G. K.

(1932). Selected studies of the principle of relative frequency in language. Harvard University Press.