The study we report in this article addresses the results of comparing the rhetorical trees from two different languages carried out by two annotators starting from the Rhetorical Structure Theory (RST). Furthermore, we investigate the methodology for a suitable evaluation, both quantitative and qualitative, of these trees. Our corpus contains abstracts of medical research articles written both in Spanish and Basque, and extracted from Gaceta Médica de Bilbao (‘Medical Journal of Bilbao’). The results demonstrate that almost half of the annotator disagreement is due to the use of translation strategies that notably affect rhetorical structures.
Abelen, E., Redeker, G. and Thompson, S.A. ( 1993) ‘The Rhetorical Structure of US-American and Dutch Fund-Raising Letters’, Text13(3): 323-350.
2.
Arakama, J.M., Arrieta, A., Lozano, J., Robles, J. and Urrutia, R.M. ( 2005) IVAPeko Estilo Liburua. Zarautz: IVAP.
3.
Bateman, J.A. and Rondhuis, K.J. ( 1997) ‘Coherence Relations: Towards a General Specification’ , Discourse Processes24: 3-50.
4.
Bouayad-Agha, N. ( 2000) ‘Using an Abstract Rhetorical Representation to Generate a Variety of Pragmatically Congruent Texts’, in Proceedings of the 38th Meeting of the Association for Computational Linguistics. Student Workshop, 16-22.
5.
Burstein, J. and Marcu, D. ( 2003) ‘A Machine Learning Approach for Identification of Thesis and Conclusion Statements in Student Essays’, Computers and the Humanities37(4): 455-467.
6.
Carlson, L. and Marcu, D. ( 2001) Discourse Tagging Reference Manual. ISI Technical Report ISITR-545. Los Angeles, CA: University of Southern California.
7.
Carlson, L., Marcu, D. and Okurowski, M.E. ( 2001) ‘Building a Discourse-Tagged Corpus in the Framework of Rhetorical Structure Theory’, in Proceedings of the 2nd SIGDIAL Workshop on Discourse and Dialogue. 1-10.
8.
Cuartero, J.M. ( 1995) ‘El estatuto categorial de además y sus propiedades distribucionales’, Dicenda13: 103-118.
9.
Cui, S. ( 1986) ‘A Comparison of English and Chinese Expository Rhetorical Structures’, Unpublished Master’s thesis, UCLA.
10.
da Cunha, I. ( 2008) Hacia un modelo lingüístico de resumen automático de artículos médicos en español. Barcelona: IULA. [CD-ROM] (Sèrie Tesis; 23).
11.
da Cunha, I. and Torres-Moreno, J.-M. ( 2010) ‘Automatic Discourse Segmentation: Review and Perspectives’ , in Proceedings of the International Workshop on African Human Languages Technologies. Djibouti: Institute of Sciences and Information Technologies.
12.
da Cunha, I., Wanner, L. and Cabré, M.T. ( 2007) ‘Summarization of Specialized Discourse: The Case of Medical Articles in Spanish’, Terminology13(2): 249-286.
13.
Delin, J., Hartley, A. and Scott, D. ( 1996) ‘Towards a Contrastive Pragmatics: Syntactic Choice in English and French Instructions’, Language Sciences18(3-4): 897-931.
14.
Ghorbel, H., Ballim, A. and Coray, G. ( 2001) ‘ROSETTA: Rhetorical and Semantic Environment for Text Alignment’, in P. Rayson, A. Wilson, A.M. McEnery , A. Hardie and S. Khoja (eds) Proceedings of Corpus Linguistics2001, pp. 224-233.
15.
Haouam, K. and Marir, F. ( 2003) ‘SEMIR: Semantic Indexing and Retrieving Web Document using Rhetorical Structure Theory’, Lecture Notes in Computer Science: 596-604.
16.
Iruskieta, M., Diaz de Ilarraza, A. and Lersundi, M. (in press) ‘Correlaciones en euskera entre las relaciones retóricas y los marcadores del discurso’, Proceedings of 27th AESLA International Conference: Ways and Modes of Human Communication . Ciudad Real: Universidad de Castilla-La Mancha.
17.
Kong, K.C.C. ( 1998) ‘Are Simple Business Request Letters Really Simple? A Comparison of Chinese and English Business Request Letters’, Text18(1): 103-141.
18.
Mann, W.C. ( 2005) RST Web Site. Available at: www.sfu.ca/rst (accessed 15 August 2009).
19.
Mann, W.C. and Thompson, S.A. ( 1988) ‘Rhetorical structure theory: Toward a functional theory of text organization’, Text8(3): 243-281.
20.
Marcu, D. ( 1998) ‘The Rhetorical Parsing, Summarization, and Generation of Natural Language Texts’, PhD thesis, University of Toronto.
21.
Marcu, D. ( 1999) Instructions for manually annotating the discourse structure of texts. Available at: http://www.isi.edu/~marcu .
22.
Marcu, D. ( 2000a) The Theory and Practice of Discourse Parsing Summarization . Cambridge, MA: Massachusetts Institute of Technology.
23.
Marcu, D. ( 2000b) ‘The Rhetorical Parsing of Unrestricted Texts: A Surface-Based Approach’, Computational Linguistics26(3): 395-448.
24.
Marcu, D., Amorrortu, E. and Romera, M. ( 1999) ‘Experiments in Constructing a Corpus of Discourse Trees’, in Proceedings of the ACL Workshop on Standards and Tools for Discourse Tagging: 48-57.
25.
Marcu, D., Carlson, L. and Watanabe, M. ( 2000) ‘The Automatic Translation of Discourse Structures’ , Proceedings of the First Annual Meeting of the North American Chapter of the Association for Computational Linguistics, 9-17.
26.
Mazeiro, E. and Pardo, T.A.S. ( 2009) ‘Metodologia de avaliação automática de estruturas retóricas’, in Proceedings of the 7th Brazilian Symposium in Information and Human Language Technology (STIL 2009). São Carlos, São Paulo.
27.
O’Donnell, M. ( 2000) ‘RSTTOOL 2.4 - A markup tool for rhetorical structure theory’, in Proceedings of the International Natural Language Generation Conference: 253-256.
28.
Pardo, T.A.S. and Nunes, M.G.V. ( 2008) ‘On the Development and Evaluation of a Brazilian Portuguese Discourse Parser’, Journal of Theoretical and Applied Computing15(2): 43-64.
29.
Pardo, T.A.S., Nunes, M.G.V. and Rino, L.H.M. ( 2004) ‘DiZer: An Automatic Discourse Analyzer for Brazilian Portuguese’, Lecture Notes in Artificial Intelligence : 224-234.
30.
Ramsay, G. ( 2000) ‘Linearity in Rhetorical Organisation: A Comparative Cross-Cultural Analysis of Newstext from the People’s Republic of China and Australia’, International Journal of Applied Linguistics10(2): 241-258.
31.
Ramsay, G. ( 2001) ‘What are they Getting At? Placement of Important Ideas in Chinese Newstext: A Contrastive Analysis withAustralian Newstext’, Australian Review of Applied Linguistics24(2): 17-34.
32.
Salkie, R. and Oates, S.L. ( 1999) ‘Contrast and Concession in French and English’ , Languages in Contrast2(1): 27-56.
33.
Scott, D., Delin, J. and Hartley, A. ( 1998) ‘Identifying Congruent Pragmatic Relations in Procedural Texts’, Languages in Contrast1(1): 45-82.
34.
Skadhauge, P. and Hardt, D. ( 2005) ‘Syntactic Identification of Attribution in the RST Treebank’, in Proceedings of the Sixth International Workshop on Linguistically Interpreted Corpora. Jeju Island, 57-62.
35.
Stede, M. ( 2008) ‘Disambiguating Rhetorical Structure’, Journal of Research in Language and Computation6: 311-332.
36.
Sumita, K., Ono, K., Chino, T., Ukita, T. and Amano, S. ( 1992) ‘A Discourse Structure Analyzer for Japanese Text’ , in Proceedings of the International Conference on Fifth Generation Computer Systems, 1133-1140.
37.
Swales, J. ( 1990) Genre Analysis: English in Academic and Research Settings . Cambridge: Cambridge University Press.
38.
Taboada, M. and Mann, W.C. ( 2005) ‘Applications of Rhetorical Structure Theory’ , Discourse Studies8(4): 567-588.
39.
Taboada, M. and Mann, W.C. ( 2006) ‘Rhetorical Structure Theory: Looking Back and Moving Ahead’, Discourse Studies8(3): 423-459.
40.
van Dijk, T.A. ( 1980) Macro-Structures. An Interdisciplinary Study of Global Structures in Discourse, Cognitions and Interaction. Hillsdale, NJ: Lawrence Erlbaum.
41.
van Dijk, T.A. ( 1989) La ciencia del texto. Barcelona: Paidós.
42.
Zabala, I. ( 1996) ‘Testu-lotura: lotura tematikoa eta erreferentzia-sareak testu teknikoetan’, in Testu-loturarako baliabideak: euskara teknikoa, pp. 15-44. Bilbao: EHU.
