The power of visual communication is multiplied when it is co-deployed with language in multimodal texts. In hypertexts, such as websites, the interaction of these two semiotic resources affords new forms of informational and design complexity and presents us with some new political choices. This article offers a semiotic scheme for the analysis of composite verbal-visual meanings and some discussions of the semiotic politics of visual communication in hypermedia design.
Aarseth, Espen (1997) Cybertext. Baltimore, MD: Johns Hopkins University Press.
2.
Arnheim, Rudolf (1956) Art and Visual Perception. London: Faber.
3.
Bakhtin, Mikhail M. (1981[1935]) ‘Discourse in the Novel’, in M. Holquist (ed.) The Dialogic Imagination. Austin: University of Texas Press.
4.
Eco, Umberto (1990) Travels in Hyperreality, ed. John Radziewicz, trans. William Weaver, 2nd edn.Fort Washington, PA: Harvest Books.
5.
Halliday, M.A.K. (1978) Language as Social Semiotic. London: Arnold.
6.
Halliday, M.A.K. (1994) An Introduction to Functional Grammar. 2nd edn.London: Arnold.
7.
Halliday, M.A.K. and Hasan, R. (1976) Cohesion in English. London: Longman.
8.
Kolb, David (1997) ‘Scholarly Hypertext’, Hypertext ’97: Proceedings of the ACM Conferences on Hypertext! (Association for Computing Machinery): 29-37.
9.
Kress, G. and Van Leeuwen, T. (1996) Reading Images. London: Routledge.
10.
Kress, G. and Van Leeuwen, T. (2001) Multimodal Discourse. London: Arnold.
Lemke, J.L. (1988) ‘Text Structure and Text Semantics’, in R. Veltman and E. Steiner (eds) Pragmatics, Discourse, and Text, pp. 158-170. London: Pinter.
13.
Lemke, J.L. (1995) ‘Intertextuality and Text Semantics’, in M. Gregory and P. Fries (eds) Discourse in Society: Functional Perspectives, pp. 85-114. Norwood, NJ: Ablex Publishing.
14.
Lemke, J.L. (1998a) ‘Resources for Attitudinal Meaning: Evaluative Orientations in Text Semantics’, Functions of Language5(1): 33-56.
15.
Lemke, J.L. (1998b) ‘Multiplying Meaning: Visual and Verbal Semiotics in Scientific Text’, in James R. Martin and Robert Veel (eds) Reading Science, pp. 87-113. London: Routledge.
16.
Lemke, J.L. (2002a) ‘Notes on Multimedia and Hypertext’, online at: [http://academic.brooklyn.cuny.edu/education/jlemke/papers/hypermedia/appendix.html]
17.
Lemke, J.L. (2002b) ‘Multimedia Genres for Science Education and Scientific Literacy’, in M. Schleppegrell and M.C. Colombi (eds) Developing Advanced Literacy in First and Second Languages. Mahwah, NJ: Erlbaum.
18.
Lemke, J.L. (in press a) ‘Mathematics in the Middle: Measure, Picture, Gesture, Sign, and Word’, in M. Anderson, V. Cifarelli, A. Saenz-Ludlow and A. Vile (eds) Semiotic Perspectives on Mathematics Education.
19.
Lemke, J.L. (in press b) ‘The Role of Texts in the Technologies of Social Organization’, in R. Wodak and G. Weiss (eds) Theory and Interdisciplinarity in Critical Discourse Analysis. London: Macmillan/Palgrave.
20.
Mann, William and Thompson, Sandra (1986) ‘Relational Propositions in Discourse’, Discourse Processes9(1): 57-90.
21.
Martin, J.R. (1992) English Text: System and Structure. Philadelphia: John Benjamins.
22.
Mitchell, W.J.T. (1994) Picture Theory. Chicago: University of Chicago Press.
23.
Voloshinov, V.N. (1986[1929]) Marxism and the Philosophy of Language, trans. L. Matejka and I.R. Titunik. Cambridge, MA: Harvard University Press.
