Document Type : Research Paper

Authors

1 Ph.D. Student Department of Linguistics, Faculty of Literature, Alzahra University, Tehran, Iran

2 Professor of linguistics, AL Zahra University, Tehran, Iran.

Abstract

The increasing impact of advertising on human life is undeniable. The simultaneous use of various communication modes such as visual, linguistic, spatial, aural, and gestural in the form of multimodal texts in this important field can more effectively encourage and persuade the audience to purchase goods and services than before. Among these, the role of language and image and their intermodal relationship with each other and with other modes in meaning-making is noteworthy. The present study, while employing a mixed framework in the form of qualitative research of a semiotic type, examines how language and image (static and dynamic) interact in television and print advertisements and also examines the effectiveness of each of these two modes in multimodal advertising texts. The results show that although multimodal texts, as a semantic whole, are the result of the functioning of all modes, each mode has a different impact. In a way that in television advertisements, the share of language in constructing and transmitting meaning is more than the image, but in the print version of the same advertisements, the effectiveness of these two modes is different from each other

Keywords

Main Subjects

 
Ahmadi, H, Yazdani, S; Babasalari, & Z; Rabi, A. (2018). Relationships between Texts and Images in Persian Language Textbooks Based on Marsh and White’s Theory: The Case Study of a Persian Language Textbook Series. Journal of Teaching Persian to Speakers of Other   Languages Vol. 8, No. 2 (Tome 18), Fall & Winter 2019. [in Persian]
 
Jafari, M., & Shakrinzhad, M. (2016). An Introduction to the Application of Social Semiotics in Film Analysis. Journal of  Society, Culture, and Media, 8(31), 65-102. [in Persian]
 
Hakim, A., Pakzad, Z., & Kouhmary, M. (2019). Analysis of thef unction of Language in Contemporary Painting from the Perspective of Michael Halliday's Systemic Functional Linguistics. Journal of   Sociolinguistics, 3(2), 25-36. [in Persian]
 
Hakim, A., Pakzad, Z., & Kouhmary, M. (2021). Statement in Contemporary Iranian Painting: A Multimodal Discourse Analysis   (Case Study: Solo Painting Exhibitions at Tarahan-e Azad Gallery,   2006-2016), Bagh-e Nazar Journal, 18(101), 67-82. [in Persian]
 
Adams, Y., Matu, P. M, & Oketch, O. (2014). Multimodality in Safaricom Advertisement Communication in the Kenyan Daily Nation   Newspaper. Academic Journal of Interdisciplinary Studies, 403-410.
 
Bateman, J. A. (2014). Text and Image: A Critical Introduction to the Visual/Verbal Divide. London: Routledge
 
Barthes, R. (1977). Image Music Text: Essays Selected and Translated by Stephen Heath. London: Fontana Press.
 
Carney, R. N., & Levin, J. R. (2002). Pictorial Illustrations Still Improve
   Students’Learning from Text. EducationalPsycholoy Review. 14(1):
   5-26.
 
Dastjerdi, H. V., Mobarkeh, S. D., & Zare, M. (2012). A Multimodal
   Analysis of Differences Between TV Commercials and
   Press Advertisements: A Discoursal Study of Persuasion-Seeking
   Strategies in the Mass Media. Studies in Literature and Language, Vol
  4, No. 2, 115-121
 
Halliday, M. A. K. (1985). An Introduction to Functional Grammar
   London: Edward Arnold.
 
Halliday, M. A. K. (1978). Language as Social Semiotic: The Social
   Interpretation of Language and Meaning. London: Edward Arnold.
 
Halliday, M.A.K. & Matthiessen, C.M.I.M. (2004). An introduction to
   Functional Grammar. 3rd ed. London, Arnold.
 
Jewitt, C. (Ed.) (2009). The Routledge Handbook of Multimodal
   Analysis. London: Routledge.
 
Jewitt, C., & Oyama, R. (2008). Visual meaning: a social semiotic
   approach. In T. V. Leeuwen, & C. Jewitt, Handbook of Visual
   Analysis.
 
Jewitt, C. Bezmer, J. O'Halloran, k. (2016). Introducing Multimodality
   London: Routledge.
 
Kress, G. R., & Van Leeuwen, T. (1996). Reading Images: The
   Grammar of Visual Design. London: Routledge
 
Kress, G., & van Leeuwen, T. (2006). Reading images: the grammar of
   visual design. London: Routledge.
 
Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Abingdon: Routledge.
 
Marsh, E. E. & White, M. D. (2003). A Taxonomy of Relationships
   between Images and Text. Journal of Documentation, 59.6, pp. 647–
  672(pp. 134-156). London: Sage
 
Martinec, R., & Salway, A. (2005). A System for Image–Text Relations
   in New (and Old) Media. Visual Communication. 4(3): 337-371.
 
Olowu, A., & Akinkurolere, S. O. (2015). A multimodal discourse
   analysis of selected advertisement of malaria drugs. Journal of English
   Education,3(2),166-173.
 
O'Toole, M. (2008). Thinking with your eyes: Magritte and the logical
   metafunction, systemic functional linguistics in use, Odense Working
   Papers in Language & Communication, 29, 63-84.
 
Salway, A., & Martinec, R. (2002). Some Ideas for Modelling Image-Text Combinations [On-line].  Available:http://epubs.surrey.ac.uk/508/ Leeuwen, & C. Jewitt, Handbook of Visual Analysis (pp. 134-156). London: Sage.
 
Siefkes, M. (2015). How Semiotic Modes Work Together in Multimodal
   Texts: Defining and Representing Intermodal Relations. 10plus1:
   Living Linguistics. Issue 1, Media Linguistics.
 
Stöckl, H. (2004b). In between Modes: Language and Image in Printed
   Media. In E. Ventola et al. (Eds.), Perspectives on Multimodality (pp
   9-30). Amsterdam: Benjamins.
 
Thibault, P.J. (2000). The multimodal transcription of a television
   advertisement. In A. Baldry (Ed.), Multimodality and multimediality in
   the distance learning age. Campobasso, Italy: Palladino.
 
van Leeuwen, T. (2005). Introducing social semiotics. London:   Routledge.