Volume 40 Issue 6
Dec.  2024
Turn off MathJax
Article Contents
Abstract
References
Article Navigation >  Journal of University of Science and Technology Beijing ( Social Sciences Edition)  > 2024  >  40(6): 60-70
HAN Yanfang. Corpus-based Study on the Levels of Multimodal Affordance Transformations: From the Perspective of Context Transfer[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2024, 40(6): 60-70. doi: 10.19979/j.cnki.issn10082689.2023100109
Citation: HAN Yanfang. Corpus-based Study on the Levels of Multimodal Affordance Transformations: From the Perspective of Context Transfer[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2024, 40(6): 60-70. doi: 10.19979/j.cnki.issn10082689.2023100109
shu

Corpus-based Study on the Levels of Multimodal Affordance Transformations: From the Perspective of Context Transfer

doi: 10.19979/j.cnki.issn10082689.2023100109

  • School of International Studies, Zhengzhou University, Zhengzhou 450001, China

  • Received Date: 2023-10-31
  • Publish Date: 2024-12-25
    Abstract
  • Multimodal semiotic construction, a prominent area of academic research, has undergone continuous development in both theoretical understanding and practical applications. However, there is a notable gap in our understanding of multimodal affordance transformation and its hierarchical aspects, which necessitates further exploration. This study, taking a contextual shift perspective and using the Olympic emblem symbol corpus as a foundation, investigates the levels and functions of multimodal affordance meaning transformation, focusing on genre elements, layout, and symbol selection. The research findings suggest that, under the context transfer (1) transformations in genre elements, layout, and semiotic choices display consistent patterns; (2) the use of multimodal affordance meaning transformation across different time periods is interconnected, and the symbolic features accumulated in the context are migrated to the new emblem, with semiotic hallmarks and optimal choices made through dimensional shifts, impacting knowledge shaping, role definition, and coherence; (3) intensifying of the degree of multimodal symbol meaning transformation, diminishing of the transparency of contextual shifts, and increasing of the abstraction level of affordance transformation, indicate that affordance meaning transformation is not just a contextualization process for transferring symbol resources but also a mechanism for symbol meaning innovation. Additionally, this study introduces a framework for understanding affordance transformation in social practices, providing valuable insights for analyzing the phenomena resulting from affordance transformation.

     

    • FullText(HTML)
    • References(34)
  • [1]
    BATEMAN J A,WILDFEUER J & HIIPPALA T. Multimodality:Foundations,Research and Analysis:A Problem Oriented Introduction [M]. Berlin:De Gruyter Mouton. 2017.
    [2]
    张德禄,胡瑞云. 多模态话语建构中的系统、选择与供用特征[J]. 当代修辞学,2019(5):68-79.
    [3]
    FORCEVILLE C. Visual and Multimodal Communication:Applying Relevance Principle [M]. New York and London:Oxford University Press,2020.
    [4]
    张德禄. 多模态话语中符号意义构成研究[J]. 当代修辞学,2023(3):24-36.
    [5]
    GIBSON J J. The Ecological Approach to Visual Perception (Classic Edition) [M]. Psychology Press:New York and London,2014.
    [6]
    NORMAN D A. The Design of Everyday Things [M]. Doubleday:New York,1988.
    [7]
    NORMAN D A. Affordances,conventions and design [J]. Interactions,1999,6(3):38-43. doi: 10.1145/301153.301168
    [8]
    KRESS G. Against arbitrariness:The social production of the sign as a foundational issue in critical discourse analysis [J]. Discourse & Society,1993,4(2):169-191.
    [9]
    HALLIDAY M A K & MATTHIESSEN C M I M. Construing Experience Through Meaning:A Language-based Approach to Cognition [M]. London:Cotinuum,1999.
    [10]
    韩艳方. 多模态话语建构中模态协同的多维分析:系统功能视角[J]. 外语学刊,2022(1):35-40.
    [11]
    NORMAN D A. The Design of Everyday Things(Revised and Expanded Edition) [M]. New York:Basic Books,2013.
    [12]
    ELLESTROM L. Media Transformation:The Transfer of Media Characteristics Among Media [M]. Basingstoke:Palgrave Macmillan,2014.
    [13]
    ELLESTROM L. Transmedial Narration Narratives and Stories in Different Media [M]. Basingstoke:Palgrave Macmillan,2019.
    [14]
    KRESS G &VAN LEEUWEN T. Reading Images:the Grammar of Visual Design [M]. London:Routledge,1996.
    [15]
    张德禄,吴连春. 再语境化在英语阅读课培养学生核心素养中的作用:社会教育学视角[J]. 西安外国语大学学报,2021,29(1):48-53.
    [16]
    苗兴伟,李珂. 再语境化视角下企业生态身份的话语建构[J]. 外语教学,2021,42(2):1-6.
    [17]
    曾蕾,朱薪羽. 多模态视角下投射意义的再符号化研究——以儿童文学双语绘本为例[J]. 北京科技大学学报(社会科学版),2023,39(5):554-562.
    [18]
    BERNSTEIN B. Class,Codes and Control:Theoretical studies towards a sociology of language [M]. London:Routledge and Kegan Paul,1971.
    [19]
    RICHARDSON J E & WODARK R. Recontextualising fascist ideologies of the past:Right-wing discourses on employment and nativism in Austria and the United Kingdom [J]. Critical Discourse Studies,2009,6(4):251-267. doi: 10.1080/17405900903180996
    [20]
    LINELL P. Discourse across boundaries:on recontextualisations and the blending of voices in professional discourse [J]. Text,1998,18(2):143-158.
    [21]
    FLOWERDEW J & RICHARDSON J E. The Routledge Handbook of Critical Discourse Studies [M]. London:Routledge,2018.
    [22]
    HANSAN R. Towards a paradigmatic description of context:Systems,metafunctions,and semantics [J]. Functional Linguistics,2014(1):1-54.
    [23]
    HALLIDAY M A K. Introduction:on the “Architecture” of human language [C] // WEBSTER J. On Language and Linguistics. London; New York:Continuum,2003:1-32.
    [24]
    BALDRY A & THIBAULT P J. Multimodal Transcription and Text Analysis. A Multimedia Toolkit and Coursebook [M]. London:Equinox,2006.
    [25]
    IEDEMA R. Resemiotization [J]. Semiotica,2001,137(1):23-39.
    [26]
    IEDEMA R. Multimodality,resemiotisation:Extending the analysis of discourse as multi-semiotic practice [J]. Visual Communication,2003,2(1):29-57. doi: 10.1177/1470357203002001751
    [27]
    BATEMAN J A. Multimodality and Genre:A Foundation for Systematic Analysis of Multimodal Documents [M]. New York:Palgrave MacMillan,Springer,2008.
    [28]
    BOWCHER W L & LIANG J Y. GSP and multimodal texts [C] // BOWCHER W L & LIANG J Y. Society in Language, Language in Society. London: Palgrave Macmillan, 2016: 251-274.

    BOWCHER W L & LIANG J Y. GSP and multimodal texts [C] // BOWCHER W L & LIANG J Y. Society in Language,Language in Society. London:Palgrave Macmillan,2016:251-274.
    [29]
    HASAN R. The nursery tale as a genre [C] // CLORAN C,BUTT D & WILLIAMS G. Ways of Saying:Ways of Meaning. London:Cassell,1996:51-72.
    [30]
    BATEMAN J A,DELI J & HENSCHEL R. Mapping the multimodal genres for traditional and electronic newspapers [C] // ROYCE T & BOWCHER W L. New Directions in the Analysis of Multimodal Discourse. Mahwah:Lawrence Erlbaum Associates. 2007:147-172.
    [31]
    Olympic Charter [Z/OL]. (1996-07-18)[2020-09-01]. https://www.olympic.org/documents/olympic-charter.
    [32]
    VAN LEEUWEN T. Discourse and Practice:New Tools for Critical Discourse Analysis [M]. New York and London:Oxford University Press,2008.
    [33]
    LEMEKE J L. Discourse,dynamics,and social change [J]. Cultural Dynamics,1993,6(1-2):243-257. doi: 10.1177/092137409300600107
    [34]
    张德禄. 文化语境在多模态话语建构中的作用研究[J]. 解放军外国语学院学报,2023(5):54-61,161.
    • Relative Articles

  • Relative Articles

    [1]FAN Li. Multimodal Low-carbon Discourse：A Case Study of Promotional Materials for National Low Carbon Day (2020−2022)[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2023, 39(6): 739-753. doi: 10.19979/j.cnki.issn10082689.2023020107
    [2]ZENG Lei, ZHU Xinyu. The Study of Resemiotisation System of Projection: Taking Bilingual Picture Book of Children’s Literature as an Example[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2023, 39(5): 554-562. doi: 10.19979/j.cnki.issn10082689.2022100006
    [3]YU Hui, SONG Jin-ge. A Multimodal Approach to the Social Semiotic Construction of Ecological Meanings in Children’s Picture Book[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2022, 38(6): 667-676. doi: 10.19979/j.cnki.issn10082689.2022100067
    [4]WU Yuan-zheng, FENG De-zheng. The Attitudinal Meaning and Value Construction in Multimodal Ecological Discourse[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2022, 38(6): 677-684. doi: 10.19979/j.cnki.issn10082689.2022100139
    [5]LI Zhan-zi, FAN Bing-bing. Construction of Multimodal Corpus and Its Pedagogic Application: A Case Analysis of Text-image Typology in “China-US Focus” Website[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2021, 37(5): 511-517.
    [6]ZENG Lei, ZHU Xin-yu. The Realization of Ideational Meaning of Multimodal Projection in Sinology Comics[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2020, 36(6): 1-9.
    [7]XIAO Hao-zhang, YANG Ying-ying. An Eco-analysis of the Multimodal Effects in China's EFL Education[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(6): 1-9.
    [8]TANG Lei. The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(6): 64-71.
    [9]ZHANG Chun-yan, CHEN Si-yi-ye. The Construe of Interactive Meaning in Multimodal Electronic Dictionaries—Taking LDOCEP for IOS as an Example[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2016, 32(3): 15-20.
    [10]SUN Yi, ZHOU Jing. Interpretation of National Flag Multimodal Metaphor across the World[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2016, 32(5): 1-7.
    [11]HUANG Li-he. Situated Discourse and Multimodal Studies: Significance, Theory and Methodology[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2016, 32(5): 29-36.
    [12]WANG Jia. The Interaction of Multi-metaphor and Multi-metonymy in Political Cartoons[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2014, 30(6): 20-26.
    [13]CENG Lei. The Study of the Multimodal Discourse in College English Teaching[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2014, 30(5): 9-15.
    [14]CHEN Ming-yao, XIE Li. On Cognitive and Emotional Persuasion of Multimodal Metaphor[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2012, 28(4): 73-77.
    [15]TANG Qing-ye. The Multimodal Representation of Poverty[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2012, 28(4): 60-66.
    [16]LI Li. Paraphrasing Humor in Multi-modality[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2012, 28(4): 52-59.
    [17]FENG De-zheng. Digital Technology and Multimodal Discourse Analysis[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2010, 26(4): 12-17.
    [18]PENG Yi, YANG Hai-yan. The Construal of the Integrative Meaning of Multimodal Commercial Advertising Discourse[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2010, 26(4): 1-6.
    [19]ZHAO Xiu-feng, SU Hui-yan. Cognitive Meaning Construction of Metaphorical Multimodal Discourse——Blending on the Interplay of Multimetonymy and Multimetaphor[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2010, 26(4): 18-24,30.
    [20]CHEN Yu-min. Multimodal Construal of Appraisal: A Case Study of Olympics Television Public Service Advertising[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2008, 24(3): 108-114.
    • Supplements(0)
    • Cited By
  • Created with Highcharts 5.0.7Amount of accessChart context menuAbstract Views, HTML Views, PDF Downloads StatisticsAbstract ViewsHTML ViewsPDF Downloads2024-082024-092024-102024-112024-122025-012025-022025-032025-042025-052025-062025-07050100150200
    Created with Highcharts 5.0.7Chart context menuAccess Class DistributionFULLTEXT: 62.2 %FULLTEXT: 62.2 %META: 35.2 %META: 35.2 %PDF: 2.6 %PDF: 2.6 %FULLTEXTMETAPDF
    Created with Highcharts 5.0.7Chart context menuAccess Area Distribution其他: 8.1 %其他: 8.1 %其他: 1.1 %其他: 1.1 %Falls Church: 0.3 %Falls Church: 0.3 %Moscow: 0.1 %Moscow: 0.1 %Rochester: 0.4 %Rochester: 0.4 %上海: 2.9 %上海: 2.9 %东莞: 0.1 %东莞: 0.1 %六安: 0.1 %六安: 0.1 %北京: 3.0 %北京: 3.0 %南京: 0.8 %南京: 0.8 %南昌: 0.3 %南昌: 0.3 %南通: 0.7 %南通: 0.7 %南阳: 0.1 %南阳: 0.1 %厦门: 0.1 %厦门: 0.1 %合肥: 0.1 %合肥: 0.1 %周口: 0.1 %周口: 0.1 %哥伦布: 0.4 %哥伦布: 0.4 %商丘: 0.1 %商丘: 0.1 %嘉兴: 0.8 %嘉兴: 0.8 %圣地亚哥: 0.4 %圣地亚哥: 0.4 %大连: 0.1 %大连: 0.1 %天津: 1.4 %天津: 1.4 %太原: 0.3 %太原: 0.3 %宁波: 0.3 %宁波: 0.3 %宜春: 0.3 %宜春: 0.3 %宣城: 0.7 %宣城: 0.7 %布鲁塞尔: 0.3 %布鲁塞尔: 0.3 %常州: 0.4 %常州: 0.4 %平顶山: 0.1 %平顶山: 0.1 %广州: 0.5 %广州: 0.5 %张家口: 1.4 %张家口: 1.4 %扬州: 1.5 %扬州: 1.5 %新乡: 0.3 %新乡: 0.3 %昆明: 2.6 %昆明: 2.6 %曼谷: 0.1 %曼谷: 0.1 %杭州: 2.3 %杭州: 2.3 %武汉: 0.4 %武汉: 0.4 %泸州: 0.1 %泸州: 0.1 %洛阳: 2.7 %洛阳: 2.7 %济宁: 0.1 %济宁: 0.1 %淄博: 0.3 %淄博: 0.3 %深圳: 0.4 %深圳: 0.4 %温州: 2.3 %温州: 2.3 %渭南: 0.1 %渭南: 0.1 %漯河: 5.1 %漯河: 5.1 %漳州: 0.4 %漳州: 0.4 %潍坊: 0.1 %潍坊: 0.1 %烟台: 0.5 %烟台: 0.5 %珠海: 0.3 %珠海: 0.3 %益阳: 0.1 %益阳: 0.1 %石家庄: 1.1 %石家庄: 1.1 %福州: 0.1 %福州: 0.1 %秦皇岛: 0.1 %秦皇岛: 0.1 %绵阳: 0.1 %绵阳: 0.1 %芒廷维尤: 20.9 %芒廷维尤: 20.9 %芝加哥: 0.3 %芝加哥: 0.3 %衡水: 0.8 %衡水: 0.8 %衡阳: 0.4 %衡阳: 0.4 %襄阳: 0.3 %襄阳: 0.3 %西宁: 4.9 %西宁: 4.9 %西安: 0.8 %西安: 0.8 %许昌: 0.1 %许昌: 0.1 %贵阳: 0.1 %贵阳: 0.1 %赣州: 0.1 %赣州: 0.1 %赫尔辛基: 0.4 %赫尔辛基: 0.4 %邯郸: 0.4 %邯郸: 0.4 %郑州: 19.8 %郑州: 19.8 %长沙: 1.5 %长沙: 1.5 %阿什本: 0.4 %阿什本: 0.4 %青岛: 1.0 %青岛: 1.0 %其他其他Falls ChurchMoscowRochester上海东莞六安北京南京南昌南通南阳厦门合肥周口哥伦布商丘嘉兴圣地亚哥大连天津太原宁波宜春宣城布鲁塞尔常州平顶山广州张家口扬州新乡昆明曼谷杭州武汉泸州洛阳济宁淄博深圳温州渭南漯河漳州潍坊烟台珠海益阳石家庄福州秦皇岛绵阳芒廷维尤芝加哥衡水衡阳襄阳西宁西安许昌贵阳赣州赫尔辛基邯郸郑州长沙阿什本青岛

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(7)

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (255) PDF downloads(19) Cited by()
    Proportional views
    Related

    Copyright © Journal of Univeraity of Science and Technology Beijing.京ICP备13030111号

    Address：Room 305, Library, 30 Xueyuan Road, Haidian District, Beijing (100083)   website：https://bkds.ustb.edu.cn/   Tel：010-62334089

    Supported by: Beijing Renhe Information Technology Co. Ltd    

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return