The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information

TANG Lei

Volume 34 Issue 6

May 2021

Turn off MathJax

Article Contents

Abstract

References

Article Navigation > Journal of University of Science and Technology Beijing ( Social Sciences Edition) > 2018 > 34(6): 64-71

TANG Lei. The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(6): 64-71.

Citation:

TANG Lei. The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(6): 64-71.

Citation:

TANG Lei. The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(6): 64-71.

PDF( 1180 KB)

The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information

TANG Lei

Japanese Language and Culture College, Dalian University, Dalian 116622, China

Received Date: 2018-06-19
Available Online: 2021-05-22

Abstract

Abstract

This study employs a Japanese spoken language corpus containing multimodal information to organize and summarize relevant data.An empirical study using attributes such as “laugh,” “rising intonation,” “silence,” and “backchannel” is conducted.A comprehensive analysis of the interaction and practical use of information in multiple forms is implemented.Throughout the process,the value of multimodal information embodied in spoken language corpus is confirmed.
- spoken language corpus,
- The Transcribed Corpus of Japanese Natural Conversation,
- multimodal,
- non-verbal information

FullText(HTML)

References(27)

References

[1]	Allwood, J.Multimodal corpora[A].In Lüdeling, A.,Kytö, M.(eds.).Corpus Linguistics:An International Handbook[C].Berlin:Mouton de Gruyter.2009:207-225.
[2]	文秋芳,王金铨.中国大学生英汉汉英口笔译语料库[M].北京:外语教学与研究出版社,2008.
[3]	黄立波,王克非.语料库翻译学:课题与进展[J].外语教学与研究,2011,43(6):911-924.
[4]	张威.中国口译学习者语料库的副语言标注:标准与程序[J].外语电化教学,2015,(1):23-30.
[5]	刘剑,胡开宝.多模态口译语料库的建设与应用研究[J].中国外语,2015,12(5):1-18.
[6]	王跃龙.汉语口语互动分级语料库的构建[J].计算机工程与科学,2016,38(2):395-400.
[7]	Gu,Y.Multimodal text analysis:a corpus linguistic approach to situated discourse[J].Text and Talk,2006(2):127-167.
[8]	Gu,Y.From real-life situated discourse to video-stream data-mining:an argument for agent-oriented modeling for multimodal corpus compilation[J].International Journal of Corpus Linguistics, 2009,14(4):433-466.
[9]	顾曰国.论言思情貌整一原则与鲜活话语研究——多模态语料库语言学方法[J].当代修辞学,2013,(6):1-18.
[10]	朱永生.多模态话语分析的理论基础与研究方法[J].外语学刊,2007,(5):82-86.
[11]	何山燕.国内多模态话语分析研究述评[J].重庆文理学院学报(社会科学版),2011,30(3):153-157.
[12]	冯德正,张德禄,Kay O'Halloran.多模态语篇分析的进展与前沿[J].当代语言学,2014,16(1):88-99.
[13]	宋红波,王雪利.近十年国内语料库语言学研究综述[J].山东外语教学,2013,(3):41-47.
[14]	Martin, J.C., Paggio, P., Kuehnlein, P., Stiefelhagen,R.&F.Pianesi.Introduction to the special issue on multimodal corpora for modeling human multimodalbehavior[J].Language Resources and Evaluation, 2008,42(2):253-264.
[15]	Pessentheiner, H., Pichler, T. & Hagmuller, M.AMISCO:The austrian german multi-sensor corpus[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016)[C].Portorož:European Language Resources Association(ELRA).2016:760-766.
[16]	Hough,J.et al.DUEL:A multi-lingual multimodal dialogue corpus for disfluency,exclamations and laughter[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016)[C].Portorož:European Language Resources Association(ELRA).2016:1784-1788.
[17]	Götze, J.& J.Boye.SPACEREF:A corpus of street-level geographic descriptions[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016) [C].Portorož:European Language Resources Association(ELRA).2016:3822-3827.
[18]	Den, Y.& Enomoto,M.A scientific approach to conversa-tional informatics:description, analysis, and modeling of human conversation[A].In Nishida, T.(ed.) Conversational Informatics: An Engineering Approach[C].Hoboken, NJ:John Wiley& Sons.2007:307-330.
[19]	Yamamoto, S., Taguchi, K., Ijuin, K., Umata, I.&Nishida, M. Multimodal corpus of multiparty conversations in L1 and L2 languages and findings obtained from it[J].Lang Resources& Evaluation.2015,49(4):857-882.
[20]	Okada, S., Hang, M.& Nitta,K.Predicting performance of collaborative storytelling using multimodal analysis[J].IEICE TRANSACTIONS on Information and Systems,2016,99(6):1462-1473.
[21]	泉子·K·メイナード.会話分析[M].東京,くろしお出版.1993.
[22]	Tench,P.Intonation and the differentiation of syntactic patterns in English and German[J].International Journal of Applied Linguistics,2010,6(2):223-256.
[23]	[俄]H.C.特鲁别茨柯依.音位学原理[M].杨衍春译.桂林:广西师范大学出版社,2015.(原著于1960年出版).
[24]	Den, Y., Koiso, H., Takanashi, K.& Yoshida,N.Annotation of response tokens and their triggering expressions in Japanese multi-party conversations[A].International Conference on Language Resources&Evaluation(LREC 2012)[C].Istanbul:European Language Resources Association(ELRA).2012,(1):1332-1337.
[25]	Robertson, S.M.C.& Hopko,D.R.Emotional expression during autobiographical narratives as a function of aging:support for the socioemotional selectivity theory[J].Journal of Adult Development, 2013,20(2):76-86.
[26]	Carstensen, L.L.& Charles,S.T.Emotion in the second half of life[J].Current Directions in Psychological Science, 1998,7(5):144-149.
[27]	Romaine,S.The Language of Children and Adolescents[M].Hoboken, NJ:Blackwell.Publishers,1984.

Relative Articles

[1]	HAN Yanfang. Corpus-based Study on the Levels of Multimodal Affordance Transformations: From the Perspective of Context Transfer[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2024, 40(6): 60-70. doi: 10.19979/j.cnki.issn10082689.2023100109
[2]	WANG Yi, ZHANG Rui-e, HAN Ming-li. Disciplinary Relevance of Corpus Translation Studies: Categories, Theories and Trends[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2022, 38(5): 552-562. doi: 10.19979/j.cnki.issn10082689.2021090023
[3]	WU Yuan-zheng, FENG De-zheng. The Attitudinal Meaning and Value Construction in Multimodal Ecological Discourse[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2022, 38(6): 677-684. doi: 10.19979/j.cnki.issn10082689.2022100139
[4]	LIU Yan. The Construction of Ecological Features of Environmental Discourse: As Exemplified in the “China Daily News Corpus of Climate Change”[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2021, 37(3): 254-263.
[5]	ZENG Lei, ZHU Xin-yu. The Realization of Ideational Meaning of Multimodal Projection in Sinology Comics[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2020, 36(6): 1-9.
[6]	HAN Ying. Media Literacy Education Based on Multiliteracies Theory[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2019, 35(3): 49-55.
[7]	YANG Zi. New Trends in the Study of Corpus-based Pragmatics: A Review of Yearbook of Corpus Linguistics and Pragmatics 2015[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(1): 26-29.
[8]	ZHAO Liang. Comparison of Rules and Competition Model and Words and Rules Model[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2017, 33(4): 32-37.
[9]	XIAO Hao-zhang, LIU Yu-ting. The Effects of Audio and Video Modalities on Business English Majors'Listening Comprehension[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2017, 33(6): 19-24.
[10]	HUANG Li-he. Situated Discourse and Multimodal Studies: Significance, Theory and Methodology[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2016, 32(5): 29-36.
[11]	LIANG Xiao-hui, SUN Kai-meng. A Cognitive Multimodal Teaching Model for Writing of English Expository Articles: Color Terms[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2016, 32(5): 14-22.
[12]	ZHANG Dan-dan. A Corpus-based Study on Nominalizations in Argumentative Essays of Chinese EFL Learners[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2015, 31(1): 21-27.
[13]	YU Chang-li, LUO Yi. Corpora-based SFL Contrastive Study on English Extended Numeratives and Chinese Numeral + Measure Configuration[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2014, 30(4): 37-45.
[14]	QIAN Duo-xiu, LUO Yuan. Corpus-based Comparative Study of Moves in the Abstracts of Research Papers[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2014, 30(2): 12-17.
[15]	ZHAO Xiu-feng, LI Xiao-wei. The Multimodal Metonymic Construction of Emotion in The Rainbow of Time: A Perspective of Cognitive Poetics[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2014, 30(6): 1-7,58.
[16]	ZHOU Qi-feng. Analysis of Image-Text Relations in English Picture Book and Its Implications With Little Red Riding Hood as an Example[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2014, 30(5): 22-27.
[17]	YANG Xin-zhang. Text-image Relations in Learner's English-Chinese Dictionaries[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2012, 28(4): 45-51.
[18]	TANG Qing-ye. The Multimodal Representation of Poverty[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2012, 28(4): 60-66.
[19]	LI Li. Paraphrasing Humor in Multi-modality[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2012, 28(4): 52-59.
[20]	CHEN Yu-min. Multimodal Construal of Appraisal: A Case Study of Olympics Television Public Service Advertising[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2008, 24(3): 108-114.