The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information

TANG Lei

May 2021

Article Contents

Article Navigation > Journal of University of Science and Technology Beijing ( Social Sciences Edition) > 2018 > 34(6): 64-71

TANG Lei. The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(6): 64-71.

Citation:

TANG Lei. The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(6): 64-71.

Citation:

TANG Lei. The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information[J]. Journal of University of Science and Technology Beijing ( Social Sciences Edition), 2018, 34(6): 64-71.

PDF( 1180 KB)

The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information

TANG Lei

Japanese Language and Culture College, Dalian University, Dalian 116622, China

Received Date: 2018-06-19
Available Online: 2021-05-22

Abstract

Abstract

This study employs a Japanese spoken language corpus containing multimodal information to organize and summarize relevant data.An empirical study using attributes such as “laugh,” “rising intonation,” “silence,” and “backchannel” is conducted.A comprehensive analysis of the interaction and practical use of information in multiple forms is implemented.Throughout the process,the value of multimodal information embodied in spoken language corpus is confirmed.
- spoken language corpus,
- The Transcribed Corpus of Japanese Natural Conversation,
- multimodal,
- non-verbal information

FullText(HTML)

References(27)

References

[1]	Allwood, J.Multimodal corpora[A].In Lüdeling, A.,Kytö, M.(eds.).Corpus Linguistics:An International Handbook[C].Berlin:Mouton de Gruyter.2009:207-225.
[2]	文秋芳,王金铨.中国大学生英汉汉英口笔译语料库[M].北京:外语教学与研究出版社,2008.
[3]	黄立波,王克非.语料库翻译学:课题与进展[J].外语教学与研究,2011,43(6):911-924.
[4]	张威.中国口译学习者语料库的副语言标注:标准与程序[J].外语电化教学,2015,(1):23-30.
[5]	刘剑,胡开宝.多模态口译语料库的建设与应用研究[J].中国外语,2015,12(5):1-18.
[6]	王跃龙.汉语口语互动分级语料库的构建[J].计算机工程与科学,2016,38(2):395-400.
[7]	Gu,Y.Multimodal text analysis:a corpus linguistic approach to situated discourse[J].Text and Talk,2006(2):127-167.
[8]	Gu,Y.From real-life situated discourse to video-stream data-mining:an argument for agent-oriented modeling for multimodal corpus compilation[J].International Journal of Corpus Linguistics, 2009,14(4):433-466.
[9]	顾曰国.论言思情貌整一原则与鲜活话语研究——多模态语料库语言学方法[J].当代修辞学,2013,(6):1-18.
[10]	朱永生.多模态话语分析的理论基础与研究方法[J].外语学刊,2007,(5):82-86.
[11]	何山燕.国内多模态话语分析研究述评[J].重庆文理学院学报(社会科学版),2011,30(3):153-157.
[12]	冯德正,张德禄,Kay O'Halloran.多模态语篇分析的进展与前沿[J].当代语言学,2014,16(1):88-99.
[13]	宋红波,王雪利.近十年国内语料库语言学研究综述[J].山东外语教学,2013,(3):41-47.
[14]	Martin, J.C., Paggio, P., Kuehnlein, P., Stiefelhagen,R.&F.Pianesi.Introduction to the special issue on multimodal corpora for modeling human multimodalbehavior[J].Language Resources and Evaluation, 2008,42(2):253-264.
[15]	Pessentheiner, H., Pichler, T. & Hagmuller, M.AMISCO:The austrian german multi-sensor corpus[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016)[C].Portorož:European Language Resources Association(ELRA).2016:760-766.
[16]	Hough,J.et al.DUEL:A multi-lingual multimodal dialogue corpus for disfluency,exclamations and laughter[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016)[C].Portorož:European Language Resources Association(ELRA).2016:1784-1788.
[17]	Götze, J.& J.Boye.SPACEREF:A corpus of street-level geographic descriptions[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016) [C].Portorož:European Language Resources Association(ELRA).2016:3822-3827.
[18]	Den, Y.& Enomoto,M.A scientific approach to conversa-tional informatics:description, analysis, and modeling of human conversation[A].In Nishida, T.(ed.) Conversational Informatics: An Engineering Approach[C].Hoboken, NJ:John Wiley& Sons.2007:307-330.
[19]	Yamamoto, S., Taguchi, K., Ijuin, K., Umata, I.&Nishida, M. Multimodal corpus of multiparty conversations in L1 and L2 languages and findings obtained from it[J].Lang Resources& Evaluation.2015,49(4):857-882.
[20]	Okada, S., Hang, M.& Nitta,K.Predicting performance of collaborative storytelling using multimodal analysis[J].IEICE TRANSACTIONS on Information and Systems,2016,99(6):1462-1473.
[21]	泉子·K·メイナード.会話分析[M].東京,くろしお出版.1993.
[22]	Tench,P.Intonation and the differentiation of syntactic patterns in English and German[J].International Journal of Applied Linguistics,2010,6(2):223-256.
[23]	[俄]H.C.特鲁别茨柯依.音位学原理[M].杨衍春译.桂林:广西师范大学出版社,2015.(原著于1960年出版).
[24]	Den, Y., Koiso, H., Takanashi, K.& Yoshida,N.Annotation of response tokens and their triggering expressions in Japanese multi-party conversations[A].International Conference on Language Resources&Evaluation(LREC 2012)[C].Istanbul:European Language Resources Association(ELRA).2012,(1):1332-1337.
[25]	Robertson, S.M.C.& Hopko,D.R.Emotional expression during autobiographical narratives as a function of aging:support for the socioemotional selectivity theory[J].Journal of Adult Development, 2013,20(2):76-86.
[26]	Carstensen, L.L.& Charles,S.T.Emotion in the second half of life[J].Current Directions in Psychological Science, 1998,7(5):144-149.
[27]	Romaine,S.The Language of Children and Adolescents[M].Hoboken, NJ:Blackwell.Publishers,1984.