The Application of a Spoken Language Corpus Based on Information Embodied in Conversations: Practical Use and Evaluation of Attributes and Multimodal Information
-
摘要: 文章以收录了多模态信息的口语语料库作为研究对象,对成熟的日语口语语料库进行了详细的分析。通过对对话中“笑声”的出现方式及特征进行实例分析,结合属性信息、对话特征信息、语调变化、沉默等数据,对口语语料库中多种信息的相互关联及活用方法进行了探讨。在此过程中,对口语语料库中多模态信息的科研价值进行了验证。
-
关键词:
- 口语语料库 /
- 日本自然会话转写语料库 /
- 多模态 /
- 非语言信息
Abstract: This study employs a Japanese spoken language corpus containing multimodal information to organize and summarize relevant data.An empirical study using attributes such as “laugh,” “rising intonation,” “silence,” and “backchannel” is conducted.A comprehensive analysis of the interaction and practical use of information in multiple forms is implemented.Throughout the process,the value of multimodal information embodied in spoken language corpus is confirmed. -
[1] Allwood, J.Multimodal corpora[A].In Lüdeling, A.,Kytö, M.(eds.).Corpus Linguistics:An International Handbook[C].Berlin:Mouton de Gruyter.2009:207-225. [2] 文秋芳,王金铨.中国大学生英汉汉英口笔译语料库[M].北京:外语教学与研究出版社,2008. [3] 黄立波,王克非.语料库翻译学:课题与进展[J].外语教学与研究,2011,43(6):911-924. [4] 张威.中国口译学习者语料库的副语言标注:标准与程序[J].外语电化教学,2015,(1):23-30. [5] 刘剑,胡开宝.多模态口译语料库的建设与应用研究[J].中国外语,2015,12(5):1-18. [6] 王跃龙.汉语口语互动分级语料库的构建[J].计算机工程与科学,2016,38(2):395-400. [7] Gu,Y.Multimodal text analysis:a corpus linguistic approach to situated discourse[J].Text and Talk,2006(2):127-167. [8] Gu,Y.From real-life situated discourse to video-stream data-mining:an argument for agent-oriented modeling for multimodal corpus compilation[J].International Journal of Corpus Linguistics, 2009,14(4):433-466. [9] 顾曰国.论言思情貌整一原则与鲜活话语研究——多模态语料库语言学方法[J].当代修辞学,2013,(6):1-18. [10] 朱永生.多模态话语分析的理论基础与研究方法[J].外语学刊,2007,(5):82-86. [11] 何山燕.国内多模态话语分析研究述评[J].重庆文理学院学报(社会科学版),2011,30(3):153-157. [12] 冯德正,张德禄,Kay O'Halloran.多模态语篇分析的进展与前沿[J].当代语言学,2014,16(1):88-99. [13] 宋红波,王雪利.近十年国内语料库语言学研究综述[J].山东外语教学,2013,(3):41-47. [14] Martin, J.C., Paggio, P., Kuehnlein, P., Stiefelhagen,R.&F.Pianesi.Introduction to the special issue on multimodal corpora for modeling human multimodalbehavior[J].Language Resources and Evaluation, 2008,42(2):253-264. [15] Pessentheiner, H., Pichler, T. & Hagmuller, M.AMISCO:The austrian german multi-sensor corpus[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016)[C].Portorož:European Language Resources Association(ELRA).2016:760-766. [16] Hough,J.et al.DUEL:A multi-lingual multimodal dialogue corpus for disfluency,exclamations and laughter[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016)[C].Portorož:European Language Resources Association(ELRA).2016:1784-1788. [17] Götze, J.& J.Boye.SPACEREF:A corpus of street-level geographic descriptions[A].Proceedings of the Tenth International Conference on Language Resources and Evaluation(LREC 2016) [C].Portorož:European Language Resources Association(ELRA).2016:3822-3827. [18] Den, Y.& Enomoto,M.A scientific approach to conversa-tional informatics:description, analysis, and modeling of human conversation[A].In Nishida, T.(ed.) Conversational Informatics: An Engineering Approach[C].Hoboken, NJ:John Wiley& Sons.2007:307-330. [19] Yamamoto, S., Taguchi, K., Ijuin, K., Umata, I.&Nishida, M. Multimodal corpus of multiparty conversations in L1 and L2 languages and findings obtained from it[J].Lang Resources& Evaluation.2015,49(4):857-882. [20] Okada, S., Hang, M.& Nitta,K.Predicting performance of collaborative storytelling using multimodal analysis[J].IEICE TRANSACTIONS on Information and Systems,2016,99(6):1462-1473. [21] 泉子·K·メイナード.会話分析[M].東京,くろしお出版.1993. [22] Tench,P.Intonation and the differentiation of syntactic patterns in English and German[J].International Journal of Applied Linguistics,2010,6(2):223-256. [23] [俄]H.C.特鲁别茨柯依.音位学原理[M].杨衍春译.桂林:广西师范大学出版社,2015.(原著于1960年出版). [24] Den, Y., Koiso, H., Takanashi, K.& Yoshida,N.Annotation of response tokens and their triggering expressions in Japanese multi-party conversations[A].International Conference on Language Resources&Evaluation(LREC 2012)[C].Istanbul:European Language Resources Association(ELRA).2012,(1):1332-1337. [25] Robertson, S.M.C.& Hopko,D.R.Emotional expression during autobiographical narratives as a function of aging:support for the socioemotional selectivity theory[J].Journal of Adult Development, 2013,20(2):76-86. [26] Carstensen, L.L.& Charles,S.T.Emotion in the second half of life[J].Current Directions in Psychological Science, 1998,7(5):144-149. [27] Romaine,S.The Language of Children and Adolescents[M].Hoboken, NJ:Blackwell.Publishers,1984.
点击查看大图
计量
- 文章访问数: 260
- HTML全文浏览量: 36
- PDF下载量: 12
- 被引次数: 0