Kyushu University [Miharu Fuyuno (Associate Professor) Faculty of Design, Department of Media Design]

Books

1.

Miharu Fuyuno, Using Immersive Virtual Environment for Educational Purposes. In K. Tsuchiya, F. Coffey & K. Nakamura (Eds.), Multimodal Approaches to Healthcare Communication Research: Visualising Interactions for Resilient Healthcare in the UK and Japan. , Bloomsbury Publishing, Chapter 11 (pp. 173-193),, 2023.03, This chapter aims to review the application of immersive Virtual Reality (VR) technology for educational purposes and discuss how multimodal analysis can be effective for the development of educational materials utilizing Extended Reality (XR) technologies such as VR and AR. One example is the soon-to-be-introduced VR system for training in public speaking, which was developed based on the research outcomes of the Kyushu University Multimodal Corpus Analysis project (Fuyuno 2020, 2021; Fuyuno and Yamashita 2020). The method we developed through the process of the VR system project is applicable to healthcare and medical education. The last section of this chapter reviews the current applications of XR technology in
medical education and explores the future prospects for the application of XR based on multimodal analyses in education in medicine and other fields..

2.

Miharu Fuyuno, Yamashita Yuko, Yoshitaka Nakajima, Input a Word, Analyse the World.-Selected Approaches to Corpus Linguistics, Cambridge Scholars Publishing, Chapter 29: Multimodal Corpora of English Public Speaking by Asian Learners: Analyses on Speech Rate, Pause and Head Gesture, 2016.01.

Papers

Show All Papers >>

1.	Keiko Tsuchiya, Frank Coffey, Kyota Nakamura, Andrew Mackenzie, Sarah Atkins, Małgorzata Chałupnik, Alison Whitfield, Takuma Sakai, Stephen Timmons, Takeru Abe, Takeshi Saitoh, Akira Taneichi, Mike Vernon, David Crundall, Miharu Fuyuno, Action request episodes in trauma team interactions in Japan and the UK - A multimodal analysis of joint actions in medical simulation, Journal of Pragmatics, https://doi.org/10.1016/j.pragma.2022.04.009, 194, 101-118, 2022.05, Grounding is a fundamental human practice for cooperation and collaboration in a joint activity, when more than two people interact. Emergency care is one such interactive situation, and whether a trauma team can efficiently establish and increment their common ground at an appropriate timing during the complex and fluid activity of emergency medical treatment is key to maximise collective competence to best perform as a trauma team. This article investigates recurrent patterns in the grounding process between the trauma team leader and the members, comparing the practices between Japan and the UK, using an eye-tracking device. The embodied practice of grounding was multimodally described, applying both quantitative multimodal corpus analytic and qualitative interactional linguistic approaches. The analysis has shown that five grounding episodes reoccurred, most of which were more ego-centric and one of them ba-centric interactions, drawing on intersubjectivity and the theory of ba in Western and Eastern philosophy respectively..
2.	Fuyuno, M., Development of 3D Computer Graphics Avatars for VR Communication Education System based on Gesture Unit Analysis, Proceedings of International Conference for Media in Education 2021, 303-308, 2021.08.
3.	Blanco, L. M. C., Fuyuno, M., & Tomotari, M., Immersive 360-degree video as a medium for teacher-led VR material development, Proceedings of The Japan Association for Language Education and Technology (LET) 60th Annual National Conference, 176-177, 2021.08.
4.	Naoya Kuwamura, Miharu Fuyuno, Riichi Yoshimura, Application of Gamification to Online Survey Forms: Development of Digital Template System “Bingo Survey” and Evaluation, NICOINT 2021, 10.1109/NICOINT52941.2021.00019, 62-69, 2021.07.
5.	Kaito Yamamoto, Kyosuke Hamasaki, Laura Maria Cortes Blanco, Miharu Fuyuno, Examination of Two Types of Visual Information Emphasis Methods: Towards Effective Presentation, Proceedings of International Conference for Media in Education 2020, 156-158, 2020.08.
6.	Laura Maria Cortes Blanco, Miharu Fuyuno, Immersive video materials for standardized English-speaking tests: Development and ongoing application, Proceedings of International Conference for Media in Education 2020, 213-220, 2020.08.
7.	Miharu Fuyuno, Development and Evaluation of 360-degree VR Training System for English Public Speaking: Cross-analysis with Participants' Proficiency, Proceedings of International Conference for Media in Education 2020, 179-186, 2020.08.
8.	Fuyuno, M., Saitoh, T., Yamashita, Y., & Yokomori, D. , Gaze-Point Analysis of EFL Learners while Watching English Presentations: Toward Effective Teaching, International Journal for Educational Media and Technology, 14, 1, 1-12, 2020.06.
9.	Fuyuno, M., Komiya, R., and Saitoh, T., Multimodal analysis of public speaking performance by EFL learners: Applying deep learning to understanding how successful speakers use facial movement, The Asian Journal of Applied Linguistics, 4, 3, 2018.03, Although multimodal corpus analysis has been widely practiced in the field of applied linguistics, few studies have investigated performance of English public speaking by EFL learners. Needs for effective public speaking are fundamental in the globalizing society; however, performing public speaking in English is challenging for EFL learners, and objective analysis on factors of eye contact and speech pauses still remain few though such information is crucial in efficient teaching. This study analyses public speaking performance by EFL learners based on data from a multimodal corpus. Data were collected in an annual speech contest at a Japanese high school. Speakers presented English speeches to an audience and judges. The data consist of video and digital audio recordings of performance, as well as speech scripts and evaluation scores by contest judges. Characteristics of speakers’ facial movement patterns in regard to spoken contents and the correlation between facial movements and eye movements were examined. Facial and eye movements were detected with motion tracking and the deep learning method. The results indicated that facial direction changes were not synchronized with speech pauses among highly evaluated speakers. Furthermore, the facial direction changes tended to be synchronized with content words in the spoken utterance rather than function words..
10.	Fuyuno, M., Yamashita, Y., Nakajima, Y., The effect of virtual eyes on psychological nervousness of public speakers, Proceedings of the 33rd Annual Meeting of the International Society for Psychophysics 128-131, 128-131, 2017.11.
11.	Fuyuno, M., An Investigation into the Influence of Domestic and Foreign Cosmetics Advertisements in Thailand: Evaluation of Subjective Impression by SD Method, Linguistic Science, 52, 47-59, 2017.03.
12.	Komiya, R., Saitoh, T., Fuyuno, M., Yamashita, Y., Nakajima, Y., Head pose estimation and motion analysis of public speaking videos, International Journal of Software Innovation, 5, 1, 57-71, 2017.01.
13.	Fuyuno, M., Yamashita, Y., Saitoh, T., Nakajima, Y., Semantic Structure, Speech Units and Facial Movements: Multimodal Corpus Analysis of English Public Speaking, EPiC Series in Language and Linguistics, 1, 447, 2016.11.
14.	Blanco, L. M. C., Fuyuno, M., Development of an Interactive Multimedia Spanish Learning Application with a Focus on Authentic Material, Proc. of SAI Joint International Conference, 2016.09.
15.	Komiya, R., Saitoh, T., Fuyuno, M., Yamashita, Y., Nakajima, Y., Head pose estimation and movement analysis for speech scene, Proc. of 15th IEEE/ACIS International Conference on Computer and Information Science, 409-413, 2016.07.
16.	Miharu Fuyuno, Comparative analyses of Japanese learners' self-evaluation and judges' evaluation of English public speaking : Identifying primary targets for practical teaching of multimodal speaking skills (招待採録), Collected articles on the English language, 48, 2016.04.
17.	Miharu Fuyuno, Rote Learning in English Education for Japanese Students : towards more Context-Oriented Multimedia Material (招待採録), Collected articles on the English language, 48, 2016.04.
18.	Yamashita Yuko, Miharu Fuyuno, Three Aspects of Public Speeches with Competent Speakers: Speech Pauses, Head Movements, and Lexical Choices, International STEM Journal, 5, 215-231, 2015.12.
19.	Yamashita Yuko, Miharu Fuyuno, アメリカの大学の卒業式における著名人による祝辞スピーチの録画映像の分析：音声の無音区間と顔上げ動作, ATEM Journal, 20, 33-44, 2015.03.
20.	Miharu Fuyuno, Hiroki Shimokawara, I-Ting Chuang, Pei-ru Lin, Washback Effects on Language Learning Motivation: A Comparison between Taiwanese and Jaanese Learners, Selected Papers from the International Symposium on English Teaching, 23, 223-241, 2014.11.
21.	Miharu Fuyuno, Yamashita Yuko, Yoshikiyo Kawase, Yoshitaka NAKAJIMA, Analyzing Speech Pauses and Facial Movement Patterns in Multimodal Public-Speaking Data of EFL Learners, Learner Corpus Studies in Asia and the World, 2, XX-XX, (13 pages), 2014.05.
22.	Miharu Fuyuno, Negative Washback Effects of Japanese Standardized University Entrance Examination: Reflections for Effective First-year Education (in print), Quest : studies in English linguistics and literature, 20, 1-21, 2014.03.
23.	Miharu Fuyuno, Nanae Hama, Joseph Myall, Naomi Yukimaru, Effects of English recitation for Japanese EFL learners: towards multi-modal English speaking skills education, Annual Review of Language Learning and Teaching, 4, 2014.03.
24.	Miharu Fuyuno, The Usage of Psychological Passives in Spoken and Written English: A Corpus-based Analysis and Implications for English Language Teaching, Procedia - Social and Behavioral Sciences , 95, 184-194, 2013.11.
25.	Miharu Fuyuno, English passives with psychological verbs: Application of corpora in ELT , 日本人英語学習者の概念構造に関する統計的研究, 39-53, 2012.02.
26.	Miharu Fuyuno, Use of passives with psychological verbs: Comparison between native speakers of English and Japanese EFL learners, the 44th annual meeting of BAAL, 44, 37-37, 2011.09.

Works, Software and Database

1.

.

Presentations

Show All Presentations >>

1.	Andrew Mackenzie, Keiko Tsuchiya, Mike Vernon, James Myers, Frank Coffey, Douglas Craig, Miharu Fuyuno, Hitoshi Sato, Kyota Nakamura, Akira Taneichi, Takeru Abe, David Crundall, Cross cultural validation of the “What Happens Next” situation awareness tool in emergency medicine, Royal College of Emergency Medicine Annual Scientific Conference 2023 (RCEM2023), 2023.09, Internationally, computer and video-based interventions have been found to be effective methods for training and assessment in medicine. Though, many target only knowledge-based learning. In emergency medicine settings, medical personnel must also have an understanding of the ever-changing environment, be able to make real-time decisions and make predictions; complex cognitive skills akin to “situation awareness”. Across three studies, we aimed to create and validate a novel measure that assessed this type of cognitive skill in emergency medicine. The first study was a proof-of-concept study that demonstrated that a freeze-frame question probe style technique of assessment (such as that used in the SAGAT) was a useful paradigm for use within trauma settings. Importantly, it was found that simple knowledge-based questions were not sensitive enough to discriminate between inexperienced and experienced medical trauma personnel. In the second study, a simulated trauma scenario was filmed using a 360-degree camera. Using the theoretical framework of the three-level situation awareness concept, prediction-based questions of “What Happens Next” were edited into the footage. To validate the tool, its ability to discriminate performance between novice, inexperienced and experienced trauma team members was examined where participants had to, at various points, correctly identify “what happens next” based on the events in the scenario. It was found that experienced personnel outperformed inexperienced who, in turn, outperformed novice trauma team members. Thus, highlighting that this tool may be a successful tool in targeting specific trauma leader knowledge/understanding that experienced or expert personnel possess. In Study 3, we aimed to replicate the findings within a Japanese hospital setting to provide evidence of cross-cultural validation for this type of assessment tool. The results were replicated. Together, the findings provide the first evidence of a theoretically-driven and cross-culturally validated tool that may assess an individual’s level of complex cognitive skill in emergency medicine..
2.	Fuyuno, M., Development and effect verification of immersive virtual reality (VR) presentation training system for Japanese office workers: toward effective presentation skills, TAW2023 (Panel: How AI is revolutionizing communication)(p. 123), 2023.05.
3.	Blanco, L. M. C. & Fuyuno, M., Pedagogical applications of interactive virtual reality technology: Examples from language education and medical technique instruction, The 2nd International Workshop on Health Communication and Safety, 2023.03.
4.	Miharu Fuyuno, Application of Results from Multimodal Analysis to VR-based Medical Education, 6th ESTIDIA Conference, 2022.06.
5.	Miharu Fuyuno, Applying Immersive Virtual Reality Technology for ELT, Invited Talk at The British Association of Lecturers in English for Academic Purposes (Technology -Enhanced Learning (TEL) SIG), 2021.05, This talk introduces examples of the application of VR for ELT. As technological tools become more embedded in our daily lives, Computer-Assisted Language Learning (CALL) has also become an essential part of language education. One of the most recent technological tools to become widely available is Virtual Reality (VR). In the past decade, emerging VR research has demonstrated that VR tools can provide advantages such as cognitive and affective skills acquisition, intuitive interaction, and the chance to experience situations that are usually unavailable. Dr Miharu Fuyuno will introduce her research project about a 360-degree VR speech training system for English learners. The system provides an authentic public speaking environment for self-practice of English speeches and presentations. Learners can feel as if they are in front of the audience by 360-degree virtual venue and virtual audience..
6.	Miharu Fuyuno, Takeshi Saitoh, Multimodal Corpus Analysis of English Presentations for EFL teaching: Speech Contents, Speakers’ Behavior and Gaze Points of Audience, pp. 22-23. 12th International Conference on Corpus Linguistics (CILC2021), 2021.04.
7.	Miharu FUYUNO, Development of immersive virtual reality material for training English speech, The HKCPD International Conference 2021, 2021.01.
8.	Yuko Yamashita, Miharu Fuyuno, Yoshitaka Nakajima, Stanislava Antonijevic-Elliott, Mark A. Elliott Sophia Arndt, A quantitative analysis to characterize verbal and non-verbal behavior in public speaking performance, 35th Annual Meeting of the International Society for Psychophysics, 2019.10.
9.	Laura Maria Cortes Blanco, Miharu Fuyuno, The application of 360-degree video as a tool for standardized language testing material, 2019 Conference of Foreign Language Education and Technology (FLEAT) VII, 2019.08.
10.	Fuyuno, M., Yamashita, Y., Nakajima, Y., The effect of virtual eyes on psychological nervousness of public speakers, The 33rd Annual Meeting of the International Society for Psychophysics , 2017.10.
11.	Laura, M. C. B., Fuyuno, M., Comparing the effectiveness of a multimedia learning application using authentic and non-authentic cultural material for Spanish as a Foreign Language, 57th National Conference of Language Education and Technology, 2017.08.
12.	Fuyuno, M., Komiya, R., Saitoh, T., Analyzing Public Speaking for EAP Pedagogy: Factors of Better Performance, Faces of English 2: Teaching and Researching Academic and Professional English, 2017.06.
13.	Fuyuno, M., Blanco, L. M. C., Development of a multimedia Spanish language learning application: based on ADDIE model and Unity 3D platform, 56th National Conference of Language Education and Technology, 2016.08.
14.	Fuyuno, M., Yamada, Y., Yamashita, Y., Yoshitaka NAKAJIMA, Developing effective instructions to decrease Japanese speaker' s nervousness during English and Japanese public speeches: Evidence from psychological and physiological measurements, 31st International Congress of Psychology 2016 (ICP2016), 2016.07.
15.	Fuyuno, M., Yamashita, Y., Saitoh, T., Nakajima, Y., Multimodal Corpus Approach to Speech Psychology: The Effect of Public Speakers’ Facial Movements on Audience Reception , 31st International Congress of Psychology 2016 (ICP2016) , 2016.07.
16.	Miharu Fuyuno, Yamashita Yuko, Takeshi Saitoh, Yoshitaka Nakajima, Semantic Structure, Speech Units and Facial Movements: Multimodal Corpus Analysis of English Public Speaking, 8th International Conference on Corpus Linguistics, 2016.03.
17.	Miharu Fuyuno, Analysis and application of multimodal corpora of English public speaking by EFL learners: Toward evidence-based teaching, International Conference on Corpus Linguistics and Technology Advancement 2015, 2015.12.
18.	Miharu Fuyuno, Yamashita Yuko, Yoshitaka NAKAJIMA, Head movements and speech pause insertion patterns in English public speaking performances: Investigation on a multimodal corpus data of Asian EFL learners, 7th International Conference on Corpus Linguistic, 2015.03.
19.	Fuyuno, M., Shimokawara, H., Chuang, I. T., Lin, P. R., Washback Effects on Language Learning Motivation: A Comparison between Taiwanese and Japanese Learners, The 23rd International Symposium and Book Fair on English Teaching, 2014.11.
20.	Miharu Fuyuno, Yamashita Yuko, Yoshitaka NAKAJIMA, Multimodal Corpora of English Public Speaking by Asian Learners: Analyses on Speech Rates and Pauses , The 6th International Conference on Corpus Linguistics, 2014.05.
21.	Miharu Fuyuno, Yamashita Yuko, Yoshikiyo Kawase, Yoshitaka NAKAJIMA, Analyzing Speech Pauses and Facial Movement Patterns in Multimodal Public-Speaking Data of EFL Learners, The Learner Corpus Studies Asia and the World Sympodium 2014, 2014.05.
22.	Miharu Fuyuno, The Intersection between Corpora and Cognitive Linguistics: towards Dynamic/Static Scaling of English Passive Construction (査読有り), Second Asia Pacific Corpus Linguistics Conference (APCLC2014) , 2014.03.
23.	Miharu Fuyuno, Cognitive linguistics meets corpora: Examples of human spatial cognition reflected in English language , The 11th Perceptual Frontier Seminar , 2014.01.
24.	Miharu Fuyuno, The usage of psychological passives in spoken and written English: A corpus-based comparative analysis and implications for ELT , The 5th International conference on corpus linguistics, 2013.03.
25.	Miharu Fuyuno, Use of passives with psychological verbs: Comparison between native speakers of English and Japanese EFL learners, Annual Meeting of BAAL , 2011.09.