2026/08/27 更新

お知らせ

 

写真a

シヨウ トウ
XIAO TAO
XIAO TAO
所属
システム情報科学研究院 情報知能工学部門 助教
職名
助教

論文

  • Self-Admitted GenAI Usage in Open-Source Software 査読

    Xiao, T; Fan, YM; Calefato, F; Treude, C; Kula, RG; Hata, H; Baltes, S

    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING   52 ( 6 )   1891 - 1910   2026年6月   ISSN:0098-5589 eISSN:1939-3520

     詳細を見る

    担当区分:筆頭著者   出版者・発行元:IEEE Transactions on Software Engineering  

    The widespread adoption of generative AI (GenAI) tools such as GitHub Copilot and ChatGPT is transforming software development. Since generated source code is virtually impossible to distinguish from manually written code, their real-world usage and impact on open-source software (OSS) development remain poorly understood. In this paper, we introduce the concept of self-admitted GenAI usage, that is, developers explicitly referring to the use of GenAI tools for content creation in software artifacts. Using this concept as a lens to study how GenAI tools are integrated into OSS projects, we analyze a curated sample of more than 200,000 GitHub repositories, identifying 1,292 such self-admissions across 156 repositories in commit messages, code comments, and project documentation. Using a mixed methods approach, we derive a taxonomy of 32 tasks, 10 content types, and 11 purposes associated with GenAI usage based on 1,292 qualitatively coded mentions. We then analyze 13 documents with policies and usage guidelines for GenAI tools and conduct a developer survey to uncover the ethical, legal, and practical concerns behind them. Our findings reveal that developers actively manage how GenAI is used in their projects, highlighting the need for project-level transparency, attribution, and quality control practices in AI-assisted software development. Finally, we examine the longitudinal impact of GenAI adoption on code churn in 151 repositories with self-admitted GenAI usage and find no general increase, contradicting popular narratives on the impact of GenAI on software development.

    DOI: 10.1109/TSE.2026.3681886

    Web of Science

    Scopus

  • Cross-Project Flakiness: A Case Study of the OpenStack Ecosystem 査読

    Xiao, T; Wang, D; McIntosh, S; Hata, H; Kamei, Y

    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING   52 ( 6 )   1875 - 1890   2026年6月   ISSN:0098-5589 eISSN:1939-3520

     詳細を見る

    担当区分:筆頭著者   出版者・発行元:IEEE Transactions on Software Engineering  

    Automated regression testing is a cornerstone of modern software development, often contributing directly to code review and Continuous Integration (CI). Yet some tests suffer from flakiness, where their outcomes vary non-deterministically. Flakiness erodes developer trust in test results, wastes computational resources, and undermines CI reliability. While prior research has examined test flakiness within individual projects, its broader ecosystem-wide impact remains largely unexplored. In this paper, we present an empirical study of test flakiness in the OpenStack ecosystem, which focuses on (1) cross-project flakiness, where flaky tests impact multiple projects, and (2) inconsistent flakiness, where a test exhibits flakiness in some projects but remains stable in others. By analyzing 649 OpenStack projects, we identify 1,535 cross-project flaky tests and 1,105 inconsistently flaky tests. We find that cross-project flakiness affects 55% of OpenStack projects and significantly increases both review time and computational costs. Surprisingly, 70% of unit tests exhibit cross-project flakiness, challenging the assumption that unit tests are inherently insulated from issues that span modules like integration and system-level tests. Through qualitative analysis, we observe that race conditions in CI, inconsistent build configurations, and dependency mismatches are the primary causes of inconsistent flakiness. These findings underline the need for better coordination across complex ecosystems, standardized CI configurations, and improved test isolation strategies.

    DOI: 10.1109/TSE.2026.3685588

    Web of Science

    Scopus

  • Generative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions 査読

    Tao Xiao, Hideaki Hata, Christoph Treude, Kenichi Matsumoto

    Proceedings of the ACM on Software Engineering   1   2024年7月

     詳細を見る

    担当区分:筆頭著者, 責任著者   記述言語:英語   掲載種別:研究論文(国際会議プロシーディングス)  

    DOI: 10.1145/3643773

    その他リンク: https://tao-xiao.github.io/files/Copilot4PR_FSE_2024.pdf

  • Quantifying and Characterizing Clones of Self-Admitted Technical Debt in Build Systems 査読

    Tao Xiao, Zhili Zeng, Dong Wang, Hideaki Hata, Shane McIntosh & Kenichi Matsumoto

    Empirical Software Engineering   2024年2月

     詳細を見る

    担当区分:筆頭著者, 責任著者   記述言語:英語   掲載種別:研究論文(学術雑誌)  

    DOI: 10.1007/s10664-024-10449-5

    その他リンク: https://arxiv.org/pdf/2402.08920

  • 18 million links in commit messages: purpose, evolution, and decay 査読

    Tao Xiao, Sebastian Baltes, Hideaki Hata, Christoph Treude, Raula Gaikovina Kula, Takashi Ishio & Kenichi Matsumoto

    Empirical Software Engineering   2023年5月

     詳細を見る

    担当区分:筆頭著者, 責任著者   記述言語:英語   掲載種別:研究論文(学術雑誌)  

    DOI: 10.1007/s10664-023-10325-8

    その他リンク: https://tao-xiao.github.io/files/Links_ESE_2023.pdf

  • GitHub sponsors: exploring a new way to contribute to open source 査読 国際共著

    Naomichi Shimada, Tao Xiao, Hideaki Hata, Christoph Treude, Kenichi Matsumoto

    Proceedings of the 44th International Conference on Software Engineering   2022年7月

     詳細を見る

    記述言語:英語   掲載種別:研究論文(国際会議プロシーディングス)  

    DOI: 10.1145/3510003.3510116

    その他リンク: https://arxiv.org/pdf/2202.05751

  • Self-Admitted GenAI Usage in Open-Source Software

    Tao Xiao, Youmei Fan, Fabio Calefato, Christoph Treude, Raula Gaikovina Kula, Hideaki Hata, Sebastian Baltes

    2025年7月

     詳細を見る

    担当区分:筆頭著者   記述言語:英語  

  • How Far Have LLMs Come Toward Automated SATD Taxonomy Construction? 査読

    Nakashima, S; Ishimoto, Y; Kondo, M; Xiao, T; Kamei, Y

    2025 32ND ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE, APSEC   832 - 836   2025年   ISSN:1530-1362 ISBN:979-8-3315-6654-8

     詳細を見る

    出版者・発行元:Proceedings Asia Pacific Software Engineering Conference APSEC  

    Technical debt refers to suboptimal code that degrades software quality. When developers intentionally introduce such debt, it is called self-admitted technical debt (SATD). Since SATD hinders maintenance, identifying its categories is key to uncovering quality issues. Traditionally, constructing such taxonomies requires manually inspecting SATD comments and surrounding code, which is time-consuming, labor-intensive, and often inconsistent due to annotator subjectivity. In this study, we investigate to what extent large language models (LLMs) can generate SATD taxonomies. We designed a structured, LLM-driven pipeline that mirrors the taxonomy construction steps researchers typically follow. We evaluated it on SATD datasets from three domains: quantum software, smart contracts, and machine learning. It successfully recovered domain-specific categories reported in prior work, such as Layer Configuration in machine learning. It also completed taxonomy generation in under two hours and for less than $1, even on the largest dataset. These results suggest that, while full automation remains challenging, LLMs can support semi-automated SATD taxonomy construction. Furthermore, our work opens up avenues for future work, such as automated taxonomy generation in other areas.

    DOI: 10.1109/APSEC66846.2025.00087

    Web of Science

    Scopus

  • AILINKPREVIEWER: Enhancing Code Reviews with LLM-Powered Link Previews 査読

    Trakoolgerntong, P; Xiao, T; Kondo, M; Ragkhitwetsagul, C; Choetkiertikul, M; Sangaroonsilp, P; Kamei, Y

    2025 32ND ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE, APSEC   1021 - 1024   2025年   ISSN:1530-1362 ISBN:979-8-3315-6654-8

     詳細を見る

    出版者・発行元:Proceedings Asia Pacific Software Engineering Conference APSEC  

    Code review is a key practice in software engineering, where developers evaluate code changes to ensure quality and maintainability. Links to issues and external resources are often included in Pull Requests (PRs) to provide additional context, yet they are typically discarded in automated tasks such as PR summarization and code review comment generation. This limits the richness of information available to reviewers and increases cognitive load by forcing context-switching. To address this gap, we present AILINKPREVIEWER, a tool that leverages Large Language Models (LLMs) to generate previews of links in PRs using PR metadata, including titles, descriptions, comments, and link body content. We analyzed 50 engineered GitHub repositories and compared three approaches: Contextual LLM summaries, Non-Contextual LLM summaries, and Metadata-based previews. The results in metrics such as BLEU, BERTScore, and compression ratio show that contextual summaries consistently outperform other methods. However, in a user study with seven participants, most preferred non-contextual summaries, suggesting a trade-off between metric performance and perceived usability. These findings demonstrate the potential of LLM-powered link previews to enhance code review efficiency and to provide richer context for developers and automation in software engineering. The video demo is available at https://www.youtube.com/ watch?v=h2qH4RtrB3E, and the tool and its source code can be found at https://github.com/c4rtune/AILinkPreviewer.

    DOI: 10.1109/APSEC66846.2025.00121

    Web of Science

    Scopus

  • A Mutation-Guided Assessment of Acceleration Approaches for Continuous Integration: An Empirical Study of Yourbase 査読

    Zhili Zeng; Tao Xiao; Maxime Lamothe; Hideaki Hata; Shane McIntosh

    2024 IEEE/ACM 21st International Conference on Mining Software Repositories   2024年7月

     詳細を見る

    記述言語:英語   掲載種別:研究論文(国際会議プロシーディングス)  

    DOI: 10.1145/3643991.3644914

    その他リンク: https://rebels.cs.uwaterloo.ca/papers/msr2024_zeng.pdf

  • “My GitHub Sponsors profile is live!” Investigating the Impact of Twitter/X Mentions on GitHub Sponsors 査読

    Youmei Fan, Tao Xiao, Hideaki Hata, Christoph Treude, Kenichi Matsumoto

    Proceedings of the IEEE/ACM 46th International Conference on Software Engineering   2024年4月

     詳細を見る

    記述言語:英語   掲載種別:研究論文(国際会議プロシーディングス)  

    DOI: 10.1145/3597503.3639127

    その他リンク: https://arxiv.org/pdf/2401.02755

  • More than React: Investigating the Role of Emoji Reaction in GitHub Pull Requests

    Wang, D; Xiao, T; Son, T; Kula, RG; Ishio, T; Kamei, Y; Matsumoto, K

    EMPIRICAL SOFTWARE ENGINEERING   28 ( 5 )   2023年9月   ISSN:1382-3256 eISSN:1573-7616

     詳細を見る

    出版者・発行元:Empirical Software Engineering  

    Open source software development has become more social and collaborative, evident GitHub. Since 2016, GitHub started to support more informal methods such as emoji reactions, with the goal to reduce commenting noise when reviewing any code changes to a repository. From a code review context, the extent to which emoji reactions facilitate a more efficient review process is unknown. We conduct an empirical study to mine 1,850 active repositories across seven popular languages to analyze 365,811 Pull Requests (PRs) for their emoji reactions against the review time, first-time contributors, comment intentions, and the consistency of the sentiments. Answering these four research perspectives, we first find that the number of emoji reactions has a significant correlation with the review time. Second, our results show that a PR submitted by a first-time contributor is less likely to receive emoji reactions. Third, the results reveal that the comments with an intention of information giving, are more likely to receive an emoji reaction. Fourth, we observe that only a small proportion of sentiments are not consistent between comments and emoji reactions, i.e., with 11.8% of instances being identified. In these cases, the prevalent reason is when reviewers cheer up authors that admit to a mistake, i.e., acknowledge a mistake. Apart from reducing commenting noise, our work suggests that emoji reactions play a positive role in facilitating collaborative communication during the review process.

    DOI: 10.1007/s10664-023-10336-5

    Web of Science

    Scopus

  • Understanding the Role of Images on Stack Overflow

    Wang, D; Xiao, T; Treude, C; Kula, RG; Hata, H; Kamei, Y

    2023 IEEE/ACM 20TH INTERNATIONAL CONFERENCE ON MINING SOFTWARE REPOSITORIES, MSR   377 - 388   2023年   ISSN:2160-1852 ISBN:979-8-3503-1184-6

     詳細を見る

    出版者・発行元:Proceedings - 2023 IEEE/ACM 20th International Conference on Mining Software Repositories, MSR 2023  

    Images are increasingly being shared by software developers in diverse channels including question-and-answer forums like Stack Overflow. Although prior work has pointed out that these images are meaningful and provide complementary information compared to their associated text, how images are used to support questions is empirically unknown. To address this knowledge gap, in this paper we specifically conduct an empirical study to investigate (I) the characteristics of images, (II) the extent to which images are used in different question types, and (III) the role of images on receiving answers. Our results first show that user interface is the most common image content and undesired output is the most frequent purpose for sharing images. Moreover, these images essentially facilitate the understanding of 68% of sampled questions. Second, we find that discrepancy questions are more relatively frequent compared to those without images, but there are no significant differences observed in description length in all types of questions. Third, the quantitative results statistically validate that questions with images are more likely to receive accepted answers, but do not speed up the time to receive answers. Our work demonstrates the crucial role that images play by approaching the topic from a new angle and lays the foundation for future opportunities to use images to assist in tasks like generating questions and identifying question-relatedness.

    DOI: 10.1109/MSR59073.2023.00059

    Web of Science

    Scopus

▼全件表示

共同研究・競争的資金等の研究課題