THOMAS GABRIEL FRANCIS DIEGO
Organization
Faculty of Information Science and Electrical Engineering Department of Advanced Information Technology Associate Professor
School of Engineering Department of Electrical Engineering and Computer Science（Concurrent）
Graduate School of Information Science and Electrical Engineering Department of Information Science and Technology（Concurrent）
Title
Associate Professor
Contact information
Tel
0928023571
Profile
My research is related to the automatic 3D modeling of static and dynamic indoor scenes using consumer-grade RGB-D cameras. At first, I focused my research activities on the 3D registration task (i.e., how to align two parts of the same object captured from different viewpoint). Then I focused my research in deriving more suitable 3D models (i.e., 3D mathematical representations) for efficient fusion of videos of (aligned) depth images for large- scale, real-time 3D modeling of indoor scenes. Recently, my research aimed at handling animations in the 3D modeling process. More precisely, I focused my research theme on the animation and 3D modeling of the human body.
Education:
-Year 2017-Now: Assistant professor at Kyushu University, Fukuoka (Japan)
-Year 2015-2017: JSPS Post-doc research at Kyushu University, Fukuoka (Japan)
-Year 2012-2015: Post-doc researcher at the National Institute of Informatics, Tokyo (Japan).
-Year 2009-2012: Phd course at the National Institute of Informatics, Tokyo (Japan) as a student of SOKENDAI. (Best student award)
-Year 2005-2008: Master course at the ENSIMAG-INPG (Engineering school of Computer Science and Mathematics), Grenoble, option IRV (Image and Virtual Reality). Diploma with honors.
-Year 2003-2005: Two-year intensive course in science and mathematics at undergraduate level as preparation for competitive entrance exam to French engineering schools, lycee Champollion, in Grenoble.
External link
ORCID
Degree
-
Master (France)
-
Ph. D
Research History
-
I was a post doc researcher at the National Institute of Informatics from April 2012 to March 2015.
Research Interests・Research Keywords
-
Research theme：Digital humans
Keyword：generative AI; 3D and 4D capture; motion retargeting; gesture
Research period： 2023.1
-
Research theme：AI-based avatar animation synthesis
Keyword：deep learning; avatar animation; dense deformation; texture
Research period： 2021.6 - 2022.6
-
Research theme：Aerial-based outdoor 3D scene mapping
Keyword：aerial drone; RGB-D SLAM; outdoor scene
Research period： 2020.4 - 2022.4
-
Research theme：3D shape from a single image
Keyword：Deep learning, 3D shape estimation
Research period： 2019.4 - 2021.8
-
Research theme：Mediated Reality Agents for educational applications targeting young children
Keyword：Education support, Virtual Reality, Augmented Reality, Mixed Reality, Virtual Assistant, RGB-D camera.
Research period： 2018.5 - 2020.6
-
Research theme：High frame-rate 3D reconstruction with multiple cameras
Keyword：RGB-D camera; high frame rate; multi-view set-up; real time; distributed system; GPU optimization; volumetric reconstruction; fast and uncontrolled motion
Research period： 2017.12 - 2018.2
-
Research theme：Human body 3D reconstruction in dynamic scenes
Keyword：RGB-D camera; fast motion; skeleton; deforming bounding boxes; volumetric depth fusion; ICP; GPU optimization; large-scale scene
Research period： 2017.4 - 2018.2
-
Research theme：Facial 3D reconstruction and expression tracking
Keyword：RGB-D camera; Facial expression; Blendshape; Template mesh; Texturing; 3D modeling; Retargeting; Deviation mapping; Real-time.
Research period： 2015.4 - 2018.2
-
Research theme：3D reconstruction of large-scale static indoor scenes using consumer-grade RGB-D cameras
Keyword：RGB-D camera; SLAM; Depth Fusion; 3D modeling; Camera tracking; Loop closure
Research period： 2012.4 - 2017.4
Awards
-
Best paper award
2019.11 The 9th Pacific-Rim Symposium on Image and Video Technology (PSIVT 2019)
-
Best poster presentation award
2019.11 Machine Perception and Robotics (MPR 2019)
-
Outstanding research achievement and contribution to ASPCIT 2019 Annual Meeting Invited Presentation
2019.7 Asia Pacific Society for Computing and Information Technology
-
Best poster award
2019.2 IW-FCV2019
-
Outstanding reviewer
2015.7 MIRU 2015
-
Best student award
2012.3 National Insitute of Informatics
Papers
-
TetraTSDF: 3D human reconstruction from a single image with a tetrahedral outer shell Reviewed International journal
Hayato Onizuka, Zehra Hayirci, Diego Thomas, Akihiro Sugimoto, Hideaki Uchiyama, Rin-ichiro Taniguchi
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020.6
-
Human shape reconstruction with loose clothes from partially observed data by pose specific deformation Reviewed International journal
#Akihiko Sayo, #Hayato Onizuka, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, and Katsushi Ikeuchi
he 9th Pacific-Rim Symposium on Image and Video Technology 2019.11
-
Revisiting Depth Image Fusion with Variational Message Passing Reviewed International journal
Diego Thomas, Ekaterina Sirazitdinova, Akihiro Sugimoto, Rin-ichiro Taniguchi
International conference on 3D vison 2019. 2019.9
-
Landmark-guided deformation transfer of template facial expressions for automatic generation of avatar blendshapes Reviewed International journal
Hayato Onizuka, Diego Thomas, Hideaki Uchiyama, Rin-ichiro Taniguchi
Proceedings of the IEEE International Conference on Computer Vision Workshops 2019.9
-
Dense 3D reconstruction by combining photometric stereo and key frame-based SLAM with a moving smartphone and its flashlight Reviewed International journal
@Remy Maxence, Hideaki Uchiyama, Hiroshi Kawasaki, Diego Thomas, Vincent Nozick, Hideo Saito
International Conference on 3D vision 2019.9
-
SegmentedFusion: 3D human body reconstruction using stitched bounding boxes Reviewed International journal
Shih Hsuan Yao, Diego Thomas, Akihiro Sugimoto, Shang-Hong Lai, Rin-Ichiro Taniguchi Kyushu
2018 International Conference on 3D Vision (3DV) 2018.9
-
Augmented blendshapes for real-time simultaneous 3d head modeling and facial motion capture Reviewed International journal
Diego Thomas, Rin-Ichiro Taniguchi
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016.6
-
Range Image Registration Using a Photometric Metric under Unknown Lighting Reviewed International journal
Diego Thomas, Akihiro Sugimoto
IEEE transactions on pattern analysis and machine intelligence 2013.9
-
ActiveNeuS: Neural Signed Distance Fields for Active Stereo Reviewed International journal
Kazuto Ichimaru, Takaki Ikeda, Diego Thomas, Takafumi Iwaguchi, Hiroshi Kawasaki
International Conference on 3D Vision 2024.3
-
Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Maps International journal
Wu, Jane, Diego Thomas, and Ronald Fedkiw
arXiv 2023.11
-
A Two-step Approach for Interactive Animatable Avatars Reviewed International journal
#Takumi Kitamura, Diego Thomas, Hiroshi Kawasaki, Naoya Iwamoto
COMPUTER GRAPHICS INTERNATIONAL 2023 2023.9
-
ACT2G: Attention-based Contrastive Learning for Text-to-Gesture Generation Reviewed International journal
#Teshima Hitoshi, Naoki Wake, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, Katsushi Ikeuchi
ACM on Computer Graphics and Interactive Techniques 6 2023.8
-
Deep Gesture Generation for Social Robots Using Type-Specific Libraries Reviewed International journal
Hitoshi Teshima, Naoki Wake, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, Katsushi Ikeuchi
2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2022.10
-
Self-calibration of multiple-line-lasers based on coplanarity and Epipolar constraints for wide area shape scan using moving camera Reviewed International journal
Genki Nagamatsu, Takaki Ikeda, Takafumi Iwaguchi, Diego Thomas, Jun Takamatsu, Hiroshi Kawasaki
2022 26th International Conference on Pattern Recognition (ICPR) 2022.8
-
3D pedestrian localization using multiple cameras: a generalizable approach Reviewed International journal
Machine Vision and Applications 2022.7
-
Generalizable Online 3D Pedestrian Tracking with Multiple Cameras Reviewed International journal
Victor Lyra, Isabella de Andrade, Joao Paulo Lima, Rafael Roberto, Lucas Figueiredo, Joao Marcelo Teixeira, Diego Thomas, Hideaki Uchiyama, Veronica Teichrieb
Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) 2022.3
-
Refining OpenPose With a New Sports Dataset for Robust 2D Pose Estimation Reviewed International journal
Takumi Kitamura, Hitoshi Teshima, Diego Thomas, Hiroshi Kawasaki
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision 2022.1
-
Integration of gesture generation system using gesture library with DIY robot design kit Reviewed International journal
Hitoshi Teshima, Naoki Wake, Diego Thomas, Yuta Nakashima, David Baumert, Hiroshi Kawasaki, Katsushi Ikeuchi
2022 IEEE/SICE International Symposium on System Integration (SII) 2022.1
-
Self-calibrated dense 3D sensor using multiple cross line-lasers based on light sectioning method and visual odometry Reviewed International journal
Genki Nagamatsu, Jun Takamatsu, Takafumi Iwaguchi, Diego Thomas, Hiroshi Kawasaki
2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2021.9
-
PoseRN: A 2D pose refinement network for bias-free multi-view 3D human pose estimation Reviewed International journal
Akihiko Sayo, Diego Thomas, Hiroshi Kawasaki, Yuta Nakashima, Katsushi Ikeuchi
2021 IEEE International Conference on Image Processing (ICIP) 2021.9
-
Unsupervised 3D Human Pose Estimation in Multi-view-multi-pose Video Reviewed International journal
#Cheng Sun, Diego Thomas, Hiroshi Kawasaki
2020 25th International Conference on Pattern Recognition (ICPR) 5959 - 5964 2021.1
-
Analysis and classification of gestures in ted talks Reviewed International journal
Hitoshi Teshima, Naoki Wake, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, Katsushi Ikeuchi
IEICE Technical Report; IEICE Tech. Rep. 2020.10
-
On-the-fly Extrinsic Calibration of Non-Overlapping in-Vehicle Cameras based on Visual SLAM under 90-degree Backing-up Parking Reviewed International journal
Kazuki Nishiguchi, Hideaki Uchiyama, Kazutaka Hayakawa, Jun Adachi, Diego Thomas, Atsushi Shimada, Rin-Ichiro Taniguchi
2020 IEEE Intelligent Vehicles Symposium (IV) 2020.10
-
Real-time Simultaneous 3D Head Modeling and Facial Motion Capture with an RGB-D camera International journal
Diego Thomas
arXiv preprint arXiv:2004.10557 2020.4
-
Generating a consistent global map under intermittent mapping conditions for large-scale vision-based navigation Reviewed International journal
Kazuki Nishiguchi, Walid Bousselham, Hideaki Uchiyama, Diego Thomas, Atsushi Shimada, Rin Ichiro Taniguchi
15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020 2020.1
-
Regression of 3D human body shapes from a single image in a tetrahedral volume International journal
#Hayato Onizuka, Diego Thomas, @Zehra Hayirci, Akihiro Sugimoto, Hideaki Uchiyama, Rin-ichiro Taniguchi
THE 15TH JOINT WORKSHOP ON MACHINE PERCEPTION AND ROBOTICS 2019.11
-
Real-Time Facial Motion Capture Using RGB-D Images Under Complex Motion and Occlusions Reviewed International journal
@Joao Otavio de Lucena, Joao Paulo Lima, Diego Thomas, Veronica Teichrieb
THE SYMPOSIUM ON VIRTUAL AND AUGMENTED REALITY 2019 2019.10
-
MeRA: An Interactive Mediated Reality Agent for Educational Application Reviewed International journal
@Guillaume Quiniou, Frederic Rayar, Diego Thomas
International Symposium on Mixed and Augmented Reality | ISMAR 2019 2019.10
-
Landmark-guided deformation transfer of template facial expressions for automatic generation of avatar blendshapes Reviewed International journal
#Hayato Onizuka, Diego Thomas, Hideaki Uchiyama, Rin-ichiro Taniguchi
The 2nd Workshop on 3D Reconstruction in the Wild (3DRW2019) in conjunction with ICCV2019 2019.10
-
Blended-Keyframes for Mobile Mediated Reality Applications Reviewed International journal
#Yu Xue, Diego Thomas, Frederic Rayar, Hideaki Uchiyama, Rin-ichiro Taniguchi, Boacai Yin
IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2019.10
-
仲介現実を用いた次世代教育に向けるアプリ
第22回 画像の認識・理解シンポジウム (MIRU2019) 2019.8
-
3D Body and Background Reconstruction in a Large-scale Indoor Scene using Multiple Depth Cameras Reviewed International journal
Daisuke Kobayashi ; Diego Thomas ; Hideaki Uchiyama ; Rin-ichiro Taniguchi
2019 12th Asia Pacific Workshop on Mixed and Augmented Reality (APMAR) 2019.3
-
3D Body and Background Reconstruction in a Large-scale Indoor Scene using Multiple Depth Cameras Reviewed International journal
#Daisuke Kobayashi, Diego Thomas, Hideaki Uchiyama, Rin-ichiro Taniguchi
The 12th Asia Pacific Workshop on Mixed and Augmented Reality 2019.3
-
Solving monocular visual odometry scale factor with adaptive step length estimates for pedestrians using handheld devices Reviewed International journal
MDPI Sensors 2019.1
-
Incremental 3D Cuboid Modeling with Drift Compensation Reviewed International journal
MDPI Sensors 2019.1
-
Indoor Positioning System Based on Chest-Mounted IMU Reviewed International journal
Chuanhua Lu, Hideaki Uchiyama, Diego Thomas, Atsushi Shimada, Rin-ichiro Taniguchi
MDPI Sensors 2019.1
-
FusionMLS: Highly dynamic 3D reconstruction with consumer-grade RGB-D cameras Reviewed International journal
Siim Meerits, Diego Thomas, Vincent Nozick, Hideo Saito
Computational Visual Media 2018.12
-
Sparse cost volume for efficient stereo matching Reviewed International journal
Chuanhua Lu, Hideaki Uchiyama, Diego Thomas, Atsushi Shimada, Rin-ichiro Taniguchi
MDPI Remote Sensing 2018.11
-
RGB-D SLAM based incremental cuboid modeling Reviewed International journal
Masashi Mishima, Hideaki Uchiyama, Diego Thomas, Rin-ichiro Taniguchi, Rafael Roberto, Veronica Teichrieb
The European Conference on Computer Vision (ECCV) workshops, 2018 2018.9
-
Live structural modeling using RGB-D SLAM Reviewed International journal
2018 IEEE International Conference on Robotics and Automation (ICRA) 2018.5
-
Synthesis of environment maps for mixed reality Reviewed International journal
David R Walton, Diego Thomas, Anthony Steed, Akihiro Sugimoto
2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2017.10
-
Fast 3D point cloud segmentation using supervoxels with geometry and color for 3D scene understanding Reviewed International journal
Francesco Verdoja, Diego Thomas, Akihiro Sugimoto
IEEE International Conference on Multimedia and Expo (ICME), 2017 2017.7
-
Parametric surface representation with bump image for dense 3d modeling using an rbg-d camera Reviewed International journal
Diego Thomas, Akihiro Sugimoto
International Journal of Computer Vision 123 ( 2 ) 2017.6
-
Modeling large-scale indoor scenes with rigid fragments using RGB-D cameras Reviewed International journal
Diego Thomas, Akihiro Sugimoto
Computer Vision and Image Understanding 2017.4
-
Multi-view facial landmark detector learned by the Structured Output SVM Reviewed International journal
Image and Vision Computing 47 2016.3
-
Real-time multi-view facial landmark detector learned by the structured output SVM Reviewed International journal
11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), 2015 2015.5
-
A two-stage strategy for real-time dense 3D reconstruction of large-scale scenes. Reviewed International journal
Diego Thomas, Akihiro Sugimoto
IEEE European Conference on Computer Vision Workshops (ECCVW), 2014 2014.9
-
A flexible scene representation for 3D reconstruction using an RGB-D camera Reviewed International journal
Diego Thomas, Akihiro Sugimoto
IEEE International Conference on Computer Vision (ICCV), 2013 2013.12
-
Learning to discover objects in RGB-D images using correlation clustering Reviewed International journal
Michael Firman, Diego Thomas, Simon Julier, Akihiro Sugimoto
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2013 1107 - 1112 2013.11
-
Compact and accurate 3-d face modeling using an rgb-d camera: Let's open the door to 3-d video conference Reviewed International journal
Pavan Kumar Anasosalu, Diego Thomas, Akihiro Sugimoto
The IEEE International Conference on Computer Vision (ICCV) Workshops 2013.5
-
Robust simultaneous 3D registration via rank minimization Reviewed International journal
Diego Thomas, Yasuyuki Matsushita, Akihiro Sugimoto
Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2012 2012.10
-
Range Image Registration Based on Photometry Reviewed
Diego Thomas
PhD thesis, The National Institute of Informatics, SOKENDAI, Tokyo, Japan 2012.3
-
Illumination-free photometric metric for range image registration Reviewed International journal
Diego Thomas, Akihiro Sugimoto
IEEE Workshop on Applications of Computer Vision (WACV), 2012 2012.1
-
Robustly registering range images using local distribution of albedo Reviewed International journal
Diego Thomas and Akihiro Sugimoto
Computer Vision and Image Understanding 115 ( 5 ) 649 - 667 2011.5
-
Range image registration of specular objects under complex illumination Reviewed International journal
Diego Thomas, Akihiro Sugimoto
Fifth International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT2010) 2010.6
-
Range image registration of specular objects Reviewed International journal
Diego Thomas, Akihiro Sugimoto
2010.2
-
Robust range image registration using local distribution of albedo Reviewed International journal
Diego Thomas, Akihiro Sugimoto
IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), 2009 2009.9
Presentations
-
TetraTSDF: 3D human reconstruction from a single image with a tetrahedral outer shell International conference
Hayato Onizuka, Zehra Hayirci, Diego Thomas, Akihiro Sugimoto, Hideaki Uchiyama, Rin-ichiro Taniguchi
IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020.6
-
Human shape reconstruction with loose clothes from partially observed data by pose specific deformation International conference
Akihiko Sayo, Hayato Onizuka, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, Katsushi Ikeuchi
Pacific-Rim Symposium on Image and Video Technology 2019.11
-
ActiveNeuS: Neural Signed Distance Fields for Active Stereo International conference
Kazuto Ichimaru, Takaki Ikeda, Diego Thomas, Takafumi Iwaguchi, Hiroshi Kawasaki
International Conference on 3D Vision 2024.3
-
A Two-step Approach for Interactive Animatable Avatars International conference
Takumi Kitamura, Naoya Iwamoto, Hiroshi Kawasaki, Diego Thomas
COMPUTER GRAPHICS INTERNATIONAL 2023 2023.8
-
Refining OpenPose With a New Sports Dataset for Robust 2D Pose Estimation International conference
Takumi Kitamura, Hitoshi Teshima, Diego Thomas, Hiroshi Kawasaki
IEEE/CVF Winter Conference on Applications of Computer Vision 2022.1
-
スポーツ選手のマーカレスモーションキャプチャーのための効率的なOpenpose再学習
#北村 卓弥, 川崎 洋, ディエゴ トマ
情報処理学会 第248回自然言語処理・第226回コンピュータビジョンとイメージメディア合同研究発表会 2021.5
-
Analysis and Classification of Gestures in TED Talks
Hitoshi Teshima, Naoki Wake, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, Katsushi Ikeuchi
2020.10
-
Unsupervised 3D Human Pose Estimation in Multi-view-multi-pose Video International conference
Sun, Cheng, Diego Thomas, and Hiroshi Kawasaki
25th International Conference on Pattern Recognition (ICPR) 2021.1
-
3D human body reconstruction using RGB-D camera Invited International conference
Diego Thomas
Asia Pacific Society for Computing and Information Technology 2019 Annual Meeting 2019.7
-
VMPFusion: Variational Message Passing for dynamic 3D face reconstruction Invited International conference
Diego Thomas
IDS/JFLI workshop 2018.5
-
3D Modeling of Large-Scale Indoor Scenes Using RGB-D Cameras Invited International conference
Diego Thomas, Akihiro Sugimoto
The 1st International Conference on Advanced Imaging 2015.6
-
Synthesis of environment maps for mixed reality
David R. Walton, Diego Gabriel Francis Thomas, Anthony Steed, Akihiro Sugimoto
16th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2017 2017.11
-
Fast 3D point cloud segmentation using supervoxels with geometry and color for 3D scene understanding
Francesco Verdoja, Diego Gabriel Francis Thomas, Akihiro Sugimoto
2017 IEEE International Conference on Multimedia and Expo, ICME 2017 2017.8
-
Augmented blendshapes for real-time simultaneous 3D head modeling and facial motion capture
Diego Gabriel Francis Thomas, Rin-Ichiro Taniguchi
2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016 2016
-
Dense 3D reconstruction using RGB-D cameras Invited International conference
Diego Thomas
International Conference on 3DVision 2014 2014.12
-
A two-stage strategy for real-time dense 3D reconstruction of large-scale scenes
Diego Gabriel Francis Thomas, Akihiro Sugimoto
13th European Conference on Computer Vision, ECCV 2014 2015.1
-
A flexible scene representation for 3D reconstruction using an RGB-D camera
Diego Gabriel Francis Thomas, Akihiro Sugimoto
2013 14th IEEE International Conference on Computer Vision, ICCV 2013 2013
-
Compact and accurate 3-D face modeling using an RGB-D camera Let's open the door to 3-D video conference
Pavan Kumar Anasosalu, Diego Gabriel Francis Thomas, Akihiro Sugimoto
2013 14th IEEE International Conference on Computer Vision Workshops, ICCVW 2013 2013
-
Learning to discover objects in RGB-D images using correlation clustering
Michael Firman, Diego Gabriel Francis Thomas, Simon Julier, Akihiro Sugimoto
2013 26th IEEE/RSJ International Conference on Intelligent Robots and Systems: New Horizon, IROS 2013 2013.12
-
Robust simultaneous 3D registration via rank minimization
Diego Gabriel Francis Thomas, Yasuyuki Matsushita, Akihiro Sugimoto
2nd Joint 3DIM/3DPVT Conference: 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2012 2012
-
Illumination-free photometric metric for range image registration
Diego Gabriel Francis Thomas, Akihiro Sugimoto
2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012 2012
-
Robust range image registration using local distribution of albedo
Diego Gabriel Francis Thomas, Akihiro Sugimoto
2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops 2009 2009
Professional Memberships
-
IEEE
Academic Activities
-
Area chair
（ Kumamoto Japan ） 2024.8
-
Screening of academic papers
Role(s)： Peer review
2023
-
Program commitee International contribution
CVPR2022 （ New Orleans, Louisiana UnitedStatesofAmerica ） 2022.6
-
Senior Program Committee International contribution
AAAI 2022 （ Vancouver Canada ） 2022.2 - 2022.3
-
Screening of academic papers
Role(s)： Peer review
2022
-
Senior Program Committee Member International contribution
30th International Joint Conference on Artificial Intelligence (IJCAI-21) （ Montreal, Canada Canada ） 2021.8 - 2021.5
-
Program committee International contribution
CVPR 2021 （ Online UnitedStatesofAmerica ） 2021.6 - 2021.5
-
Program committee International contribution
WACV 2021 （ UnitedStatesofAmerica ） 2021.3 - 2021.5
-
講演座長
情報処理学会第83回全国大会 2021.3 - 2021.5
-
Local chair International contribution
3D Vision (3DV 2020) （ Fukuoka Japan ） 2020.11
-
Program committee International contribution
CVPR 2020 （ Seattle, Washington UnitedStatesofAmerica ） 2020.6
-
Program committee International contribution
WACV 2020 （ Aspen UnitedStatesofAmerica ） 2020.3
-
Screening of academic papers
Role(s)： Peer review
2020
-
Program chair International contribution
Machine Perception and Robotics (MPR 2019) （ Biwako Kusatsu Campus (BKC), Ritsumeikan University Japan ） 2019.11
-
Area chair International contribution
The 9th Pacific-Rim Symposium on Image and Video Technology (PSIVT 2019) （ Sydney Australia ） 2019.11
-
Screening of academic papers
Role(s)： Peer review
2019
-
Publicity chair International contribution
The 12th International Workshop on Information Search, Integration, and Personalization (ISIP2018) （ Kyushu University, Fukuoka, Japan Japan ） 2018.5
-
Publicity chair International contribution
The 12th International Workshop on Information Search, Integration, and Personalization (ISIP 2018) （ Kyushu University, Fukuoka Japan ） 2018.5
-
Screening of academic papers
Role(s)： Peer review
2018
-
Local arrangement chair International contribution
JFLI-KYUDAI JOINT WORKSHOP ON INFORMATICS （ Ito Campus, Kyushu University, Fukuoka, Japan Japan ） 2017.9
-
Screening of academic papers
Role(s)： Peer review
2017
-
Program Committee International contribution
SITIS2016 （ Naples Italy ） 2016.11 - 2016.12
-
Program Committee
MIRU2016 （ Hamamatsu Japan ） 2016.8
-
Screening of academic papers
Role(s)： Peer review
2016
-
Program Committee
MIRU2015 （ Osaka Japan ） 2015.7
-
Screening of academic papers
Role(s)： Peer review
2015
-
Program committee
MIRU2014 （ Okayama Japan ） 2014.7
Research Projects
-
A new data-driven approach to bring humanity into virtual worlds with computer vision
Grant number：23H03439 2023 - 2025
Japan Society for the Promotion of Science Grants-in-Aid for Scientific Research Grant-in-Aid for Scientific Research (B)
Authorship：Principal investigator Grant type：Scientific research funding
-
NerF-based multi-view 3D shape reconstruction using Centroidal Voronoi Tessellation International coauthorship
2022.4 - 2023.6
Kyushu University (Japan)
Authorship：Principal investigator
We investigate the use of CVT to jointly optimize 3D shape, appearance and discretization of the 3D space for high definition 3D mesh reconstruction from multi-view images.
-
Multi-Camera 3D Pedestrian Detection with Domain Adaptation and Generalization
2022 - 2023
Japan Society for the Promotion of Science
Authorship：Principal investigator Grant type：Joint research
-
AI-based animation of 3D avatars.
2021.6 - 2022.5
Joint research
Authorship：Principal investigator Grant type：Other funds from industry-academia collaboration
-
Deep human avatar animation International coauthorship
2021.5 - 2022.5
Japan
Authorship：Principal investigator
-
Realistic environment rendering with real humans for architecture project visualization
2021.4 - 2022.5
Authorship：Principal investigator
-
Multi-view 3D pedestrian localisation International coauthorship
2021.3 - 2023.4
Brazil
Authorship：Coinvestigator(s)
-
A new approach for supporting architectural works with virtual reality environments.
2021 - 2022
Authorship：Principal investigator Grant type：On-campus funds, funds, etc.
-
Weakly-supervised human 3D body shape estimation from single images International coauthorship
2020.9 - 2021.8
U.S.A
Authorship：Coinvestigator(s)
-
Dynamic human motion tracking using dual quaternion algebra International coauthorship
2020.7 - 2022.3
Japan
Authorship：Coinvestigator(s)
-
Human body 3D shape estimation, animation and gesture synthesis
2020.4 - 2021.3
Joint research
Authorship：Principal investigator Grant type：Other funds from industry-academia collaboration
-
Personalized avatars with real emotions for next generation holoportation systems International coauthorship
2020.1 - 2021.1
Microsoft Research Asia
Authorship：Principal investigator
-
2 years training and international research
2020 - 2022
SENTAN-Q
Authorship：Principal investigator Grant type：On-campus funds, funds, etc.
-
3D shape estimation and motion retargeting from 2D videos for future Holoportation systems.
2020
QR Wakaba challenge
Authorship：Principal investigator Grant type：On-campus funds, funds, etc.
-
Unifying multiple RGB and depth cameras for real-time large-scale dynamic 3D modeling with unmanned micro aerial vehicles.
2019.4 - 2021.4
KAKENHI
Authorship：Principal investigator
The project is about real-time 3D reconstruction of large-scale dynamic scenes (i.e., scenes containing one or more moving objects to be modeled, possibly with shape deformation) from unmanned micro aerial vehicles. The objective is to investigate fusion of multiple RGB and depth sensors mounted on multiple micro aerial vehicle for real-time 3D reconstruction of large-scale dynamic 3D scenes. Fundamental algorithms that will be unveiled here will be used to build large-scale dynamic 3D models and provide the necessary tools for real-time automatic dynamic 3D scene understanding.
-
Unifying multiple RGB and depth cameras for real-time large-scale dynamic 3D modeling with unmanned micro aerial vehicles
Grant number：19K20297 2019 - 2020
Japan Society for the Promotion of Science Grants-in-Aid for Scientific Research Early-Career Scientists
Authorship：Principal investigator Grant type：Scientific research funding
-
Facial motion capture International coauthorship
2017.10 - 2018.9
Huawei Technologies Japan K.K (China).
Authorship：Collaborating Investigator(s) (not designated on Grant-in-Aid)
This project is divided into three stages, the first stage is that roughly evaluates our base algorithm, and the second stage is that evaluates the robustness for overall reconstruction (expression) ability of the facial impression transfer to any 3D avatar by any person. And the third stage is that improves facial model quality (as for providing complete facial model, we need to add eye ball and mouth).
-
Facial motion capture system
2017.9 - 2018.8
Joint research
Authorship：Collaborating Investigator(s) (not designated on Grant-in-Aid) Grant type：Other funds from industry-academia collaboration
-
Free-form dynamic 3D scene reconstruction at high resolution
2017 - 2018
Authorship：Coinvestigator(s) Grant type：On-campus funds, funds, etc.
-
Large-scale and dynamic 3D reconstruction using an RGB-D camera
2015 - 2017
Japan Society for the Promotion of Science Grants-in-Aid for Scientific Research Grant-in-Aid for JSPS Fellows
Authorship：Principal investigator Grant type：Scientific research funding
Educational Activities
-
I am teaching practically exercises of data science. In this class we teach program implementation for research subject of each student. We also provide individual guidance within the lecture time.
I am teaching the class "Information Science" for the first year students of the University.
I have been teaching the class "Programming in Python" for the first year students of the University.
I am teaching the class "Digital Humans I & II" at the faculty of Information Science and Electrical Engineering.
I am teaching the experimental class "Distributed robots" at the faculty of Information Science and Electrical Engineering.
Class subject
-
デジタルヒューマンII
2024.6 - 2024.8 Summer quarter
-
デジタルヒューマンⅠ
2024.4 - 2024.6 Spring quarter
-
情報科学（英語）
2023.10 - 2024.3 Second semester
-
情報理工学論議Ⅱ
2023.10 - 2024.3 Second semester
-
情報理工学論述Ⅱ
2023.10 - 2024.3 Second semester
-
情報理工学演示
2023.10 - 2024.3 Second semester
-
デジタルヒューマンⅡ
2023.6 - 2023.8 Summer quarter
-
【通年】情報理工学講究
2023.4 - 2024.3 Full year
-
【通年】情報理工学研究Ⅰ
2023.4 - 2024.3 Full year
-
【通年】情報理工学演習
2023.4 - 2024.3 Full year
-
情報理工学論議Ⅰ
2023.4 - 2023.9 First semester
-
情報理工学読解
2023.4 - 2023.9 First semester
-
情報理工学論述Ⅰ
2023.4 - 2023.9 First semester
-
分散ロボット実験
2023.4 - 2023.6 Spring quarter
-
デジタルヒューマンⅠ
2023.4 - 2023.6 Spring quarter
-
情報科学（英語）
2022.10 - 2023.3 Second semester
-
データサイエンス演習第一
2022.10 - 2023.3 Second semester
-
データサイエンス演習第二
2022.10 - 2023.3 Second semester
-
情報知能工学演習 第三
2021.10 - 2022.3 Second semester
-
情報知能工学演習 第一
2021.10 - 2022.3 Second semester
-
データサイエンス演習第二
2021.10 - 2022.3 Second semester
-
データサイエンス演習第一
2021.10 - 2022.3 Second semester
-
プログラミング演習(P)
2021.6 - 2021.8 Summer quarter
-
情報知能工学演習 第二
2021.4 - 2021.9 First semester
-
データサイエンス演習第一
2020.10 - 2021.3 Second semester
-
データサイエンス演習第二
2020.10 - 2021.3 Second semester
-
情報科学
2020.4 - 2020.9 First semester
-
情報科学
2019.10 - 2020.3 Second semester
-
データサイエンス演習第一
2019.4 - 2019.9 First semester
-
データサイエンス演習第二
2019.4 - 2019.9 First semester
-
データサイエンス演習第二
2018.4 - 2018.9 First semester
-
データサイエンス演習第一
2018.4 - 2018.9 First semester
-
データサイエンス演習第二
2017.4 - 2017.9 First semester
-
データサイエンス演習第一
2017.4 - 2017.9 First semester
Social Activities
-
JSPS Science Dialogue
Fukui Prefectural Wakasa High School (Wakasa-city, Fukui) 2017.1
Travel Abroad
-
2016.12
Staying countory name 1：France Staying institution name 1：INRIA Grenoble
-
2011.3 - 2011.7
Staying countory name 1：China Staying institution name 1：Microsoft Research Asia
-
2010.2
Staying countory name 1：Czech Republic Staying institution name 1：Center for Machine Perception (CMP)