Kyushu University Academic Staff Educational and Research Activities Database
List of Papers
Hiroshi Kawasaki Last modified date:2022.06.29

Professor / Department of Advanced Information Technology / Faculty of Information Science and Electrical Engineering


Papers
1. Michihiro Mikamo, Hiroshi Kawasaki, Ryusuke Sagawa, Ryo Furukawa, GCN-Calculated Graph-Feature Embedding for 3D Endoscopic System based on Active Stereo, The 27th International Workshop on Frontiers of Computer Vision (IW-FCV2021), 14 pages, 2020.08.
2. Hanwei Zhang, Hiroshi Kawasaki, Tsunenori Mine, Shintaro Ono, Focusing on Discrimination between Road Conditions and Weather in Driving Video Analysis, The 27th International Workshop on Frontiers of Computer Vision (IW-FCV2021), 12 pages, 2020.08.
3. Genki Nagamatsu, Jun Takamatsu, Hiroshi Kawasaki, Self-calibration of multiple line lasers and a camera for underwater 3D shape reconstruction, The 27th International Workshop on Frontiers of Computer Vision (IW-FCV2021), 16 pages, 2020.08.
4. Teruhisa Takano, Shintaro Ono, Hiroshi Kawasaki, Katsushi Ikeuchi, High-Resolution Image Data Collection Scheme for Road Sensing Using Wide-Angle Cameras on General-Use Vehicle Criteria to Include/Exclude Collected Images for Super Resolution, International Journal of Intelligent Transportation Systems Research, 10.1007/s13177-020-00243-0, 13 pages, 2020.08, [URL].
5. Ryusuke Sagawa, Yusuke Higuchi, Hiroshi Kawasaki, Ryo Furukawa, Takahiro Ito, Dense Pixel-wise Micro-motion Estimation of Object Surface by using Low Dimensional Embedding of Laser Speckle Pattern, 15th Asian conference on computer Vision (ACCV2020), 16 pages, 2020.08, [URL].
6. Cheng Sun,Diego Thomas,Hiroshi Kawasaki, Unsupervised 3D Human Pose Estimation in Multi-view-multi-pose Video, 25th International Conference on pattern recognition (ICPR2020), 6 pages, 2020.08.
7. Yicheng Wu1 , Vivek Boominathan1 , Xuan Zhao1 , Jacob T. Robinson1 , Hiroshi Kawasaki2 , Aswin Sankaranarayanan3 , and Ashok Veeraraghavan1, FreeCam3D: Snapshot Structured Light 3D with Freely-Moving Cameras, 16TH EUROPEAN CONFERENCE ON COMPUTER VISION(ECCV2020), 10.1007/978-3-030-58583-9_19, 17 pages, 2020.08, [URL], Phase Maskを用いたパターン投影シーンで、キャリブレーション不要な3次元推定を実現.
8. Jack Erdozain Jr.,Kazuto Ichimaru,Tomohiro Maeda,Hiroshi Kawasaki,Ramesh Raskar,Achuta Kadambi, 3D IMAGING FOR THERMAL CAMERAS USING STRUCTURED LIGHT, 2020 IEEE International Conference on Image Processing(ICIP2020), 10.1109/ICIP40778.2020.9191297, 5 pages (pp.2795-2799), 2020.08.
9. Genki Nagamatsu1 , Ewa Magdalena Nowara2 , Amruta Pai2 , Ashok Veeraraghavan2 and Hiroshi Kawasaki1, PPG3D: Does 3D head tracking improve camera-based PPG estimation?, the 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society in conjunction with the 43rd Annual Conference of the Canadian Medical and Biological Engineering Society, 10.1109/EMBC44109.2020.9176065, pp.1194-1197, 2020.08, [URL].
10. Ryo Furukawa1 , Shiro Oka2 , Takahiro Kotachi2 , Yuki Okamoto2 , Shinji Tanaka2 , Ryusuke Sagawa3 , and Hiroshi Kawasaki4, Fully Auto-calibrated Active-stereo-based 3D Endoscopic System using Correspondence Estimation with Graph Convolutional Network, the 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society in conjunction with the 43rd Annual Conference of the Canadian Medical and Biological Engineering Society, 10.1109/EMBC44109.2020.9176417, pp.4357-4360, 2020.08, [URL].
11. Trung-Nghia Le,Akihiro Sugimoto,Shintaro Ono, Hiroshi Kawasaki, Attention R-CNN for Accident Detection, The 2020 IEEE Intelligent Vehicles Symposium (IV2020), 10.1109/IV47402.2020.9304730, 8 pages, 2020.08.
12. Ryo Furukawa, Hiroshi Kawasaki, Ryusuke Sagawa, Yasushi Yagi, Shape from grid pattern based on coplanarity constraints for one-shot scanning, IPSJ Transactions on Computer Vision and Applications(CVA), 1, 139-157, 2009.09.
13. Ryo Furukawa, Hiroshi Kawasaki, Laser range scanner based on self-calibration techniques using coplanarities and metric constraints, COMPUTER VISION AND IMAGE UNDERSTANDING, 10.1016/j.cviu.2009.05.006, 113, 11, 1118-1129, 2009.11, In this paper, we propose a novel method to achieve both dense 3D reconstruction of the scene and estimation of the camera intrinsic parameters by using coplanarities and other constraints (e.g., orthogonalities or parallelisms) derived from relations between planes in the scene and reflected curves of line lasers captured by a single camera. In our study, we categorize coplanarities in the scene into two types: implicit coplanarities, which can be observed as reflected curves of line lasers. and explicit coplanarities, which are. for example, observed as walls of a building. By using both types of coplanarities, we can construct simultaneous equations and can solve them up to four degrees of freedom. To upgrade the solution to the Euclidean space and estimate the camera intrinsic parameters, we can use metric constraints such as orthogonalities of the planes. Such metric constraints are given by, for example, observing the corners of rectangular boxes in the scene, or using special laser projecting device composed of two line lasers whose laser planes are configured to be perpendicular. (C) 2009 Elsevier Inc. All rights reserved..
14. Belief-Propagationによる高密度なグリッドパターン検出及びデブルーイン系列を用いた高速動物体のロバストな三次元計測手法
非常に高速に動く3次元物体の形状を高密度,高フレームレートで取得できれば,多くの物体解析や事故防止等に大きく貢献できる.本論文ではラインベースによるグリッドパターンからのワンショットスキャンを拡張して密な形状を取得できるシステムを提案する.ワンショットスキャンは1枚の画像から物体の形状を計測できるが,密なパターンを使用できないため,計測結果が疎になるなど幾つかの解決すべき課題があった.そこで,パターンの交点を用いた形状計測の拡張,デブルーイン系列とbelief-propagationによる線検出の効率化,という手法を組み合わせてこれらの課題を解決した.この提案手法とハイスピードカメラを用いて実験を行ったところ,高フレームレートで高速移動物体の密な形状の取得に成功した..
15. Koichi Ogawara, Ryo Furukawa, Ryusuke Sagawa, Hiroshi Kawasaki, "Marker-less Motion Capture using Dense Human-body Shape Scanning System", The First Joint 3DIM/3DPVT Conference 3D Imaging Modeling Processing Visualization Transmission, 2011.05.
16. Ryo Furukawa, Ryusuke Sagawa, Hiroshi Kawasaki, Kazuhiro Sakashita, Yasushi Yagi, Naoki Asada, Entire shape acquisi-tion technique using multiple pro-jectors and cameras with parallel pattern projection, IPSJ Transactions on Computer Vision and Applications(CVA), 4, 40-52, 2012.03.
17. Ismael Daribo, Ryo Furukawa, Ryusuke Sagawa, Hiroshi Kawasaki, Shinsaku Hiura, Naoki Asada, Efficient Rate-Distortion Compression of Dynamic Point Cloud for Grid-Pattern-Based 3D Scanning Systems, Journal 3D Research, 10.1007/3DRes.01(2012)2, 3, 1, 9 pages, 2012.03.
18. Robust active 3D measurement method against bokeh using projector-camera system with coded aperture.
19. Garbage Bag Recognition by Decoding Distorted Two-Dimensional Code.
20. Hiroshi Kawasaki, Hitoshi Masuyama, Ryusuke Sagawa, Ryo Furukawa, Single colour one-shot scan using modified Penrose tiling pattern, IET COMPUTER VISION, 10.1049/iet-cvi.2012.0277, 7, 5, 293-301, 2013.10, In this study, the authors propose a new technique to achieve one-shot scan using single colour and static pattern projector; such a method is ideal for acquisition of moving objects. Since projector-camera systems generally have uncertainties on retrieving correspondences between the captured image and the projected pattern, many solutions have been proposed. Especially for one-shot scan, which means that only a single image is required for shape reconstruction, positional information of a pixel of the projected pattern should be encoded by spatial and/or colour information. Although colour information is frequently used for encoding, it is severely affected by texture and material of the object and leads unstable reconstruction. In this study, the authors propose a technique to solve the problem by using geometrically unique pattern only with black and white colour that further considers the shape distortion by surface orientation of the shape. The authors technique successfully acquires high-precision one-shot scan with an actual system..
21. Yasuhiro Akagi, Ryo Furukawa, Ryusuke Sagawa, Koichi Ogawara, Hiroshi Kawasaki, Marker-less Facial Motion Capture based on the Parts Recognition, Journal of WSCG, 21, 2, 137-144, 2013.02.
22. Rina Yonekura, Yasuhiro Akagi, Satoshi Ono, Yukiko Kawai, Hiroshi Kawasaki, Navigation System which Uses Visibility Map of Landmarks to Reduce Reference Count of the Map, the Fourth International Workshop on Image Electronics and Visual Computing (IEVC), 2014.10.
23. Masayuki Furukawa, Hiroshi Kawasaki, Yasuhiro Akagi, Yukiko Kawai, Interactive 3D animation creation and viewing system based on motion graph and pose estimation method, MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia, 10.1145/2647868.2655055, 1213-1216, 2014.11, This paper proposes an interactive 3D animation system specifically aiming efficient control of human motion. However there are various commercial products for creating movies and game contents, those are still difficult to deal with for non-professional users. To ease the creation process and encourage to utilize 3D animation for the general users, e.g., in the field of such as education, medicine and so on, we propose a system using Kinect. The data of skeleton models of human motion estimated by Kinect is processed to generate Motion Graph and finally restructure the data automatically for 3D character models. We also propose an efficient 3D animation viewing system based on touch interface for tablet device, which enables intuitive control of multiple motions of the human activity. To evaluate the effectiveness of the method, we implemented a prototype system and created several 3D animations..
24. Yuki Horita, Hitoshi Masuyama, Satoshi Ono, Hiroshi Kawasaki, Makoto Kimura, Yasuo Takane, Dense Depth Map Estimation from Defocus of Video-Projector Equipped with Coded Aperture, 第17回画像の認識・理解シンポジウム, OS2-1, 2014.07.
25. Ryusuke Sagawa, Ryo Furukawa, Hiroshi Kawasaki, Dense 3D Reconstruction from High Frame-Rate Video Using a Static Grid Pattern, IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 10.1109/TPAMI.2014.2300490, 36, 9, 1733-1747, 2014.09, Dense 3D reconstruction of fast moving objects could contribute to various applications such as body structure analysis, accident avoidance, and so on. In this paper, we propose a technique based on a one-shot scanning method, which reconstructs 3D shapes for each frame of a high frame-rate video capturing the scenes projected by a static pattern. To avoid instability of image processing, we restrict the number of colors used in the pattern to less than two. The proposed technique comprises (1) an efficient algorithm to eliminate ambiguity of projected parallel-line patterns by using intersection points, (2) a batch reconstruction algorithm of multiple frames by using spatio-temporal constraints, and (3) an efficient detection method of color-encoded grid pattern based on de Bruijn sequence. In the experiments, the line detection algorithm worked effectively and the dense reconstruction algorithm produces accurate and robust results. We also show the improved results by using temporal constraints. Finally, the dense reconstructions of fast moving objects in a high frame-rate video are presented..
26. On-Vehicle Video Localization Technique Based on Video Search Using Real Data on the Web.
27. Yudai Mido, Yuki Horita, Kentaro Nakai, Taishi Megano, Satoshi Ono, Hiroshi Kawasaki, A Fundamental Study on Coded Aperture Design for Depth from Projector Defocus based on Evolutionary Multi-Objective Optimization, The 7-th International Conference on Intelligent Networking and Collaborative Systems (INCoS), 10.1109/INCoS.2015.91, 223-227, 2015.09.
28. Shigeto Yoshida, Yoko Kominami, Yoji Sanomura, Shinji Tanaka, Ryo Furukawa, Hiroshi Kawasaki, Tissue Shape Acquisition with a Hybrid Structured Light and Photometric Stereo Endoscopic System, Computer-Assisted and Robotic Endoscopy: Second International Workshop, CARE 2015, Held in Conjunction with MICCAI 2015, Munich, Germany, October 5, 2015, Revised Selected Papers, 9515, 46, 2016.02.
29. Takuya Ushinohama, Yosuke Sawai, Satoshi Ono, Hiroshi Kawasaki, Silhouette-Based Non-Rigid Registration for Non-Overlapping Depth Images, 第19回画像の認識・理解シンポジウム, OS4-5, 2016.08.
30. Kazuya Nakamura, Kohei Kamizuru, Hiroshi Kawasaki, Satoshi Ono, Multi-agent-based Two-dimensional Barcode Decoding Robust against Non-uniform Geometric Distortion, International Journal of Computer Information Systems and Industrial Management Applications, 8, 423-433, 2016.08.
31. Shoko Wakamiya, Hiroshi Kawasaki, Yukiko Kawai, Adam Jatowt, Eiji Aramaki, Toyokazu Akiyama, Lets not stare at smartphones while walking: Memorable route recommendation by detecting effective landmarks, UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 10.1145/2971648.2971758, 1136-1146, 2016.09, Navigation in unfamiliar cities often requires frequent map checking, which is troublesome for wayfinders. We propose a novel approach for improving real-world navigation by generating short, memorable and intuitive routes. To do so we detect useful landmarks for effective route navigation. This is done by exploiting not only geographic data but also crowd footprints in Social Network Services (SNS) and Location Based Social Networks (LBSN). Specifically, we detect point, area, and line landmarks by using three indicators to measure landmark's utility: visit popularity, direct visibility, and indirect visibility. We then construct an effective route graph based on the extracted landmarks, which facilitates optimal path search. In the experiments, we show that landmark-based routes outperform the ones created by baseline from the perspectives of the lap time and the number of references necessary to check self-positions for adjusting route directions..
32. Yuki Shiba, Satoshi Ono, Ryo Furukawa, Shinsaku Hiura, Hiroshi Kawasaki, Temporal Shape Super-Resolution by Intra-frame Motion Encoding Using High-fps Structured Light, Proceedings of the IEEE International Conference on Computer Vision, 10.1109/ICCV.2017.22, 2017-, 115-123, 2017.12, One of the solutions of depth imaging of moving scene is to project a static pattern on the object and use just a single image for reconstruction. However, if the motion of the object is too fast with respect to the exposure time of the image sensor, patterns on the captured image are blurred and reconstruction fails. In this paper, we impose multiple projection patterns into each single captured image to realize temporal super resolution of the depth image sequences. With our method, multiple patterns are projected onto the object with higher fps than possible with a camera. In this case, the observed pattern varies depending on the depth and motion of the object, so we can extract temporal information of the scene from each single image. The decoding process is realized using a learning-based approach where no geometric calibration is needed. Experiments confirm the effectiveness of our method where sequential shapes are reconstructed from a single image. Both quantitative evaluations and comparisons with recent techniques were also conducted..
33. Ryusuke Sagawa, Ryo Furukawa, Akiko Matsumoto, Hiroshi Kawasaki, Learning-based feature extraction for active 3D scan with reducing color crosstalk of multiple pattern projections, Robotics and Automation (ICRA), 2017 IEEE International Conference on, 2017.05.
34. Yuki Shiba, Satoshi Ono, Ryo Furukawa, Shinsaku Hiura, Hiroshi Kawasaki, Intra-frame motion encoding using high-fps structured light for temporal shape super-resolution, 第20回画像の認識・理解シンポジウム, OS3-1, 2017.08.
35. Ryo Furukawa, Ryusuke Sagawa, Hiroshi Kawasaki, Depth Estimation Using Structured Light Flow - Analysis of Projected Pattern Flow on an Object's Surface, Proceedings of the IEEE International Conference on Computer Vision, 10.1109/ICCV.2017.497, 2017-, 4650-4658, 2017.12, Shape reconstruction techniques using structured light have been widely researched and developed due to their robustness, high precision, and density. Because the techniques are based on decoding a pattern to find correspondences, it implicitly requires that the projected patterns be clearly captured by an image sensor, i.e., to avoid defocus and motion blur of the projected pattern. Although intensive researches have been conducted for solving defocus blur, few researches for motion blur and only solution is to capture with extremely fast shutter speed. In this paper, unlike the previous approaches, we actively utilize motion blur, which we refer to as a light flow, to estimate depth. Analysis reveals that minimum two light flows, which are retrieved from two projected patterns on the object, are required for depth estimation. To retrieve two light flows at the same time, two sets of parallel line patterns are illuminated from two video projectors and the size of motion blur of each line is precisely measured. By analyzing the light flows, i.e. lengths of the blurs, scene depth information is estimated. In the experiments, 3D shapes of fast moving objects, which are inevitably captured with motion blur, are successfully reconstructed by our technique..
36. Michihiro Mikamo, Hiroshi Kawasaki, Time Varying Displacement Map Synthesis for Rendering Water Drop Condensation using Image Database, The 21st Meeting on Image Recognition and Understanding, 1-6, 2018.08.
37. A structured light laser probe for gastrointestinal polyp size measurement: a preliminary comparative study.
38. Yuki Shiba, Satoshi Ono, Ryo Furukawa, Shinsaku Hiura, Hiroshi Kawasaki, Learning-based active 3D measurement technique using light field created by video projectors, IPSJ Transactions on Computer Vision and Applications, 10.1186/s41074-019-0058-y, 11, 6, 2019.07.
39. Trung-Nghia Le, Sugimoto Akihiro, Shintaro Ono, and Hiroshi Kawasaki, Toward Interactive Self- Annotation For Video Object BoundingBox: Recurrent Self-Learning And Hierarchical Annotation Based Framework, 2020 IEEE Winter Conference on Applicans of Computer Vision (WACV), 10 pages, 2020.03.
40. Sho Nakamura, Shintaro Ono, Hiroshi Kawasaki, Flooded Road Detection from Driving Recorder: Training Deep Net for Rare Event using GANs Semantic Information, International Journal of Intelligent Transportation Systems Research, 10.1007/s13177-019-00219-9, 10pages, 2020.01.
41. Sho Nakamura, Shintaro Ono, Hiroshi Kawasaki, Flooded Road Detection from Driving Recorder: Training Deep Net for Rare Event using GANs Semantic Information, 第17回ITSシンポジウム2019, 10pages, 2019.12.
42. Sayo Akihiko, Onizuka Hayato, Thomas Diego, Nakashima Yuta, Kawasaki Hirosh, Ikeuchi Katsushi, Human shape reconstruction with loose clothes from partially observed data by pose specific deformation, The Pacific-Rim Symposium on Image and Video Technology (PSIVT), 10.1007/978-3-030-34879-3_18, vol 11854, 225-239, 2019.11.
43. Ryo Furukawa, Genki Nagamatsu, Shiro Oka, Takahiro Kotachi, Yuki Okamoto, Shinji Tanaka, Hiroshi Kawasaki, Simultaneous shape and camera-projector parameter estimation for 3D endoscopic system using CNN-based grid-oneshot scan, MICCAI workshops AE-CAI, CARE (MIAR), 10.1049/htl.2019.0070, Vol. 6, Iss. 6, 249-254, 2019.10.
44. Kazuto Ichimaru, Hiroshi Kawasaki, Refraction-free Underwater Active One-shot Scan using Light Field Camera, 第22回画像の認識・理解シンポジウム, 4pages, 2019.07.
45. Genki Nagamatsu, Ryo Furukawa, Hiroshi Kawasaki, Non-Contact Cardiac Beat Detection Using Dot-line Based Oneshot Scanner, International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 1page, 2019.07.
46. Ryo Furukawa, Shiro Oka, Takahiro Kotachi, Yuki Okamoto, Shinji Tanaka, Hiroshi Kawasaki, Frame-Wise Auto-Calibration of Projector-Camera Pair of 3D Endoscope, International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 1page, 2019.07.
47. Ryo Furukawa, Shiro Oka, Takahiro Kotachi, Yuki Okamoto, Shinji Tanaka, Hiroshi Kawasaki, Simultaneous RGB and Depth Image Capture System Using Common Endoscope Based on Hight Frequency Alternative Pattern Projection, International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 1page, 2019.07.