Profile
I’m a Research Scientist on the HCI team at SB Intuitions, a SoftBank company focused on generative AI research and development. I received a Ph.D. in Interdisciplinary Information Studies (Applied Computer Science) at the University of Tokyo, advised by Jun Rekimoto and Yoshio Ishiguro.
I previously worked as a Research Intern at the University of Washington’s Paul G. Allen School of Computer Science & Engineering (UW CSE), advised by Shyam Gollakota, and as a Research Assistant at AIST’s Human Augmentation Research Center. I have been an Individual Researcher in JST ACT-X since 2023 and entered its Acceleration Phase in 2026. I have also served as a Technical Advisor at Tokyo Ishigaku Sogo Kenkyujo, K.K. since April 2025.
My research interests include speech interfaces and human–computer interaction. I explore speech input through very quiet utterances and in noisy environments. My work includes interfaces for silent speech and whispered speech, combining sensing hardware and machine learning to make speech input practical in everyday environments. My awards include the James Dyson Award 2024 (Japan National Winner) and the IPSJ Yamashita Memorial Research Award (2026).
News
-
I joined the HCI team at SB Intuitions as a Research Scientist.
-
I received my Ph.D. in Interdisciplinary Information Studies (Applied Computer Science) from the Graduate School of Interdisciplinary Information Studies at the University of Tokyo.
-
My research in JST ACT-X entered the Acceleration Phase. Project details
-
I received the IPSJ Yamashita Memorial Research Award for ClothTalk. Award recipients
-
I joined the University of Washington, Paul G. Allen School of Computer Science & Engineering, as a Research Scholar (Internship), advised by Shyam Gollakota.
-
MaskClip was featured on TV Tokyo’s World Business Satellite (WBS). TV feature
-
Our paper on ClothTalk, a conductive cloth microphone for clear speech in noisy environments, was published in IEEE Access. Paper
-
MaskClip, a collaboration between Rekimoto Laboratory and Murata Manufacturing, received the Digital Minister’s Award at CEATEC AWARD 2025. Award announcement
-
Our paper on SilentWhisper, recognizing speech whispered at extremely low volumes, was published in IEEE Access. Paper
-
ClothTalk received the Best Paper, Best Presentation, and Interactive Presentation (PC Recommendation) Awards at Interaction 2025. Award announcement
-
WhisperMask was named the Japan National Winner of the James Dyson Award 2024. Award announcement
-
I began my JST ACT-X project on wearable voice input/output interfaces for face-to-face communication. Project details
Recent publications
- 2025
- 2025
- 2025
Projects
ClothTalk
2025Conductive cloth microphone for clear, real-time speech in noisy environments
SilentWhisper
2025Speech recognition for whispers too quiet for people nearby to hear
MaskClip
2025A detachable clip that turns mask vibrations into clear speech input
WhisperMask
2024Mask-type microphone available in noisy environments
E-Mask
2022E-MASK: A Mask-Shaped Interface for Silent Speech Interaction with Flexible Strain Sensors
e-Pose
2022Headphone-type device capable of full-body pose estimation
SilentMask
2021Mask-type Silent Speech Interface with Measurement of Mouth Movement
YU-RA
2022Spatial work that creates transition through the movement of light
Media
- MaskClip turns a face mask into a microphone, with potential applications in healthcare ITmedia NEWS · Online media · In Japanese
- CEATEC draws 810 exhibitors, its third-largest turnout; ministerial awards go to Sharp and NTT DOCOMO Nikkei · Newspaper · In Japanese
- ClothTalk: a fabric microphone that captures clear speech even in very noisy environments ITmedia NEWS · Online media · In Japanese
- University of Tokyo student wins Japan’s top prize in the James Dyson Award 2024 Dyson / PR TIMES · Online media · In Japanese
- A mask that recognizes silently mouthed speech with around 80% accuracy ITmedia NEWS · Online media · In Japanese
Experience
- 2026.09 — Present
- Research ScientistSB Intuitions
HCI team
- 2026.04 — Present
- Individual ResearcherJST ACT-X Acceleration Phase
Development of a wearable voice input/output interface for enhancing face-to-face vocalization
- Joined 2025.12 — 2026.05
- Research Scholar (Internship)Paul G. Allen School of Computer Science & Engineering, University of Washington
Advised by: Shyam Gollakota
- 2025.04 — Present
- Technical AdvisorTokyo Ishigaku Sogo Kenkyujo, K.K.
- 2023.10 — 2026.03
- Individual ResearcherJST ACT-X
Development of a wearable voice input/output interface for enhancing face-to-face vocalization
- 2022.04 — 2025.03
- Research AssistantNational Institute of Advanced Industrial Science and Technology
Human Augmentation Research Center
- 2021.07 — 2022.03
- CreatorIPA Exploratory IT Human Resources Project 2021
Software Engineer, Hardware Engineer, and Designer
- 2017.08 — 2021.09
- Software EngineerYoshidumi. Inc
Backend Engineer and Web Writer
Education
- 2022.04 — 2026.09
- Ph.D. in Interdisciplinary Information Studies (Applied Computer Science)Graduate School of Interdisciplinary Information Studies, The University of Tokyo
Advised by: Jun Rekimoto, Yoshio Ishiguro
- 2020 — 2022
- Master’s degree in Interdisciplinary Information Studies (Applied Computer Science)The University of Tokyo
Advised by: Jun Rekimoto
- 2016 — 2020
- B.Eng., Information and Communication EngineeringThe University of Tokyo
Advised by: Hiroshi Esaki, Hideya Ochiai
Awards
- 2026Information Processing Society of Japan (IPSJ) Yamashita Memorial Research Award URL
- 2025CEATEC AWARD 2025 Digital Minister's Award URL
- 2025IPSJ Interaction 2025 Best Paper, Best Presentation, and Interactive Presentation Awards URL
- 2025Acoustical Society of Japan 29th Autumn Meeting Student Outstanding Presentation Award URL
- 2024James Dyson Award 2024 Japan National Winner URL
- 2024Best Paper Honorable Mention Award at Augmented Humans 2024 (AHs24) URL
- 2024GUGEN 2024 Good Idea Award and two additional prizes URL
- 2024IPSJ UBI Technical Committee #84 Student Outstanding Presentation Award URL
- 2022The University of Tokyo, GSII, Head of Department Award and Best Master’s Thesis Award URL
- 2022Good Design New Hope Award, Honorable mention URL
- 2022Japan Industry Designer's Association Next Age Award URL
- 2022Demo Award at Workshop on Interactive Systems and Software (Domestic Conference) URL
- 2021Information-technology Promotion Agency (IPA) MITOU Program URL
- 2021Best Presentation Award at Silent Speech Recognition Workshop (Domestic Workshop) URL
- 2021Best Presentation Award at Institute of Environmental Art and Design (Domestic Conference) URL
- 2021The University of Tokyo Hongo Tech Garage Spring Founder Program URL
Grants & scholarships
- 2026 — 2027
- JST ACT-X Acceleration Phase
- 2023 — 2026
- JST ACT-X
- 2022 — 2026
- The University of Tokyo, International Graduate Program of Innovation for Intelligent World
- 2021 — 2022
- IPA MITOU Program
Contact
For work inquiries or research collaborations, please get in touch by email.
hirotakahiraki@gmail.com