Research研究

研究プロジェクト

Projects

計算機光学、波動場制御、ヒューマンコンピュータインタラクション、アクセシビリティ、メディアアートにまたがる主要研究プロジェクト。

Major research projects from the Digital Nature Group spanning computational optics, wave-field control, human-computer interaction, accessibility, and media art.

28Projects件数
26Active進行中
8Research Areas領域
249+Publications関連論文

Acoustic Levitation & Manipulation音響浮揚・操作

2 projects2件
2021–presentActive進行中

Acoustic Metamaterials & Holographic Sound Fields

音響メタマテリアルとホログラフィック音場

Acoustic Levitation & Manipulation音響浮揚・操作

Extension of acoustic levitation research into metamaterial-based sound control and computational acoustic holograms. Includes reflective acoustic metamaterials for dynamic particle positioning, digital twin approaches for experimental hologram optimization (Nature Communications Engineering 2024), and phased plate systems for spatial sound modulation (Applied Physics Letters 2025).

音響浮遊研究をメタマテリアルベースの音場制御と計算音響ホログラムに拡張。反射型音響メタマテリアルによる動的粒子位置制御、デジタルツインによるホログラム最適化（Nature Comms Engineering 2024）、フェーズドプレートによる空間音変調（APL 2025）を含む。

12Publications関連論文
Key Papers主要論文
  • A digital twin approach for experimental acoustic hologram optimization (Communications Engineering 2024)
  • Spatial Sound Modulation through Manual Reconfiguration of Phased Plate (APL 2025)
  • Reversible vertical positioning of acoustically levitated particle using a spiral reflector (2026)
  • Acoustic Technologies for Particle and Droplet Manipulation (Wiley 2023)
Collaborators共同者

Tatsuki Fushimi, Yusuke Koroyasu, Takayuki Hoshi, Bruce W. Drinkwater

DOI (Comms Eng)DOI (APL)
Pixie Dust: Acoustic Levitation & 3D Manipulation
2013–presentActive進行中

Pixie Dust: Acoustic Levitation & 3D Manipulation

Pixie Dust：超音波浮遊と3次元操作

Acoustic Levitation & Manipulation音響浮揚・操作

Pioneering research on three-dimensional mid-air acoustic manipulation using ultrasonic phased arrays. The Pixie Dust system enables non-contact levitation, transport, and rendering of small objects in computational acoustic-potential fields, demonstrating that graphics can be generated entirely through sound. This work became Ochiai's most-cited contribution (SIGGRAPH 2014, 206 citations; PLOS ONE 2014, 163 citations) and laid the foundation for Pixie Dust Technologies.

超音波フェーズドアレイによる空中3次元非接触操作の先駆的研究。小物体の浮揚・搬送・描画を計算音響ポテンシャル場で実現し、音だけでグラフィクスを生成できることを実証。SIGGRAPH 2014に採択され、206被引用を記録する最高被引用論文となり、Pixie Dust Technologiesの基盤技術となった。

25Publications関連論文
Key Papers主要論文
  • Pixie Dust: Graphics Generated by Levitated and Animated Objects in Computational Acoustic-Potential Field (SIGGRAPH 2014)
  • Three-dimensional Mid-air Acoustic Manipulation by Ultrasonic Phased Arrays (PLOS ONE 2014)
  • Three-dimensional Noncontact Manipulation by Opposed Ultrasonic Phased Arrays (JJAP 2014)
  • Microfluidic platform using focused ultrasound passing through hydrophobic meshes (PNAS NEXUS 2023)
Collaborators共同者

Takayuki Hoshi, Jun Rekimoto, Tatsuki Fushimi, Yusuke Koroyasu

DOI (SIGGRAPH 2014)DOI (PLOS ONE)

Computational Optics & Aerial Display計算機光学・空中映像

5 projects5件
2022–presentActive進行中

Computational Photography & Lighting Design

計算写真と照明デザイン

Computational Optics & Aerial Display計算機光学・空中映像

Research applying Bayesian optimization and human-in-the-loop methods to photographic lighting design, enabling non-expert users to achieve professional-quality lighting setups through iterative computational guidance. Published at UIST 2022 (15 citations). Extended through event-camera-based visual microphone research for recovering sound from visual vibration patterns.

ベイズ最適化とヒューマンインザループ手法を写真照明デザインに適用。非専門家がコンピュータの反復的案内を通じてプロ品質の照明設定を達成。UIST 2022（15被引用）で発表。イベントカメラベースのビジュアルマイクロフォン研究にも拡張。

4Publications関連論文
Key Papers主要論文
  • Photographic Lighting Design with Photographer-in-the-Loop Bayesian Optimization (UIST 2022)
  • Event Topology-based Visual Microphone for Amplitude and Frequency Reconstruction (2025)
Collaborators共同者

Kenta Yamamoto, Yuki Koyama, Ryogo Niwa

2017–presentActive進行中

Computational Holography & Neural CGH

計算機ホログラフィとニューラルCGH

Computational Optics & Aerial Display計算機光学・空中映像

Research on computer-generated holography (CGH) spanning lensless holographic projection, electroholography, and deep learning-based approaches. Recent work on Conditional Neural Holography introduces distance-adaptive CGH generation using neural networks (Optics Express 2025, 4 citations). Also includes TeraFoils for terahertz binary holographic structures and the Eholo Glass lensless AR display.

レンズレスホログラフィック投影、電子ホログラフィ、深層学習ベースのアプローチにわたる計算機生成ホログラフィ（CGH）研究。条件付きニューラルホログラフィは距離適応型CGH生成をニューラルネットで実現（Optics Express 2025）。テラヘルツ帯バイナリホログラム、Eholoグラス等を含む。

12Publications関連論文
Key Papers主要論文
  • Conditional neural holography: a distance-adaptive CGH generator (Optics Express 2025)
  • Lensless Zoomable Holographic Projection (Augmented Humans 2021)
  • DeepHolo: Recognizing 3D Objects using a Binary-weighted Computer-Generated Hologram (SIGGRAPH Asia 2017)
  • Eholo glass: electroholography glass, a lensless approach to holographic AR near-eye display (SIGGRAPH Asia 2018)
Collaborators共同者

Kenta Yamamoto, Yuto Asano, Tatsuki Fushimi, Naoya Muramatsu

DOI (Optics Express)
2016–presentActive進行中

Holographic Whisper & Spatial Audio

ホログラフィック・ウィスパーと空間音響

Computational Optics & Aerial Display計算機光学・空中映像

Research on rendering directional audible sound spots in three-dimensional space by computationally focusing ultrasonic waves. Holographic Whisper creates localized sound without physical speakers at target positions, enabling private audio and spatial soundscapes. Published at CHI 2017 (39 citations) and extended through holographic acoustic field research in Scientific Reports 2021 (67 citations).

超音波の計算的集束により三次元空間に指向性音響スポットを生成する研究。物理スピーカーなしで特定位置に局所的な音を生成し、プライベートオーディオや空間音響景観を実現。CHI 2017（39被引用）に採択、Scientific Reports 2021（67被引用）で拡張。

8Publications関連論文
Key Papers主要論文
  • Holographic Whisper: Rendering Audible Sound Spots in Three-dimensional Space by Focusing Ultrasonic Waves (CHI 2017)
  • Holographic acoustic field for a target sound field (Scientific Reports 2021)
Collaborators共同者

Takayuki Hoshi, Ippei Suzuki, Tatsuki Fushimi

Fairy Lights in Femtoseconds
2014–presentActive進行中

Fairy Lights in Femtoseconds

フェアリー・ライツ・イン・フェムトセカンド

Computational Optics & Aerial Display計算機光学・空中映像

Volumetric display system rendering aerial and three-dimensional graphics by focusing femtosecond laser pulses to create plasma voxels in mid-air. The system enables touchable holographic images without any physical screen, combining computational holographic fields with ultrafast optics. Published in ACM Transactions on Graphics (2016, 99 citations) and demonstrated at SIGGRAPH 2015 Emerging Technologies.

フェムト秒レーザーパルスを集光してプラズマボクセルを空中に生成する体積型ディスプレイ。物理的スクリーンなしで触れるホログラフィック像を実現。ACM TOG（2016年、99被引用）に掲載、SIGGRAPH 2015 Emerging Technologiesで実演。

10Publications関連論文
Key Papers主要論文
  • Fairy Lights in Femtoseconds: Aerial and Volumetric Graphics Rendered by Focused Femtosecond Laser Combined with Computational Holographic Fields (ACM TOG 2016)
  • Cross-Field Aerial Haptics: Rendering Haptic Feedback in Air with Light and Acoustic Fields (CHI 2016)
Collaborators共同者

Kota Kumagai, Takayuki Hoshi, Jun Rekimoto, Satoshi Hasegawa, Yoshio Hayasaki

DOI (ACM TOG)DOI (CHI 2016)
2012–presentActive進行中

Aerial & See-Through Display Systems

空中・透過型ディスプレイシステム

Computational Optics & Aerial Display計算機光学・空中映像

A long-running stream of display research beginning with A Colloidal Display (SIGGRAPH 2012) through aerosol-based light field displays, retinal projection using metamaterial optics, crossed mirror arrays, ReverseCAVE for shared VR visualization, and See-Through Face Displays for gaze-aware communication. Includes transmissive mirror devices, solar projectors, and bubble-cloud displays.

コロイダルディスプレイ（SIGGRAPH 2012）から始まり、エアロゾル光線場ディスプレイ、メタマテリアル光学による網膜投影、クロスミラーアレイ、共有VR可視化のReverseCAVE、視線意識通信のSee-Through Face Displayに至る長期ディスプレイ研究。

25Publications関連論文
Key Papers主要論文
  • A Colloidal Display: Membrane Screen that Combines Transparency, BRDF and 3D Volume (SIGGRAPH 2012)
  • ReverseCAVE: providing reverse perspectives for sharing VR experience (SIGGRAPH 2017)
  • Make your own retinal projector: retinal near-eye displays via metamaterials (SIGGRAPH 2018 E-Tech)
  • See-Through Face Display: Enabling Gaze Communication for Any Face (SIGGRAPH Asia 2024)
Collaborators共同者

Ippei Suzuki, Kazuki Otao, Yuta Itoh, Kazuya Izumi

DOI (Colloidal)

Media Art & Installationメディアアート・インスタレーション

4 projects4件
2023–presentActive進行中

Dynamic Caustics & Ultrasonic Optical Art

動的コースティクスと超音波光学アート

Media Art & Installationメディアアート・インスタレーション

Artistic and scientific exploration of caustic light patterns generated by ultrasonically modulated liquid surfaces. By computationally controlling ultrasonic wave fields to shape water surfaces, the system renders dynamic light patterns through refraction. Published in Scientific Reports 2025 and demonstrated at SIGGRAPH 2024 Emerging Technologies.

超音波で変調した液面によるコースティクス光パターンの芸術的・科学的探求。超音波場を計算制御して水面を成形し、屈折による動的光パターンを描画。Scientific Reports 2025に掲載、SIGGRAPH 2024 Emerging Technologiesで実演。

3Publications関連論文
Key Papers主要論文
  • Dynamic Caustics by Ultrasonically Modulated Liquid Surface (Scientific Reports 2025)
  • Dynamic Acousto-Caustics in Dual-Optimized Holographic Fields (SIGGRAPH 2024 E-Tech)
Collaborators共同者

Koki Nagakura, Tatsuki Fushimi, Ayaka Tsutsui

DOI (Sci Rep)
2022–presentActive進行中

Computational Alternative Photographic Processes

計算論的オルタナティブ写真プロセス

Media Art & Installationメディアアート・インスタレーション

Research bridging digital technology with historical photographic printing techniques such as cyanotype, ambrotype, and other alternative processes. Investigates whether AI-generated images can carry the 'aura' of analog processes and explores sustainable printing through computational design. Published as Art Papers at SIGGRAPH Asia 2023 and 2024.

サイアノタイプやアンブロタイプなどの歴史的写真印刷技術とデジタル技術を橋渡しする研究。AI生成画像がアナログプロセスの「アウラ」を保持できるかを調査。SIGGRAPH Asia 2023・2024でアートペーパーとして発表。

5Publications関連論文
Key Papers主要論文
  • Can AI Generated Ambrotype Chain the Aura of Alternative Process? (SIGGRAPH Asia 2024 Art Papers)
  • Alternative Photographic Processes Reimagined (SIGGRAPH Asia 2023 Art Papers)
  • Computational Alternative Photographic Process toward Sustainable Printing (SIGGRAPH Asia 2022)
Collaborators共同者

Chinatsu Ozawa, Kenta Yamamoto, Kazuya Izumi

DOI (SA 2022)
null² Signature Pavilion (Expo 2025)
2020–2025Completed完了

null² Signature Pavilion (Expo 2025)

null² シグネチャーパビリオン（万博2025）

Media Art & Installationメディアアート・インスタレーション

Signature Pavilion at Expo 2025 Osaka-Kansai, integrating mirror-membrane architecture with AI-driven environmental control. The null² concept dissolves boundaries between body and architecture toward Digital Nature, combining computational sensing, large-scale mirror surfaces, and generative audiovisual systems. Ochiai served as Signature Pavilion Producer from 2020 to 2025.

万博2025大阪・関西のシグネチャーパビリオン。ミラーメンブレン建築とAI駆動環境制御を統合。null²のコンセプトは身体と建築の境界を溶解し、計算機自然を志向。

2Publications関連論文
Key Papers主要論文
  • null2: Boundary-Dissolving Bodies and Architecture towards Digital Nature (arXiv 2025)
Collaborators共同者

Expo 2025 Japan Association

2015–presentActive進行中

Solo Exhibitions & Media Art Practice

個展とメディアアート実践

Media Art & Installationメディアアート・インスタレーション

Over 30 solo exhibitions at major international venues including Ars Electronica, SIGGRAPH Art Gallery, the Barbican Centre, and Museum of Contemporary Art Tokyo. Artistic practice explores materiality, synesthesia, and the boundary between digital and physical, rooted in Digital Nature philosophy. Upcoming: Kirishima Open-Air Museum (Jul-Sep 2026), Mission Infinity: Space + Quantum + Art (2026).

Ars Electronica、SIGGRAPHアートギャラリー、バービカンセンター、東京都現代美術館など主要国際会場での30以上の個展。物質性、共感覚、デジタルと物理の境界を計算機自然の哲学に根ざして探求。今後：霧島アートの森（2026）。

5Publications関連論文
Key Papers主要論文
  • Levitrope: Installation rendering mid-air images by levitation (SIGGRAPH 2016 Art Gallery)
  • Photographic Conviviality: A Synchronic and Symbiotic Photographic Experience (2025)
Portfolio

Accessibility & xDiversityアクセシビリティ・xDiversity

4 projects4件
2025–presentActive進行中

MotionBuddy: Tactile Motion Learning for Blind People

MotionBuddy：視覚障害者のための触覚動作学習

Accessibility & xDiversityアクセシビリティ・xDiversity

Tabletop humanoid robot system that teaches body movements to blind people through tactile feedback. Using 3D-printed tactile poses and robot-guided kinesthetic instruction, the system enables blind users to learn and verify physical movements independently. Published at HRI 2026 and TEI 2026 in collaboration with IBM Research.

卓上ヒューマノイドロボットで視覚障害者に触覚フィードバックを通じて身体動作を教えるシステム。HRI 2026・TEI 2026で発表。

3Publications関連論文
Key Papers主要論文
  • MotionBuddy: Exploring Tactile-Based Motion Learning with a Tabletop Humanoid Robot for Blind People (HRI 2026)
  • Touching Movement: 3D Tactile Poses for Supporting Blind People in Learning Body Movements (TEI 2026)
Collaborators共同者

Kengo Tanaka, Chieko Asakawa, Hironobu Takagi

DOI (HRI)
See-Through Captions
2019–presentActive進行中

See-Through Captions

シースルーキャプション

Accessibility & xDiversityアクセシビリティ・xDiversity

Real-time captioning system using transparent displays that enables deaf and hard-of-hearing (DHH) people to read speech-to-text captions while maintaining face-to-face visual contact with the speaker. Extended to museum guided tours (ICCHP 2022) and sign language conversations (ETRA 2025). Core technology of the xDiversity accessibility platform.

透明ディスプレイを用いたリアルタイム字幕システム。聴覚障害者が話者との対面視覚接触を維持しながら音声テキスト字幕を読める。美術館ガイドツアー（ICCHP 2022）や手話会話（ETRA 2025）に拡張。

8Publications関連論文
Key Papers主要論文
  • See-Through Captions: Real-Time Captioning on Transparent Display for Deaf and Hard-of-Hearing People (ASSETS 2021)
  • See-Through Captions in a Museum Guided Tour for DHH People (ICCHP-AAATE 2022)
  • See-Through Face Display for DHH People (ETRA 2025)
Collaborators共同者

Ippei Suzuki, Kenta Yamamoto, Akihisa Shitara, Kazuya Izumi

DOI (ICCHP)
2018–presentActive進行中

xDiversity: AI-Based Accessibility Platform

xDiversity：AIベースのアクセシビリティプラットフォーム

Accessibility & xDiversityアクセシビリティ・xDiversity

JST CREST-funded research program developing spatial audiovisual-tactile technology for a computationally diverse society. Encompasses assistive technologies for DHH people (HaptStarter for sprinters, gestural musical instruments), low-vision accessibility (Low Vision Boxing, community-driven digital libraries), tactile graphics generation via AI, and wheelchair navigation systems.

JST CREST研究プログラム。計算論的に多様な社会のための空間視聴触覚技術を開発。聴覚障害者支援、弱視アクセシビリティ、AIによる触覚図版生成、車椅子ナビゲーション等を包含。

30Publications関連論文
Key Papers主要論文
  • HaptStarter: Designing haptic stimulus start system for DHH sprinters (IJHCS 2024)
  • Low Vision Boxing: Participatory Design of Adaptive Kickboxing Experiences (ASSETS 2024)
  • Text to Haptics: Designing Tactile Graphics for Inclusive Tactile Picture Books (SIGGRAPH 2023 Labs)
  • Telewheelchair: The Remote Controllable Electric Wheelchair System (Augmented Human 2018)
Collaborators共同者

Akihisa Shitara, Kengo Tanaka, Ayaka Tsutsui, Sayan Sarcar, Ryo Iijima

xDiversityJST CREST
2018–presentActive進行中

Concert without Hearing by Ear

耳で聴かないコンサート

Accessibility & xDiversityアクセシビリティ・xDiversity

Ongoing collaboration with the Japan Philharmonic Orchestra pioneering multisensory concert experiences that transcend conventional auditory boundaries. Uses wearable vibrotactile devices (LIVEJACKET), spatial computing, and visual translation to enable participation by people with diverse hearing abilities.

日本フィルハーモニー交響楽団との継続的コラボレーション。従来の聴覚の境界を超える多感覚コンサート体験を開拓。ウェアラブル振動触覚デバイス、空間コンピューティング、視覚翻訳を活用。

5Publications関連論文
Key Papers主要論文
  • LIVEJACKET: Wearable Music Experience Device with Multiple Speakers (HCII 2018)
  • Designing Gestures for Digital Musical Instruments (ASSETS 2022)
  • Concerts with vibrational scores (SUI 2021)
Collaborators共同者

Japan Philharmonic Orchestra, Satoshi Hashizume

Digital Fabrication & Metamaterialsデジタルファブリケーション・メタマテリアル

3 projects3件
2023–presentActive進行中

Ultrasonic Fabrication: HIFU Embossment

超音波ファブリケーション：HIFU型押し加工

Digital Fabrication & Metamaterialsデジタルファブリケーション・メタマテリアル

Novel fabrication methods using high-intensity focused ultrasound (HIFU) for non-contact embossment of acrylic sheets with controllable transparency. Published at CHI 2024 and demonstrated at SIGGRAPH 2023 Labs. Bridges acoustic field control with digital fabrication, enabling new material expression possibilities.

高強度集束超音波（HIFU）によるアクリルシートの非接触型押し加工と透明度制御の新ファブリケーション手法。CHI 2024で発表、SIGGRAPH 2023 Labsで実演。

4Publications関連論文
Key Papers主要論文
  • HIFU Embossment of Acrylic Sheets (CHI 2024)
  • Ultrasonic Embossment of Acrylic Sheets with Transparency Control (SIGGRAPH 2023 Labs)
Collaborators共同者

Ayaka Tsutsui, Tatsuki Fushimi, Kengo Tanaka

2018–presentActive進行中

AI-Driven Fashion & Textile Design

AI駆動のファッション・テキスタイルデザイン

Digital Fabrication & Metamaterialsデジタルファブリケーション・メタマテリアル

Research on human-AI collaborative design in fashion, from DeepWear (TEI 2018, 27 citations) exploring AI-generated clothing design to GANs-based pattern generation (Augmented Human 2019, 37 citations) and digital preservation of Ainu textile patterns using computational analysis.

DeepWear（TEI 2018、27被引用）によるAI生成衣服デザインからGANベースのパターン生成（AH 2019、37被引用）、アイヌ織物パターンのデジタル保存まで、人間-AI協働ファッションデザイン研究。

5Publications関連論文
Key Papers主要論文
  • GANs-based Clothes Design: Pattern Maker Is All You Need to Design Clothing (Augmented Human 2019)
  • DeepWear: a Case Study of Collaborative Design between Human and AI (TEI 2018)
  • An exploration in digital techniques to read Ainu textile patterns (J. Cultural Heritage 2025)
Collaborators共同者

Natsumi Kato, Hiroyuki Osone, Xanat Vargas Meza

DOI (Ainu)
2017–presentActive進行中

Digital Fabrication & Metamaterial Structures

デジタルファブリケーションとメタマテリアル構造

Digital Fabrication & Metamaterialsデジタルファブリケーション・メタマテリアル

Research on computational design and fabrication of functional objects including metamaterial-based shape-changing interfaces (Coded Skeleton), biologically-inspired tools (Kuchibashi), Ron Resch folding structures, and BOLCOF optimization for failure-free 3D printing. Includes pioneering work on silk fabrication using silkworms as biological 3D printers.

メタマテリアルベースの形状変化インターフェース、生物模倣ツール、故障のない三次元印刷最適化など、計算設計とファブリケーションの研究。蛚を生物学的三次元プリンターとして利用するシルクファブリケーションも含む。

15Publications関連論文
Key Papers主要論文
  • Coded Skeleton: Shape Changing User Interface with Mechanical Metamaterial (SIGGRAPH Asia 2018)
  • Silk Fabricator: Using Silkworms as 3D Printers (SIGGRAPH Asia 2017)
  • Kuchibashi: 3D-Printed Tweezers Bioinspired by the New Caledonian Crow's Beak (SIGGRAPH 2022)
Collaborators共同者

Kazuki Takazawa, Kenta Yamamoto, Takahito Murakami

AI & Computational CreativityAI・計算創造性

4 projects4件
2023–presentActive進行中

Generative AI for HCI Research Methods

HCI研究手法のための生成AI

AI & Computational CreativityAI・計算創造性

Research on leveraging large language models and generative AI to transform HCI research methodology. Includes LLM-driven qualitative analysis, AI-guided user studies for novel domains (air taxi services), automated game design using AutoGPT, and AI-enabled digital human debates for self-reflection.

大規模言語モデルと生成AIを活用してHCI研究方法論を変革する研究。LLM駆動の質的分析、AI誘導ユーザー研究、AutoGPTによる自動ゲームデザイン、AIデジタルヒューマン討論を含む。

6Publications関連論文
Key Papers主要論文
  • Expanding Horizons in HCI Research Through LLM-Driven Qualitative Analysis (2024)
  • Lottery and Sprint: Generate a Board Game with Design Sprint Method on AutoGPT (CHI PLAY 2023)
  • Generative artificial intelligence-guided user studies (Behaviour & IT 2025)
  • Knowing Ourselves Through Others: Reflecting with AI in Digital Human Debates (2025)
Collaborators共同者

Maya Grace Torii, Takahito Murakami, Jingjing Li

2021–2022Completed完了

BunCho: AI Story Co-Creation

BunCho：AI物語共創

AI & Computational CreativityAI・計算創造性

AI-supported creative writing system that enhances writers' creativity in Japanese through unsupervised multitask learning. BunCho generates narrative suggestions, character descriptions, and plot developments to assist human authors in co-creating stories. Published at CHI Extended Abstracts 2021 with 77 citations, making it one of the most-cited AI creativity papers from the lab.

非教師ありマルチタスク学習により日本語での執筆者の創造性を高めるAI支援創作システム。CHI EA 2021で77被引用を記録。

2Publications関連論文
Key Papers主要論文
  • BunCho: AI Supported Story Co-Creation via Unsupervised Multitask Learning (CHI EA 2021)
Collaborators共同者

Hiroyuki Osone, Jun-Li Lu

2020–presentActive進行中

Digital Heritage & Museum Technology

デジタルヘリテージと博物館テクノロジー

AI & Computational CreativityAI・計算創造性

Systematic research on digital transformation in museums and cultural heritage, including bibliometric analysis of immersive technology in exhibitions (Frontiers in VR 2023, 75 citations), digital preservation of Ainu cultural artifacts, and psychological distance in digital museum experiences (Computers in Human Behavior 2024, 65 citations).

博物館・文化遺産のデジタル変革に関する体系的研究。展示における没入技術のビブリオメトリクス分析（Frontiers in VR 2023、75被引用）、アイヌ文化遺産のデジタル保存、デジタル博物館体験の心理的距離（CHB 2024、65被引用）。

10Publications関連論文
Key Papers主要論文
  • A systematic review of digital transformation technologies in museum exhibition (Computers in Human Behavior 2024)
  • A bibliometric analysis of immersive technology in museum exhibitions (Frontiers in VR 2023)
  • YouTube Itak: a description of Ainu-related videos (Humanities & Social Sciences Communications 2023)
Collaborators共同者

Jingjing Li, Xanat Vargas Meza

DOI (CHB)
2017–presentActive進行中

Neural Rendering & Telepresence

ニューラルレンダリングとテレプレゼンス

AI & Computational CreativityAI・計算創造性

Research on telepresence and shared virtual environments, from You as a Puppet puppetry telepresence (UIST 2017, 35 citations) through Distributed Metaverse using blockchain (Augmented Human 2018, 81 citations) to Deep Billboards for real-to-sim VR (SIGGRAPH 2022) and Gaussian splatting-based avatars (SUI 2025). Also includes underwater VR and mirrored billboards for metaverse asset sharing.

パペット型テレプレゼンス（UIST 2017、35被引用）からブロックチェーン分散メタバース（AH 2018、81被引用）、VR向けDeep Billboards（SIGGRAPH 2022）、ガウシアンスプラッティングアバター（SUI 2025）までの研究。

12Publications関連論文
Key Papers主要論文
  • Distributed Metaverse: Creating Decentralized Blockchain-based Model for Peer-to-peer Sharing of Virtual Spaces (Augmented Human 2018)
  • You as a Puppet: Evaluation of Telepresence User Interface for Puppetry (UIST 2017)
  • Immersive Real World through Deep Billboards (SIGGRAPH 2022)
  • Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications (SUI 2025)
Collaborators共同者

Bektur Ryskeldiev, Mose Sakashita, Naruya Kondo, Shixiang Shane Gu

Wave Control Technology波動制御技術

3 projects3件
2022–presentActive進行中

Bio-Hybrid Systems & Living Interfaces

バイオハイブリッドシステムと生体インターフェース

Wave Control Technology波動制御技術

Research exploring the integration of living organisms with computational control systems. Calmbots uses Madagascar cockroaches as ubiquitous living interfaces (CHI EA 2022), while Insect-Computer Hybrid Speaker controls cicada chirps via electrical muscle stimulation to create bio-hybrid sound actuators.

生物と計算制御システムの統合を探求する研究。Calmbotsはマダガスカルゴキブリをユビキタス生体インターフェースとして活用。昆虫-コンピュータハイブリッドスピーカーも実現。

4Publications関連論文
Key Papers主要論文
  • Calmbots: Exploring Possibilities of Multiple Insects with On-hand Devices (CHI EA 2022)
  • Insect-Computer Hybrid Speaker: Speaker using Chirp of the Cicada Controlled by EMS (2025)
Collaborators共同者

Yuga Tsukuda, Daichi Tagami, Jun Lu

2015–presentActive進行中

Pixie Dust Technologies & Wave Control Products

ピクシーダストテクノロジーズと波動制御プロダクト

Wave Control Technology波動制御技術

Commercial translation of wave-control research through Pixie Dust Technologies, Inc. (founded 2015, NASDAQ-listed 2023, privatized 2024). Products include SonoRepro (focused ultrasound scalp care, CES Innovation Award 2023) and iwasemi RC alpha (acoustic metamaterial noise reduction, CES Innovation Award 2024).

波動制御研究の商用展開を行うピクシーダストテクノロジーズ株式会社（2015設立、2023 NASDAQ上場、2024非公開化）。SonoRepro、iwasemi RC alphaを展開。

3Publications関連論文
Key Papers主要論文
  • SonoRepro: Focused ultrasound scalp care device (CES Innovation Award 2023)
  • iwasemi RC alpha: Acoustic metamaterial noise reduction (CES Innovation Award 2024)
Collaborators共同者

Pixie Dust Technologies

2015–presentActive進行中

Haptics, EMS & Vestibular Interfaces

ハプティクス・EMS・前庭インターフェース

Wave Control Technology波動制御技術

Research on novel haptic feedback systems combining acoustic, electromagnetic, and electrical muscle stimulation (EMS) modalities. Includes cross-field haptics merging ultrasound with laser plasma, Sonovortex aerodynamic vortex haptics, EMS-based musical instrument training (45 citations), and galvanic vestibular stimulation for VR hand redirection (UIST 2025).

音響・電磁・電気筋肉刺激（EMS）を組み合わせた新規ハプティクスフィードバック研究。クロスフィールドハプティクス、EMS楽器訓練（45被引用）、VR手誘導のための前庭電気刺激（UIST 2025）を含む。

18Publications関連論文
Key Papers主要論文
  • Stimulated percussions: method to control human for learning music by using EMS (Augmented Human 2017)
  • Vestibular Stimulation Enhances Hand Redirection (UIST 2025)
  • Cross-field haptics: Tactile device combining haptic and light fields (SIGGRAPH Asia 2016 E-Tech)
  • Diminished Haptics: Towards Digital Transformation of Real World Textures (EuroHaptics 2014)
Collaborators共同者

Satoshi Hashizume, Shieru Suzuki, Kensuke Katori, Pedro Lopes

Digital Nature (Core Vision)計算機自然（中核構想）

3 projects3件
2024–presentActive進行中

Mixed Reality & Embodied Interaction

複合現実と身体的インタラクション

Digital Nature (Core Vision)計算機自然（中核構想）

Research exploring the phenomenological boundaries between physical and digital presence. Includes Floating on the Boundary (half-digital/half-physical object perception), Qi-exploration through Mixed Reality kendo practice, and AnimeGaze for mutual gaze synthesis. These works investigate how Digital Nature manifests in embodied, culturally-situated interaction.

物理的・デジタル的存在の現象学的境界を探求する研究。半デジタル半物理オブジェクト知覚のFloating on the Boundary、MR剣道練習を通じた気の探求、相互視線合成のAnimeGazeを含む。

5Publications関連論文
Key Papers主要論文
  • Floating on the Boundary: Perceptions of Reality in a Half-Digital Half-Physical Bunny (Proc. ACM CGIT 2024)
  • Discipline Together with the Self in Kendo: Exploring 'Qi' through Mixed Reality and Autoethnography (Proc. ACM CGIT 2025)
  • AnimeGaze: Real-Time Mutual Gaze Synthesis for Anime-Style Avatars (2025)
Collaborators共同者

Takumi Yokoyama, Karen Furuta, Kazuya Izumi, Jingjing Li

DOI (Kendo)
2019–presentActive進行中

Multisensory Experience Design

多感覚体験デザイン

Digital Nature (Core Vision)計算機自然（中核構想）

Research on augmenting human perception through environmental and multisensory manipulation. Core work on taste augmentation of wine through artificial climate rooms, controlling temperature and humidity to modulate taste evaluation (Augmented Human Research 2025, 4 citations). Extends the Digital Nature concept into gustatory and environmental experience design.

環境的・多感覚的操作による人間知覚の拡張研究。人工気候室でのワインの味覚増強が中核（Augmented Human Research 2025）。計算機自然のコンセプトを味覚・環境体験デザインに拡張。

3Publications関連論文
Key Papers主要論文
  • Taste Augmentation of Wine by Artificial Climate Room (Augmented Human Research 2025)
  • Augmented taste of wine by artificial climate room (Augmented Human 2019)
Collaborators共同者

Toshiharu Igarashi

2015–presentActive進行中

Digital Nature: Core Vision & Theoretical Framework

計算機自然：中核ビジョンと理論的枠組み

Digital Nature (Core Vision)計算機自然（中核構想）

The overarching research program that unifies Ochiai's work: Digital Nature (Keisanki Shizen) posits that computational environments constitute a new form of nature alongside physical reality. The theoretical framework has evolved from initial formulation (2015) through LLM-era revision (2023) to a ten-year synthesis (2025). Embodied in the R&D Center for Digital Nature at University of Tsukuba.

落合研究を統合する包括的研究プログラム。計算機自然は計算環境が物理的現実と並ぶ新たな自然であると位置づける。筑波大学R&Dセンターで具現化。

5Publications関連論文
Key Papers主要論文
  • Digital Nature Revisited: A Ten-Year Synthesis of Art, Technology, and the Evolution of 'Nature' (2025)
  • Towards Digital Nature: Bridging the Gap between Turing Machine Objects and Linguistic Objects in LLMMs (2023)
  • Pixels Toward Pixies: Post-Multimedia Interactions (SID 2016)
Collaborators共同者

Takashi Shimizu, Naruya Kondo, Tatsuki Fushimi

Digital Nature Group