核心壁垒Core Moat

LIBR 算法 —— 软组织实时变形矫正的行业唯一方案LIBR — the only published deformation correction crossing clinical usability

软组织手术导航最难的一步,就是在术中实时校正"术前影像和真实组织对不上"的偏差。这个问题十年没人真正解决 —— 我们用 LIBR 算法做出了行业里第一个能跨越临床可用线(5mm 以内)的方案。The hardest problem in soft-tissue navigation is real-time intraoperative correction — preop imaging never matches the deformed reality. For a decade, no one has truly solved it. LIBR is the first published method to cross the 5mm clinical usability threshold.

  • 肝脏活体亚表面误差:10.4mm → 6.1±2.8mm(IEEE TBME 2026 一作)Liver in-vivo subsurface: 10.4mm → 6.1±2.8mm (IEEE TBME 2026, first author)
  • 乳腺活体亚表面误差:10.4mm → 4.2±1.0mmBreast in-vivo subsurface: 10.4mm → 4.2±1.0mm
  • 仿体测试(XFEM + 非线性应变硬化):1.7±0.8mmPhantom tests (XFEM + nonlinear strain hardening): 1.7±0.8mm
  • 原创者 Heiselman 教授(公司算法首席顾问)持续优化Continuously advanced by original author Prof. Heiselman (Chief Algorithm Advisor)
DEFORMATION ERROR · IN-VIVO LIVER · BASELINE 10.4 mm LIVER · LIBR 6.1 mm BREAST · BASELINE 10.4 mm BREAST · LIBR 4.2 mm PHANTOM · LIBR+ (XFEM) 1.7 mm 5 mm · CLINICAL THRESHOLD
平台架构Architecture

三层架构Three-Layer Architecture

L1
感知层 · Perception Perception Layer RGB-D · AHAT · 光学追踪 · 超声 · 协作臂主动视觉RGB-D · AHAT · Optical Tracking · Ultrasound · Cobot Vision
多模态空间感知:RGB-D 深度相机、AHAT 深度感知、光学追踪、术中超声、协作机械臂主动视觉。Multi-modal spatial sensing: RGB-D depth, AHAT, optical tracking, intraoperative ultrasound, and active vision from cobots.
L2
计算层 · Cognition Cognition Layer LIBR / LIBR+ · 生物力学 · 实时重建 · 语义分割LIBR / LIBR+ · Biomechanics · Real-time Recon · Semantic Segmentation
Spatial AI 核心算法:LIBR / LIBR+ 软组织变形补偿、生物力学建模、实时三维重建、组织语义分割。Spatial AI core: LIBR / LIBR+ deformation correction, biomechanical modeling, real-time 3D reconstruction, tissue semantic segmentation.
L3
协作层 · Co-Pilot Co-Pilot Layer HoloLens / Vision Pro · 手势语音 · 机械臂避障 · Virtual IFSHHoloLens / Vision Pro · Voice & Gesture · Obstacle Avoidance · Virtual IFSH
医生交互与决策:HoloLens / Vision Pro AR 显示、语音手势免手控制、机械臂主动避障、Virtual IFSH 实时虚拟病理。Surgeon interaction & decision: HoloLens / Vision Pro AR display, voice & gesture control, active obstacle avoidance, Virtual IFSH real-time pathology.
七大核心能力Seven Core Capabilities

从全息稳定到术中智能决策From holographic stability to intraoperative decisions

1. 稳定全息显示1. Stable Holographic Display

自研外部反射参考工具技术,独立于头显惯导系统的固定世界坐标系 —— 即使医生大幅活动,全息内容保持毫米级稳定。Proprietary external reflective reference tools establish a world coordinate system independent of headset IMU drift — holograms stay millimeter-stable even during heavy surgeon motion.

2. 高精度实时工具跟踪2. High-Precision Tool Tracking

基于头戴 AHAT 深度相机和自研算法的无标记、亚毫米级跟踪 —— 无需额外硬件即可获得高精度数据。Markerless sub-millimeter tracking via headset AHAT depth + proprietary algorithms — no extra hardware needed.

3. 多视角器官表面采集3. Multi-View Organ Surface Capture

SAM 2 自动分割 + 三路重建融合(原生深度流 / Depth Anything V3 / 非刚性融合)—— 业内首个 Magic Leap 2 上完整跑通的术中肝表面流水线。SAM 2 auto-segmentation + tri-path reconstruction (native depth / Depth Anything V3 / non-rigid fusion) — the first complete intraoperative liver surface pipeline on Magic Leap 2.

4. 软组织变形智能补偿4. Soft-Tissue Deformation Correction 核心壁垒CORE MOAT

LIBR / LIBR+ 算法:肝脏 10.4 → 6.1mm(改善 40%+),乳腺 10.4 → 4.2mm,仿体测试 1.7mm —— 行业唯一跨越 5mm 临床可用线的方案。LIBR / LIBR+: liver 10.4 → 6.1mm (40%+ improvement), breast 10.4 → 4.2mm, phantom tests 1.7mm — the only published method below the 5mm clinical line.

5. 主动感知协作机械臂5. Active-Perception Cobot

KUKA LBR Med / KINOVA Gen3 Med + NDI Polaris Lyra + ZED 2i 多传感器末端。机械臂从"被动设备"变成"主动观察者",自动重定位、自主避让医生手部。KUKA LBR Med / KINOVA Gen3 Med + NDI Polaris Lyra + ZED 2i sensor head. Transforms the cobot from a passive device into an active observer that auto-repositions and avoids surgeon hands.

6. Virtual IFSH 与消融引导6. Virtual IFSH + Ablation Guidance

乳腺切除后追踪笔扫描标本切面 → 实时切缘距离评估(无需病理科)。肝脏微波消融实时探针轨迹 + 距靶点测量 + 消融区预测可视化。Breast: track-pen surface scan → real-time margin assessment without pathology lab. Liver MWA: live probe trajectory + target distance + ablation zone prediction.

7. MR 超声图像叠加7. MR Ultrasound Overlay

超声从"远端屏幕 2D 切面"升级为"叠加于解剖正确位置的原位三维影像" —— HoloLens 2 上 ~2mm 跟踪精度 + < 16ms 延迟。Ultrasound goes from a 2D slice on a remote screen to an in-situ 3D image at the correct anatomical position — ~2mm tracking accuracy and <16ms latency on HoloLens 2.

端到端管线End-to-End Pipeline

从 DICOM 到术中决策From DICOM to intraoperative decision

PERCEPTION → COGNITION → CO-PILOT ImagingReconSurfaceLIBRAR Guidance 01 · IMAGING CT · MRI · US DICOM 02 · 3D RECON SAM 2 Auto-Segmentation 03 · SURFACE Multi-View RGB-D + AHAT + ML 04 · LIBR+ Deformation Sub-5mm Accuracy 05 · AR + CO-PILOT HoloLens / Vision Pro + Cobot + Virtual IFSH Continuous intraoperative feedback · 15Hz refresh
知识产权Intellectual Property

"中美双国 + 校内储备"组合"US + China + University reserve" portfolio

CN 202510971966.8
一种混合现实手术导航方法及系统A Mixed Reality Surgical Navigation Method and System
中国发明专利 · 已公布(2025/10/31, 41 卷 4402 期)China Invention Patent · Published 2025/10/31 (Vol 41, Issue 4402)
中国CN
US 63/981,960
Self-Contained Surgical Navigation System in AR HMDSelf-Contained Surgical Navigation System in AR HMD
美国临时专利 · VU25032P2 · 范德堡 2026/02 申请 · 转让/许可通道已建立US Provisional · VU25032P2 · Filed by Vanderbilt 2026/02 · License pathway established
美国US
US 10426556
Biomechanical Model Assisted Image-Guided Surgery SystemBiomechanical Model Assisted Image-Guided Surgery System
美国专利 · 已授权(Miga, Meszoely et al., 2019)US Patent · Granted (Miga, Meszoely et al., 2019)
已授权Granted
VU20125
Computer Vision Apparatus for Breast Surgery Guidance
发明披露(Richey, Heiselman, Miga, 2020)Invention Disclosure (Richey, Heiselman, Miga, 2020)
DISCLOSURE
VU24058
Robotic-Enabled Surgical Navigation Assistant (ReSNA)
发明披露(Miga, Meszoely, 2023)Invention Disclosure (Miga, Meszoely, 2023)
DISCLOSURE
J Med Imaging 12(5):055001
Comprehensive Mixed Reality Surgical Navigation System for Liver Surgery
SCI 期刊 · 2025/10 · Bowen Xiang 通讯/第一作者SCI Journal · Oct 2025 · Bowen Xiang corresponding/first author
SCI
IEEE TBME 2026
Subsurface Targeting Validation Framework for MR Surgical Navigation
IEEE Transactions on Biomedical Engineering · 2026 · Bowen Xiang 第一作者IEEE TBME · 2026 · Bowen Xiang first author
SCI

与我们一起把 Spatial AI 带入手术室Bring Spatial AI into every OR with us

投资人、临床合作伙伴、学术合作 —— 欢迎联系。Investors, clinical partners, and academic collaborators — we'd love to hear from you.