Square Root Two
Back to SR2返回 SR2 APP-02 · LIVE — — : — —
SR2 / APP-02 · Immersive MonitorSR2 / APP-02 · 片场监看

Three signal paths, one monitor. 三种信号链路,一块监视器

DEMO REEL · v2026.04
UVC · NDI · iPad ↔ AVP
◉ LIVE
CAM-01 · UVC IN
DEMO · 01 / 03
DEMO-01 · UVC · DEVELOPER STRAP◉ LIVE

UVC over the developer strap. 通过开发者线缆读取 UVC。 Plug a camera straight into Vision Pro.摄像机直插 Vision Pro。

Connect any UVC-class output — a cinema camera over HDMI→USB capture, a streaming bridge, an action cam — directly to the Vision Pro developer strap. Immersive Monitor decodes the BGRA buffer on Metal and presents it as a stereoscopic SBS surface in your immersive space. 任何 UVC 输出都行 —— HDMI→USB 采集卡接电影机、推流盒、运动相机 —— 直连 Vision Pro 的开发者线缆。Immersive Monitor 用 Metal 解码 BGRA 缓冲,在沉浸空间中渲染为 SBS 立体平面。

  • USB-C developer strap · BGRA pixel buffer
  • AVCaptureSession + Metal texture pipeline
  • Tone / contrast / temperature / unsharp on the fly
  • Optional VTLowLatencySuperResolutionScaler
SOURCE UVCLATENCY <1 frameOUTPUT Stereo SBS
CAM-02 · NDI · MAC SENDER
DEMO · 02 / 03
DEMO-02 · NDI · MAC → AVP◉ LIVE

NDI from a Mac, into your headset. 来自 Mac 的 NDI 流,落到头显里。 Network video, zero cables on the talent.无线传输,演员身上没有任何线。

Run the companion Mac sender, point it at any NDI source on the LAN — switcher, camera, software output — and Immersive Monitor discovers it over Bonjour. Picture stays in sync across multiple Vision Pro devices on set; the same Mac also exposes a control channel for tone, geometry, denoise and SR. 配套 Mac 发送端,对接局域网内的任意 NDI 源(切换台、摄像机、软件输出),Immersive Monitor 通过 Bonjour 自动发现。多台 Vision Pro 同时在线,画面保持同步;同一台 Mac 还开放控制通道,远程调色、几何、降噪、超分一并搞定。

  • Bonjour _ndi._tcp / _immonitor._tcp discovery
  • NDI 5 receiver · YUV → BGRA · Metal upload
  • Multi-headset sync · single Mac sender
  • Remote control channel · IMProtocol JSON
SOURCE NDI 5SENDER macOS 14+RECEIVER visionOS · iPadOS
CAM-03 · iPad ↔ AVP
DEMO · 03 / 03
DEMO-03 · iPad NDI · AVP MIRROR◉ LIVE

iPad in hand, Vision Pro on head. 手上的 iPad,头上的 Vision Pro Same feed, two surfaces — one director, one talent.同一路画面,两块屏幕 —— 给导演,给演员。

The iPad client receives the NDI stream too — light, holdable, perfect for the script supervisor or the talent peeking at framing between takes. Vision Pro keeps the cinematic 3D presentation; iPad keeps the eye-line. Both speak the same protocol, both stay in lock-step. iPad 端同样接收 NDI 流 —— 轻便可手持,适合场记或演员之间偷看构图。Vision Pro 保留沉浸三维画面;iPad 维持眼神交流。两端同协议、同步刷新。

  • Universal binary · iPadOS native
  • Shared CaptureViewModel · same enhance stack
  • Sub-frame sync between iPad and AVP
  • Battery-friendly · ProMotion 120 Hz preview
CLIENTS iPad + AVPTRANSPORT NDI · LANUSE Script · Talent · Crew
Inside the box · Capabilities内核能力

Built like a real monitor, not a viewer. 真正的监视器,不是播放器。

VERSION · 1.x
Metal · CoreImage · NDI 5
◉ SHIPPING
CAP-01 · LATENCY

Sub-frame, on Metal亚帧延迟,Metal 直渲

Capture buffers go through a single GPU pass — normalize, tone, sharpen, scale — and land on an SBS quad in your immersive space. No CPU copies, no detours. 采集缓冲一次 GPU pass 内完成 —— 归一化、调色、锐化、超分 —— 直接渲染到沉浸空间的 SBS 平面。不绕 CPU,不做无谓拷贝。

  • BGRA pixel buffer · MetalTextureFactory
  • STMapSBSRunner stereo splitting
  • AVSampleBufferVideoRenderer present
CAP-02 · COLOR & DETAIL

Color science on the fly实时色彩科学

Exposure, contrast, shadows, highlights, saturation, temperature, tint, unsharp masking and denoise — all dialled in from a floating control bar in front of you. Reset to neutral with one tap. 曝光、对比、阴影、高光、饱和、色温、染色、锐化、降噪 —— 都在悬浮控制条里调,一个按钮回到中性。

  • LumaAdjustParams · per-frame
  • Apple low-latency Super Resolution
  • Optional spatial noise filter
CAP-03 · MULTI-CLIENT

Many headsets, one truth多终端,同一帧

Bonjour-discovered Mac sender broadcasts to every Vision Pro and iPad on the LAN. Director, DP, focus puller — all synced, all controllable from one place. Mac 发送端通过 Bonjour 自动被发现,向局域网内所有 Vision Pro 与 iPad 广播。导演、摄影、跟焦员同帧画面、统一控制。

  • _immonitor._tcp service publish
  • LineJSONConnection control channel
  • IMProtocol commands · setSource, setTone…
CAP-04 · GEOMETRY

Foveated stereo mesh注视点立体网格

A pre-baked foveated mesh maps the SBS feed to where your eyes actually are. Per-eye offset and scale are exposed so any rig — even oddly aligned — converges cleanly. 预烘焙的 foveated mesh 把 SBS 画面投到眼睛真实位置。每只眼的偏移和缩放都开放调节,再奇怪的拍摄机也能干净汇聚。

  • foveated.aime · custom RealityKit material
  • Per-eye STMap transform
  • Swap L/R · one-tap convergence reset
CAP-05 · CAMERAS

URSA-aware on the network网络中识别 URSA

Discovers Blackmagic-style camera servers on the LAN, surfaces ISO / shutter / WB / record state, and flags severity inline. Walk on set, see the cameras. 自动发现局域网内 Blackmagic 风格的摄像机服务,显示 ISO / 快门 / 白平衡 / 录制状态,并对异常分级提示。开机进场,机器自动到位。

  • CameraDiscovery · Bonjour _http._tcp
  • Severity logic for record · battery · temp
  • Detail view per host
CAP-06 · UI

Floating control bar悬浮控制条

A draggable bar follows your gaze height; pull it down for settings, push it up to get out of frame. Settings remembers context — drop in on the NDI tab when an NDI source is live. 悬浮控制条跟随视线高度;下拉是设置,上推让位画面。设置面板记住语境 —— NDI 源在线时直接落在 NDI 标签。

  • Vertical-only drag · always in front
  • Collapsible to a thin handle
  • Tally flash · per-camera record cue
Signal path · Camera → eyes信号链路 · 摄像机 → 眼前

Five stages, one frame. 五个阶段,同一帧画面

IM-PIPELINE · v2
Metal · NDI · RealityKit
/01
Camera片场摄像机

HDMI / SDI / NDI out from cinema, broadcast or mirrorless body.

URSA · FX · A7S
/02
Bridge采集 / 网络

UVC capture stick on Vision Pro, or NDI from a Mac on the LAN.

UVC · NDI 5 · LAN
/03
Decode解码归一

BGRA pixel buffer normalized, uploaded as a Metal texture pair.

AVCaptureSession · Metal
/04
Enhance增强处理

Tone, sharpen, denoise, low-latency super resolution — single GPU pass.

CoreImage · LowLatencySR
/05
Present沉浸呈现

Foveated stereoscopic mesh in mixed-immersion space; multi-client sync.

RealityKit · SBS
Get the app获取应用

On the App Store · today. App Store 现已上架。

APP-02
IMMERSIVE MONITOR
◉ LIVE

A monitor that fits in a pocket.放进口袋的监视器

Two native apps — one for Vision Pro, one for iPad — plus the Mac sender as the on-set hub. Pick your platform. 两个原生 App —— Vision Pro 一个、iPad 一个 —— 加上 Mac 端作为片场枢纽。挑选你的平台。