Worlds & the stage世界与舞台

The background is a radiance field; everything you touch is a mesh. Each world is a 3D Gaussian Splatting scene rendered by @manycore/aholo-viewer, and the props and actor are glTF meshes lit inside the same WebGL2 scene.背景是辐射场,你能交互的一切都是网格。每个世界都是由 @manycore/aholo-viewer 渲染的 3D 高斯泼溅场景,道具和角色则是在同一个 WebGL2 场景中打光的 glTF 网格。

Live generation takes minutes, so the studio opens on scenes Manycore hosts on its CDN and you can explore at once. The fifth world is one we generated with SpatialGen through Holorra's own route. Every world can be opened directly with /studio?world=<id>.实时生成需要几分钟,所以创作台默认打开 Manycore 托管在 CDN 上的场景,打开就能探索。第五个世界是我们通过 Holorra 自己的路由用 SpatialGen 生成的。每个世界都可以用 /studio?world=<id> 直接打开。

The five worlds五个世界

World世界Source来源Splats高斯点Collision碰撞Open打开
01 Designer Smart LoftManycore CDN, .spzManycore CDN,.spz2.99Mvoxel grid, 5 cm体素网格,5 cmsmart-loft-indoor
02 Juguo Urban PlazaManycore CDN, chunk-LOD + .ply skyManycore CDN,分块 LOD + .ply 天空41.8M in 528 chunks, 5 levels41.8M,分为 528 个分块,共 5 级voxel grid, 20 cm体素网格,20 cmjuguo-urban-plaza
03 Grand Transit ConcourseManycore CDN, chunk-LOD + .sog environmentManycore CDN,分块 LOD + .sog 环境32.7Mnone (fly or orbit)无(飞行或环绕)huochezhan-concourse
04 Object TurntableManycore CDN, .sogManycore CDN,.sog971Knone无sculpted-bear-studio
05 Coffee Bar · SpatialGenGenerated by us, .spz (4.4 MB)我们自己生成,.spz(4.4 MB)266,895none, fixed floor height无,使用固定地面高度spatialgen-coffee-bar
The SpatialGen coffee bar in the Holorra stage with the Lux3D actor and espresso machine
World 05, generated from one sentence with SpatialGen (world 3FO4K4V99KMD, 625 s).世界 05,用 SpatialGen 由一句话生成(世界 3FO4K4V99KMD,625 s)。

How a world loads世界如何加载

  • Direct splat files (.spz, .sog, .ply) go through SplatLoader.parseSplatData and SplatUtils.createSplat.直接加载的高斯点文件(.spz、.sog、.ply)经由 SplatLoader.parseSplatData 和 SplatUtils.createSplat 处理。
  • Chunk-LOD streams read a lod-meta.json and load chunks by distance with SplatUtils.LodSplat, keeping each frame inside a splat budget.分块 LOD 流读取 lod-meta.json,并用 SplatUtils.LodSplat 按距离加载分块,让每一帧都控制在高斯点预算之内。
  • Switching worlds aborts in-flight requests with an AbortController and destroys the old splat before the new one loads, so GPU memory does not pile up.切换世界时,先用 AbortController 中止进行中的请求,并在新世界加载前销毁旧的高斯点对象,避免显存不断堆积。
  • URLs are made absolute before they reach the splat worker. The worker runs from a blob URL and cannot resolve app-relative paths such as /assets/spatialgen/coffee-bar.spz.URL 先转为绝对地址,再交给高斯点解析 Worker。这个 Worker 从 blob URL 运行,无法解析 /assets/spatialgen/coffee-bar.spz 这类相对于应用的路径。

Coordinate frames坐标系

Three conventions meet on one stage, so each asset is wrapped once when it is added:同一个舞台上汇集了三种坐标约定,因此每个资产在加入时都会包一层变换:

Asset资产Native up axis原生朝上轴What the stage does舞台如何处理
Aholo CDN worldsAholo CDN 世界OpenCV, −Y upOpenCV,−Y 向上Used as is; camera.up is (0, −1, 0).直接使用;camera.up 为 (0, −1, 0)。
glTF props and actors (Lux3D)glTF 道具与角色(Lux3D)+Y up+Y 向上Wrapped in a group with rotation.x = π.放入一个设置了 rotation.x = π 的组中。
SpatialGen outputSpatialGen 输出+Z up+Z 向上Wrapped with rotation.x = π/2 into the −Y-up frame.通过 rotation.x = π/2 转到 −Y 向上的坐标系。

Camera forward is (−sin yaw, −cos yaw) on the ground plane, and a positive pitch looks down. Spawn poses for each world live in src/config/aholo-presets.ts.在地平面上,镜头的前方向为 (−sin yaw, −cos yaw),pitch 为正时向下看。各世界的出生位姿定义在 src/config/aholo-presets.ts 中。

Voxel collision and floors体素碰撞与地面

Worlds 01 and 02 ship a sparse voxel grid (collision.voxel-meta.json plus collision.voxel.bin). The walk modes use it in three ways:世界 01 和 02 自带稀疏体素网格(collision.voxel-meta.json 加 collision.voxel.bin)。行走模式从三个方面用到它:

  • Walls: each step is filtered with filterHorizontalMove, so a capsule slides along walls instead of passing through them.墙体:每一步移动都经过 filterHorizontalMove 过滤,胶囊体会沿着墙滑动,而不是穿墙而过。
  • Floors: findFloorY in src/lib/urdf-assembly.ts probes down the grid with isWorldPointSolid. Props, the actor and dropped models are placed on the floor it finds. In the loft that is y = 1.912.地面:src/lib/urdf-assembly.ts 中的 findFloorY 用 isWorldPointSolid 沿网格向下探测。道具、角色和投放到场景的模型都会放在它找到的地面上。在 Loft 中,地面高度为 y = 1.912。
  • Unsticking: if the spawn capsule already overlaps a voxel, the walker moves freely until it is clear, rather than freezing in place.脱困:如果出生时胶囊体已经与体素重叠,行走者会先自由移动直到脱离,而不是卡在原地。

Worlds without a grid use a fixed floor height from the preset (floorY). The coffee bar uses 1.15, measured from the splats.没有体素网格的世界使用预设中的固定地面高度(floorY)。咖啡吧用的是 1.15,根据高斯点实测得出。

Lighting光照

Meshes get an ambient light and two directional lights (a warm key and a soft rim) so they sit in the splat world rather than on top of it. Splats are composited with neutral tone mapping, and exposure is adjustable under Render in the header.网格使用一盏环境光和两盏平行光(暖色主光与柔和轮廓光),让它们融入高斯泼溅世界,而不是浮在上面。高斯点以中性色调映射合成,曝光可以在顶栏的「渲染」中调节。

Want your own world? Generate one from the World tab (see Live generation). The coffee bar was made exactly that way.想要自己的世界?在「世界」标签页中生成一个(见实时生成)。咖啡吧正是这样做出来的。