Manycore Aholo Global 3D AI Hackathon群核 Aholo 全球 3D AI 黑客松

A directing stage for generated 3D worlds.为生成式 3D 世界打造的导演舞台。

Holorra puts walkable Gaussian Splatting worlds, part-split and articulated props, a rigged actor you play and a camera director on one WebGL stage in your browser. It is built on the Manycore Aholo stack.Holorra 把可行走的高斯泼溅世界、可拆分可活动的道具、由你操控的绑骨角色和镜头导演,放进浏览器里的同一个 WebGL 舞台。完全基于群核 Aholo 技术栈构建。

WebGL23D Gaussian Splatting3D 高斯泼溅SpatialGenLux3DAholo MCPLuxReal
01
Generate the world生成世界
world.generations.create
00:00:00
01 world世界
02 parts部件
03 actors角色
04 scene场景
The Holorra studio on the SpatialGen coffee bar world, with the Lux3D actor and espresso machine on the stage, creation dock on the left and part inspector on the right.
Fig. 1图 1The studio in the coffee bar SpatialGen generated from one sentence, with the Lux3D actor and espresso machine. Real capture of the app, no mock-up.创作台中的咖啡吧(由 SpatialGen 用一句话生成),里面是 Lux3D 角色和咖啡机。应用真实截图,不是效果图。
3DGS worlds, one generated with SpatialGen个 3DGS 世界,其中一个由 SpatialGen 生成
5
splats in the largest LOD stream个高斯点,最大的 LOD 流式场景
41.8M
Lux3D capabilities wired in项 Lux3D 能力全部接入
10
retargetable humanoid clips个可重定向的人形动作
85
live Aholo jobs, every result in the app个实时 Aholo 任务,结果全部在应用中
11
01Problem问题

Generated 3D usually ends as a statue in an empty room.生成的 3D 模型,往往只是空房间里的一尊雕像。

Text-to-3D gives you a mesh. It floats in a grey void, it is fused into one shell, it cannot move, and nobody can film it. Holorra treats a generated asset as the start of a scene.文生 3D 给你的是一个网格:飘在灰色虚空里,融成一整块外壳,不能动,也没法拍。Holorra 把生成的资产当作一个场景的起点。

Place场景
A lone .glb on a grey grid.灰色网格上孤零零的一个 .glb。
Props sit inside a photoreal splat world with collision you can walk on.道具放进照片级的高斯泼溅世界,带碰撞,可以走进去。
Parts部件
One fused shell. Nothing opens.融成一整块外壳,什么都打不开。
Semantic sub-meshes you can explode, isolate, recolor and hinge.语义部件可以爆炸、单独显示、改色,还能加铰链。
Motion动作
Characters frozen in a T-pose.角色僵在 T-pose。
An auto-rigged actor you play, with 85 retargetable clips.自动绑骨的角色由你操控,有 85 个可重定向的动作。
Camera镜头
A turntable at best.顶多是个转台展示。
Keyframed camera paths that export to LuxReal for video.关键帧镜头路径,可导出给 LuxReal 生成视频。
02Play游玩

Don't just look at the scene. Play it.别只看场景,玩起来。

Press Play and the studio turns into a short scene quest. You steer the auto-rigged Lux3D actor through the splat loft and work the espresso machine Lux3D generated and articulated. Nothing is faked: the hood and drawer move on the joints in the returned URDF, and the actor plays its retargeted clips.点击 Play,创作台就变成一个简短的场景任务。你操控自动绑骨的 Lux3D 角色穿过高斯泼溅公寓,使用由 Lux3D 生成并完成关节化的咖啡机。没有任何造假:顶盖和抽屉沿返回的 URDF 关节运动,角色播放的是重定向后的动作。

Walk to the espresso machine01 Walk行走
Walk to the espresso machine走到咖啡机前
WASD, Shift to jog · Walk_Loop / Jog_Fwd_Loop on the voxel floorWASD 移动,Shift 慢跑 · 在体素地面上播放 Walk_Loop / Jog_Fwd_Loop
Press E to brew a coffee02 Brew冲咖啡
Press E to brew a coffee按 E 冲一杯咖啡
The camera cuts in as hood_top_joint and drawer_front_joint openhood_top_joint 与 drawer_front_joint 打开时镜头切入特写
Frame the shot, then celebrate03 Wrap收工
Frame the shot, then celebrate构图取景,然后庆祝
K drops a keyframe · F plays Dance_Loop · scene wrappedK 打关键帧 · F 播放 Dance_Loop · 场景杀青
Controls操作方式
  • WASDwalk行走
  • Shiftjog慢跑
  • Draglook环顾
  • Ebrew冲咖啡
  • Kframe取景
  • Fcheer欢呼
  • On a phone, a thumb joystick walks the actor and Brew, Frame and Cheer buttons sit beside it.在手机上,用拇指摇杆操控角色行走,旁边是冲咖啡、取景和欢呼按钮。
  • Expand hides every panel and gives the render the whole screen.全屏会隐藏所有面板,整个屏幕只留渲染画面。
  • Your keyframe stays on the camera path, ready to play back or send to LuxReal.你打的关键帧会保留在镜头路径上,可以回放,也可以交给 LuxReal。

Walk in, brew a coffee, frame the shot. About a minute, no key needed.走进去,冲杯咖啡,拍下这个镜头。大约一分钟,无需密钥。

03Pipeline流程

Generate the world. Split the parts. Rig the actors. Direct the scene.生成世界,拆分部件,绑定角色,导演场景。

Four stages, each backed by real Manycore SDK calls behind Holorra's /api/aholo routes. Every stage hands its output to the next on the same stage.四个阶段,每一步都由 Holorra 的 /api/aholo 接口背后真实的群核 SDK 调用支撑。每个阶段的产出都在同一个舞台上交给下一个阶段。

  1. 01

    Generate the world生成世界

    Prompt or photograph a space with SpatialGen, or reconstruct one from video, photos or Insta360 footage with Aholo Reality. Our coffee bar came back from one sentence in 625 s, ready to walk.用 SpatialGen 从提示词或照片生成空间,或用 Aholo Reality 从视频、照片、Insta360 素材重建。我们的咖啡吧只用一句话、625 秒就生成了,可以直接走进去。

    world.generations.createworld.reconstructions.create
  2. 02

    Split the parts拆分部件

    Forge props with Lux3D G1 or G1-Turbo, break them into semantic sub-meshes, and give them joints from one sentence. Finished models drop into the world you are standing in.用 Lux3D G1 或 G1-Turbo 生成道具,拆分成语义部件,再用一句话为它加上关节。生成好的模型会直接投放到你所在的世界里。

    textTo3dimgTo3dpartSplitarticulationAnimation
  3. 03

    Rig the actors绑定角色

    Auto-rig a humanoid mesh, retarget any of the 85 Lux3D clips onto it, then play it through the world on its voxel floor.为人形网格自动绑骨,把 85 个 Lux3D 动作中的任意一个重定向上去,再操控它在体素地面上穿行整个世界。

    humanoidAutoRighumanoidAnimationRetarget
  4. 04

    Direct the scene导演场景

    Drop camera keyframes in the stage, play them back as a smooth spline, and export a storyboard pack for LuxReal video.在舞台中打下镜头关键帧,按平滑样条回放,再导出分镜包交给 LuxReal 生成视频。

    Catmull-Rom pathstoryboard JSONLuxReal
04Results成果

Real Lux3D output, not mock-ups.真实的 Lux3D 产出,不是效果图。

Ten Lux3D jobs and one SpatialGen world ran through Holorra's own /api/aholo routes on 18 November. Every image below is what the API returned, rendered in @manycore/aholo-viewer, with its real task ID and wall-clock time.11 月 18 日,10 个 Lux3D 任务和 1 个 SpatialGen 世界经由 Holorra 自己的 /api/aholo 接口运行完成。下面每张图都是 API 实际返回的结果,在 @manycore/aholo-viewer 中渲染,并标注真实的任务 ID 和耗时。

Espresso machine · G1-Turbo
Espresso machine · G1-Turbo咖啡机 · G1-Turbo
textTo3d · task 8353472 · 151 s · 252k tris
Same prompt · G1
Same prompt · G1同一提示词 · G1
textTo3d · task 8353478 · 343 s · 230k tris · 3 PBR maps
Part split · 4 parts, exploded
Part split · 4 parts, exploded部件拆分 · 4 个部件,爆炸视图
partSplit · task 8354166 · 118 s
“The hood hinges open”
“The hood hinges open”「顶盖铰链打开」
articulationAnimation · task 8354168 · 298 s · URDF
Attempt 1 · rig rejected
Attempt 1 · rig rejected第 1 次 · 绑骨被拒
humanoidAutoRig · RIG_ELIGIBILITY_FAILED
Attempt 2 · auto-rigged
Attempt 2 · auto-rigged第 2 次 · 自动绑骨成功
humanoidAutoRig · task 8355123 · 81 s · 52 joints
Retargeted · Walk_Loop
Retargeted · Walk_Loop已重定向 · Walk_Loop
humanoidAnimationRetarget · task 8359816 · 8 clips
The 360° panorama SpatialGen returned for the coffee bar world
SpatialGen · Scandinavian Coffee Bar北欧风咖啡吧
world.generations.create · world 3FO4K4V99KMD · 625 s · 266,895 splats

Prompt: “A cozy Scandinavian coffee bar interior with a long light-oak counter, a tiled back wall with open shelves of ceramic mugs, pendant lamps, potted plants, wooden stools and tall windows with warm morning light. Clean open floor in the middle.” The panorama above came back with the splat file; the splats are world 05 in the studio.提示词:「A cozy Scandinavian coffee bar interior with a long light-oak counter, a tiled back wall with open shelves of ceramic mugs, pendant lamps, potted plants, wooden stools and tall windows with warm morning light. Clean open floor in the middle.」上面的全景图和高斯点文件一起返回;这些高斯点就是创作台里的世界 05。

Inspect them live on the bench在测试台上实时查看Turntable, explode, joint sliders and clip switching on the real files.基于真实文件的转台、爆炸视图、关节滑块和动作切换。
05Drop-in投放

Generate a model. It lands at your feet.生成一个模型,它就落在你脚边。

Keep playing while Lux3D works. When the job finishes, the model appears in front of the camera in whatever world you are in, falls to the floor and settles. The wait becomes part of the scene.Lux3D 生成期间你可以继续玩。任务完成后,模型会出现在你当前所在世界的镜头前,落到地面并停稳。等待本身也成了场景的一部分。

A generated espresso machine dropped onto the floor of the SpatialGen coffee bar next to the Lux3D actor
Fig. 2图 2A Lux3D model dropped into the SpatialGen coffee bar. Without a key, Holorra drops the stored G1-Turbo result from task 8353472 and labels it cached.一个 Lux3D 模型投放到 SpatialGen 咖啡吧中。没有密钥时,Holorra 投放的是任务 8353472 存下来的 G1-Turbo 结果,并标注为缓存结果。
  1. 01Submit提交
    Text to 3D calls lux3d.textTo3d.create through /api/aholo/lux3d.文生 3D 通过 /api/aholo/lux3d 调用 lux3d.textTo3d.create。
  2. 02Track跟踪
    A timer chip on the stage follows lux3d.tasks.retrieve, polled every 10 s.舞台上的计时标签每 10 秒轮询一次 lux3d.tasks.retrieve。
  3. 03Fetch获取
    The finished GLB comes in through an allowlisted asset proxy, so no expiring links reach the browser.生成好的 GLB 经由白名单资源代理取回,过期链接不会直接暴露给浏览器。
  4. 04Drop投放
    Scaled to about 70 cm, it falls in front of you onto the floor found in the voxel grid and bounces to rest.模型缩放到约 70 cm,落在你面前由体素网格找到的地面上,弹几下后停稳。
06Worlds世界

Five splat worlds. We generated one of them.五个高斯泼溅世界,其中一个是我们生成的。

Live generation takes minutes, so Holorra opens on four Gaussian Splatting scenes hosted on Manycore's CDN. The fifth came from a single SpatialGen prompt through Holorra's own /api/aholo/world route. Each card opens its world in the studio.实时生成需要几分钟,所以 Holorra 一打开就是托管在群核 CDN 上的四个高斯泼溅场景。第五个来自一句 SpatialGen 提示词,经由 Holorra 自己的 /api/aholo/world 接口生成。点击卡片即可在创作台中打开对应世界。

07Hybrid stage混合舞台

Radiance fields and meshes on one stage.辐射场与网格,同台呈现。

Splats carry the world's look; meshes carry everything you want to touch. Both render in a single @manycore/aholo-viewer scene, lights on the meshes and tone-mapped compositing on the splats.高斯点负责世界的外观,网格负责一切你想触碰的东西。两者在同一个 @manycore/aholo-viewer 场景中渲染:网格有灯光,高斯点做色调映射合成。

A Gaussian Splatting rail yard with exploded mesh parts in front of it
Fig. 3图 3A 32.7M-splat LOD stream with exploded mesh parts in the same scene.3270 万个高斯点的 LOD 流式场景,同一场景中有爆炸展开的网格部件。
  • Chunk-LOD streaming分块 LOD 流式加载
    Loads splat chunks by distance and keeps each frame inside a splat budget.按距离加载高斯点分块,让每一帧都控制在高斯点预算内。
  • Direct splat files直接加载高斯点文件
    .spz, .sog and .ply for single scenes and object captures.单个场景和物体扫描支持 .spz、.sog 和 .ply。
  • Voxel collision体素碰撞
    Sparse grids so actors stand on floors and stop at walls.稀疏网格让角色站在地面上、碰到墙会停下。
  • PBR meshesPBR 网格
    GLTF props and rigged characters lit inside the splat world.GLTF 道具和绑骨角色在高斯泼溅世界中被照亮。
08Parts部件

Take any generated object apart.把任何生成的物体拆开。

lux3d.partSplit returns an object's semantic sub-meshes. Explode them to inspect, isolate or recolor one, then describe its motion in plain language with lux3d.articulationAnimation. Try the control below.lux3d.partSplit 返回物体的语义部件。爆炸展开查看、单独显示或改色,再用一句大白话通过 lux3d.articulationAnimation 描述它怎么动。试试下面的控件。

explode 35% · 4 parts
Illustration of the studio control. The real one runs inside the WebGL stage.创作台控件示意。真实控件运行在 WebGL 舞台中。
35%
Part hierarchy部件层级

hood top, top hood · revolute, 0–90°. 。Moves as hinge-x.运动方式:hinge-x。

09Actors角色

85 clips, any character.85 个动作,任意角色。

humanoidAutoRig puts a skeleton in a static mesh; humanoidAnimationRetarget maps up to ten official Lux3D clips onto it per job. The actor you play went through both: a G1-Turbo character, rigged with 52 joints and given eight clips.humanoidAutoRig 为静态网格装上骨骼;humanoidAnimationRetarget 每个任务最多可把 10 个官方 Lux3D 动作重定向上去。你操控的角色两步都走过:一个 G1-Turbo 角色,绑定了 52 个关节,配上 8 个动作。

Category类别Clips动作数
Locomotion & Traversal移动与穿行11
Parkour & Acrobatics跑酷与特技10
Social, Dialogue & Acting社交、对话与表演16
Object Interaction & Work物体交互与工作12
Combat, Melee, Ranged & Magic战斗:近战、远程与魔法29
Impact Reactions & Creatures受击反应与怪物7
Total合计85
10Director导演

Block the shot in 3D. Render it in LuxReal.在 3D 里排好镜头,交给 LuxReal 出片。

Each keyframe stores a camera position, look-at target, duration and shot prompt. Holorra plays them back as a Catmull-Rom flythrough over the live stage, grabs a reference frame per keyframe, and exports a storyboard pack for LuxReal's video creator.每个关键帧记录镜头位置、注视点、时长和镜头提示词。Holorra 在实时舞台上以 Catmull-Rom 样条飞行回放,为每个关键帧截取参考画面,并导出分镜包交给 LuxReal 的视频创作工具。

01 · Entrance wide · 3.0s01 · 入口全景 · 3.0s02 · Hero appliance · 3.5s02 · 主角家电 · 3.5s03 · Rigged character · 3.0s03 · 绑骨角色 · 3.0s
Add keyframe添加关键帧Play path播放路径Export storyboard导出分镜Open in LuxReal在 LuxReal 中打开
11Co-directorAI 副导演

Describe the scene. Get the tool plan.描述场景,拿到工具调用计划。

The in-app co-director turns a plain-language brief into an ordered plan of Aholo MCP tool calls and updates the stage to match. The same MCP server is pre-configured in .mcp.json, so Claude Code or Cursor can drive SpatialGen and Lux3D directly.应用内的 AI 副导演把一段大白话描述转成有序的 Aholo MCP 工具调用计划,并相应更新舞台。同一个 MCP 服务已在 .mcp.json 中配置好,Claude Code 或 Cursor 可以直接驱动 SpatialGen 和 Lux3D。

.mcp.json
{
  "mcpServers": {
    "aholo-sdk-mcp": {
      "command": "npx",
      "args": ["-y", "@manycore/aholo-sdk-mcp"],
      "env": { "AHOLO_API_KEY": "…" }
    }
  }
}
brief → plan

“Walk the actor to the espresso machine and open the hood.”「让角色走到咖啡机前,打开顶盖。」

  1. 1 lux3d_humanoid_animation_retarget
  2. 2 lux3d_part_split
  3. 3 lux3d_articulation_animation
Open the MCP hub打开 MCP 中心
12Stack技术栈

Official SDKs across the whole stack.全栈使用官方 SDK。

No reimplemented renderer. The stage runs on @manycore/aholo-viewer, and server routes under /api/aholo/* call the official World, Lux3D and Asset clients with your key.没有自研渲染器。舞台运行在 @manycore/aholo-viewer 上,服务端 /api/aholo/* 接口用你的密钥调用官方的 World、Lux3D 和 Asset 客户端。

Package包Version版本
@manycore/aholo-viewer1.14.0
@manycore/aholo-sdk-world1.5.0
@manycore/aholo-sdk-lux3d1.10.0
@manycore/aholo-sdk-asset1.4.0
@manycore/aholo-sdk-mcp1.10.0
LuxRealhand-off交接

Bring your own key. Paste a labs.aholo.ai or labs.aholo.cn key in the studio. It is sent per request as x-aholo-api-key with a COM / CN region switch, so jobs run on your own credits.使用你自己的密钥。在创作台中粘贴 labs.aholo.ai 或 labs.aholo.cn 的密钥,每次请求通过 x-aholo-api-key 发送,并可切换 COM / CN 区域,任务消耗的是你自己的额度。

13Try it试一试

A one-minute tour.一分钟上手。

Everything below works without an API key. Add one at the end to send live generation jobs.下面所有操作都不需要 API 密钥。最后再加上密钥,就能发送实时生成任务。

  1. 01
    Launch the app启动应用
    The Smart Loft streams in from Manycore's CDN. No sign-up, no key.智能公寓从群核的 CDN 流式加载。无需注册,无需密钥。
  2. 02
    Press Play点击 Play
    Walk to the espresso machine with W A S D, brew with E, frame with K, cheer with F. Phones get a joystick.用 W A S D 走到咖啡机前,按 E 冲咖啡,K 取景,F 欢呼。手机上有虚拟摇杆。
  3. 03
    Switch worlds切换世界
    Five scenes in the header tabs, including the coffee bar SpatialGen generated.顶部标签里有五个场景,包括 SpatialGen 生成的咖啡吧。
  4. 04
    Explode a prop爆炸一个道具
    Drag the explode control, select a part to isolate or recolor it, toggle articulation.拖动爆炸视图控件,选中部件可单独显示或改色,也可开关关节动画。
  5. 05
    Drop in a model投放一个模型
    Press Text to 3D. The model lands in front of you when the job finishes; without a key a cached result drops in.点击文生 3D,任务完成后模型会落在你面前;没有密钥时投放的是缓存结果。
  6. 06
    Direct a shot导演一个镜头
    Add keyframes at a few viewpoints, play the path, then export the storyboard or open LuxReal.在几个视角打关键帧,回放镜头路径,再导出分镜或打开 LuxReal。
  7. 07
    Expand the stage全屏舞台
    The Expand button in the stage toolbar hides the panels and shows only the render. Esc returns.舞台工具栏的全屏按钮会隐藏所有面板,只显示渲染画面。按 Esc 返回。
  8. 08
    Go live运行实时任务
    Add your labs.aholo.ai key under API key to send real SpatialGen and Lux3D jobs to your own account.在 API 密钥里填入你的 labs.aholo.ai 密钥,就能用自己的账户发送真实的 SpatialGen 和 Lux3D 任务。

Step onto the stage.走上舞台。

A Gaussian Splatting world is already loaded and waiting. Walk in, brew a coffee, take something apart, frame your first shot.一个高斯泼溅世界已经加载好在等你。走进去,冲杯咖啡,拆开点什么,拍下你的第一个镜头。