Video Generation
Overview​
Video generation turns one or two reference frames into a short animated clip for a scene block. It is a 3-step process accessed from the scene view.
Prerequisites​
- A start frame must be generated before video generation is possible
- An end frame is optional — if omitted, the video uses only the start frame as reference
- Requires
scene_block:video:generatepermission
Step 1 — Generate Start Frame​
Click the purple film icon on a dialog or action block. The modal opens to Step 1.
Configure and generate an image using the scene's location, characters, and prompt. The generated image becomes the start frame.
Step 2 — Generate End Frame (optional)​
After a start frame exists, move to Step 2 to optionally generate an end frame. The end frame tells the video model where the animation should end, enabling controlled camera movement or action.
If you skip Step 2, the video uses only the start frame.
Step 3 — Generate Video​
With a start frame present, move to Step 3:
| Parameter | Description |
|---|---|
| Prompt | Motion description — what should happen in the video |
| Negative Prompt | Things to avoid (blurriness, distortion, etc.) |
| Duration | Length in seconds (options: 1–8s) |
| Frame Rate | 24, 25, or 30 fps |
| Steps | Diffusion steps (1–50, default 28) |
| Guidance Scale | Prompt adherence (1–20, default 3) |
| Seed | For reproducibility (leave blank for random) |
| Resolution | Width × height (e.g. 1920×1080) |
Prompt optimization​
Before generating, click Optimize Prompt to run the prompt through the LLM preprocessor, which rewrites it into a format better suited for the video model. The prompt field turns green when optimized.
Missing frame warnings​
- If the start frame is missing: an amber warning appears and the Generate button is disabled
- If only the end frame is missing: a neutral info banner appears noting the video will use only the start frame — generation is still allowed
Deleting a video​
Click the trash button on the generated video card. Requires scene_block:video:delete.
Model​
The current video model is ltx2.3 (LTX Video).
API​
| Method | Endpoint | Description |
|---|---|---|
POST | /api/scenes/:sceneId/blocks/video | Generate video for a block |
DELETE | /api/scenes/:sceneId/blocks/:blockId/video | Delete a block's video |