// Panorama and video input for world generation - maximum layout control
World Labs Marble API integration - authentication, endpoints, models, and media uploads
Chisel 3D blocking tool for world generation - geometry, walls, and reference models
World Labs export formats - Gaussian splats, meshes, images, and engine integrations
Single image input for world generation - requirements, best practices, and examples
Multi-image input with direction control and auto layout for world generation
World Labs Studio - Compose multiple worlds, record camera animations, and expand boundaries
| name | world-labs-pano-video |
| description | Panorama and video input for world generation - maximum layout control |
| allowed-tools | ["Bash","WebFetch"] |
Panoramas and videos provide the most control over world layout by capturing complete scene coverage.
| Input Type | Marble 0.1-plus | Marble 0.1-mini |
|---|---|---|
| Panorama | 1,500 | 150 |
| Video | 1,600 | 250 |
Panoramas skip the pano generation step, saving 80 credits compared to regular images.
| Requirement | Specification |
|---|---|
| Format | 360Ā° equirectangular projection |
| Aspect ratio | 2:1 (width:height) exactly |
| Recommended | 2560 pixels wide |
| File size | Max 20 MB |
| Formats | PNG (recommended), JPG, WebP |
āāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāā
ā ā
ā ā 360Ā° horizontal field of view ā ā
ā ā
ā ā Left Center Right ā ā
ā ā
ā ā 180Ā° vertical (zenith to nadir) ā
ā ā
āāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāā
Aspect ratio: 2:1
From Phone:
From Camera:
From 360Ā° Camera:
Panoramas use the image type with the is_pano flag:
{
"model": "Marble 0.1-plus",
"world_prompt": {
"type": "image",
"image_prompt": {
"source": "media_asset",
"media_asset_id": "550e8400-e29b-41d4-a716-446655440000"
},
"is_pano": true,
"text_prompt": "Add dramatic sunset lighting"
}
}
{
"model": "Marble 0.1-plus",
"world_prompt": {
"type": "image",
"image_prompt": {
"source": "uri",
"uri": "https://example.com/360-panorama.jpg"
},
"is_pano": true,
"text_prompt": "Transform into a mystical forest"
}
}
ā Level horizon: Keep camera level during capture ā Consistent exposure: Use manual settings or HDR ā No moving objects: Static scenes work best ā Clean nadir: Bottom of image should be clean ā Full 360Ā°: Complete coverage essential ā Exact 2:1 aspect ratio: Required for recognition
ā Tripod visible: Remove or patch the tripod ā People in frame: Causes artifacts ā Heavy stitching seams: Fix edges before uploading ā Phone panoramas: Often lack full 180Ā° vertical coverage
| Requirement | Specification |
|---|---|
| File size | Max 100 MB |
| Duration | Max 30 seconds |
| Rotation | Camera should cover 180-360Ā° |
| Focal length | Fixed (no zoom during recording) |
| Exposure | Fixed (manual mode) |
| Movement | Slow, smooth rotation |
| Formats | mp4, mov, webm |
Camera Movement:
Start
ā
āāāāāāāāāāāāāāā
ā ā ā
ā Rotate ā
ā 180-360Ā° ā
ā ā ā
āāāāāāāāāāāāāāā
ā
End
DO:
DON'T:
{
"model": "Marble 0.1-plus",
"world_prompt": {
"type": "video",
"video_prompt": {
"source": "media_asset",
"media_asset_id": "550e8400-e29b-41d4-a716-446655440000"
},
"text_prompt": "Transform into a mystical nighttime scene"
}
}
{
"model": "Marble 0.1-plus",
"world_prompt": {
"type": "video",
"video_prompt": {
"source": "uri",
"uri": "https://example.com/room-rotation.mp4"
},
"text_prompt": "A scenic mountain landscape"
}
}
import requests
def generate_from_pano_or_video(
api_key: str,
file_path: str,
input_type: str, # "panorama" or "video"
prompt: str = None
):
base_url = "https://api.worldlabs.ai/marble/v1"
headers = {"WLT-Api-Key": api_key, "Content-Type": "application/json"}
# Determine kind and extension
ext = file_path.lower().split('.')[-1]
if ext == "jpeg":
ext = "jpg"
# Set kind based on input type
kind = "video" if input_type == "video" else "image"
# Prepare upload
prep = requests.post(
f"{base_url}/media-assets:prepare_upload",
headers=headers,
json={"file_name": file_path.split('/')[-1], "kind": kind, "extension": ext}
).json()
media_asset_id = prep["media_asset"]["media_asset_id"]
upload_url = prep["upload_info"]["upload_url"]
# Determine content type for upload
content_types = {
"jpg": "image/jpeg", "jpeg": "image/jpeg", "png": "image/png", "webp": "image/webp",
"mp4": "video/mp4", "mov": "video/quicktime", "webm": "video/webm"
}
content_type = content_types.get(ext, "application/octet-stream")
# Upload file
with open(file_path, 'rb') as f:
requests.put(upload_url, headers={"Content-Type": content_type}, data=f.read())
# Build world_prompt based on type
if input_type == "video":
world_prompt = {
"type": "video",
"video_prompt": {
"source": "media_asset",
"media_asset_id": media_asset_id
}
}
else: # panorama
world_prompt = {
"type": "image",
"image_prompt": {
"source": "media_asset",
"media_asset_id": media_asset_id
},
"is_pano": True
}
if prompt:
world_prompt["text_prompt"] = prompt
# Generate
response = requests.post(
f"{base_url}/worlds:generate",
headers=headers,
json={"model": "Marble 0.1-plus", "world_prompt": world_prompt}
)
return response.json()["operation_id"]
# Panorama example
pano_op = generate_from_pano_or_video(
"your_api_key",
"360_office.jpg",
"panorama",
"Add warm afternoon sunlight"
)
# Video example
video_op = generate_from_pano_or_video(
"your_api_key",
"room_rotation.mp4",
"video",
"Make it look abandoned and overgrown"
)
| Feature | Panorama | Video | Multi-Image |
|---|---|---|---|
| Layout control | ā ā ā ā ā | ā ā ā ā ā | ā ā ā āā |
| Ease of capture | ā ā ā āā | ā ā ā ā ā | ā ā ā ā ā |
| Coverage | Full 360Ā° | 180-360Ā° | Selected angles |
| Equipment needed | 360Ā° camera or stitching | Phone/camera | Any camera |
| Best for | Complete environments | Room capture | Specific views |
| Credits (plus) | 1,500 | 1,600 | 1,600 |
| Credits (mini) | 150 | 250 | 250 |
| Problem | Solution |
|---|---|
| Not recognized as panorama | Verify exactly 2:1 aspect ratio |
| Warped horizon | Re-level panorama in editing software |
| Stitching seams | Use better overlap or manual alignment |
| Tripod in nadir | Clone-stamp or use nadir patch |
| Overexposed sky | Use HDR or graduated filters |
| Problem | Solution |
|---|---|
| Shaky footage | Use gimbal or stabilize in post |
| Inconsistent exposure | Lock exposure in manual mode |
| Too fast rotation | Slow down, stay under 30 seconds |
| Insufficient coverage | Ensure at least 180Ā° rotation |
world-labs-api - API integration detailsworld-labs-image-prompt - Single image inputworld-labs-multi-image - Multi-image with direction controlworld-labs-studio - Compose and animate generated worlds