depth-map-generation

# Depth Map Generation Generate accurate depth maps from any image using each::sense. This skill extracts depth information from 2D images for 3D effects, parallax animations, VR/AR applications, computational photography, and more. ## Features - **Monocular Depth Estimation**: Extract depth from single images - **Portrait Depth Maps**: Precise depth for portrait photography effects - **Landscape Depth**: Scene depth for panoramic and landscape images - **Product Depth**: 3D-ready depth maps for e-commerce - **Architectural Depth**: Building and interior depth analysis - **3D Parallax Effects**: Depth data for Ken Burns-style animations - **VR/AR Depth**: Real-time depth estimation for immersive experiences - **Stereo Image Generation**: Convert 2D to stereoscopic 3D - **Focus Stacking**: Depth-based focus plane selection - **Background Blur**: Depth-aware bokeh and blur effects ## Quick Start ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this photo"}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/photo.jpg"], "mode": "max" }' ``` ## Depth Map Output Formats | Format | Description | Use Case | |--------|-------------|----------| | Grayscale | 8-bit depth (white=near, black=far) | General purpose, visualization | | Inverse Grayscale | 8-bit depth (black=near, white=far) | Some 3D software compatibility | | Normalized | 0-1 range depth values | Machine learning pipelines | | Metric | Real-world distance estimation | AR/VR, robotics | ## Use Case Examples ### 1. Generate Depth Map from Photo Basic depth extraction from any image. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this image. Output as grayscale where white represents closer objects and black represents distant objects."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/scene.jpg"], "mode": "max" }' ``` ### 2. Portrait Depth Map Extract precise depth from portrait photos for bokeh effects and 3D portraits. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Create a high-precision depth map from this portrait photo. Focus on accurate edge detection around the subject, especially hair and facial features. I need this for applying realistic depth-of-field effects."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/portrait.jpg"], "mode": "max" }' ``` ### 3. Landscape Depth Map Generate depth from landscape and outdoor scenes with extended depth range. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this landscape photo. The scene has foreground elements, mid-ground terrain, and distant mountains. Capture the full depth range from near to far with good separation between depth layers."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/landscape.jpg"], "mode": "max" }' ``` ### 4. Product Depth for 3D Effect Create depth maps for product images to enable 3D viewing experiences. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Extract a depth map from this product photo. I need accurate depth information to create a 3D interactive view for an e-commerce website. Focus on capturing the product shape and surface details."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/product-sneaker.jpg"], "mode": "max" }' ``` ### 5. Architectural Depth Map Generate depth from architectural and interior photos for visualization. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Create a depth map from this interior architecture photo. Capture the spatial relationships between walls, furniture, and architectural elements. I need this for a virtual tour with depth-based transitions."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/interior.jpg"], "mode": "max" }' ``` ### 6. 3D Parallax Effect Creation Generate depth maps optimized for creating parallax animations and Ken Burns effects. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this photo that I will use for a 3D parallax animation. I need clear depth separation between foreground, midground, and background elements. The depth should be smooth with distinct layers for a compelling parallax effect."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/scene-for-parallax.jpg"], "mode": "max" }' ``` ### 7. VR/AR Depth Estimation Create depth maps suitable for virtual and augmented reality applications. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this room photo for AR/VR use. I need metric depth estimation that accurately represents real-world distances. This will be used for placing virtual objects in an augmented reality application."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/room.jpg"], "mode": "max" }' ``` ### 8. Stereo Image Generation Convert 2D images to stereoscopic 3D using depth estimation. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this photo and use it to create a stereoscopic 3D image pair (left and right eye views). The stereo effect should be subtle enough for comfortable viewing but noticeable enough to create depth perception."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/photo-for-stereo.jpg"], "mode": "max" }' ``` ### 9. Focus Stacking Depth Generate depth maps for computational focus stacking and all-in-focus composites. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Create a depth map from this macro/close-up photo. I need precise depth information to identify focus planes for computational focus stacking. Each depth layer should be clearly defined so I can select which areas should be in focus."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/macro-photo.jpg"], "mode": "max" }' ``` ### 10. Depth-Aware Background Blur Generate depth for applying realistic bokeh and background blur effects. ```bash curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this photo for applying depth-aware background blur. The subject in the foreground should be clearly separated from the background. I need accurate edge detection so the blur transition looks natural, similar to a portrait mode effect."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/photo-for-blur.jpg"], "mode": "max" }' ``` ## Multi-Turn Depth Processing Use `session_id` to refine depth maps or process multiple related images: ```bash # Initial depth estimation curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this photo"}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/scene.jpg"], "session_id": "depth-project-001" }' # Refine the depth map curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "The depth map looks good but can you enhance the edge detection around the main subject? The boundaries are a bit fuzzy."}], "model": "eachsense/beta", "stream": true, "session_id": "depth-project-001" }' # Apply the depth map for an effect curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Now use this depth map to create a 3D parallax video animation with subtle camera movement"}], "model": "eachsense/beta", "stream": true, "session_id": "depth-project-001" }' ``` ## Batch Depth Processing Process multiple images for consistent depth estimation: ```bash # Process first image curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \ -H "Content-Type: application/json" \ -H "X-API-Key: $EACHLABS_API_KEY" \ -H "Accept: text/event-stream" \ -d '{ "messages": [{"role": "user", "content": "Generate a depth map from this product photo. I will be sending more product images that need consistent depth estimation."}], "model": "eachsense/beta", "stream": true, "image_urls": ["https://example.com/product1.jpg"], "session_id": "product-depth-batch", "mode": "eco" }'