Skip to main content

using-model-endpoint

Call a registered model endpoint over its native HTTP API from the endpoint's scoped inference kernel (BASE_URL preloaded). Load once a task needs predictions from a registered model endpoint.

Ir a la instalación

Datos de origen

Repositorio
HughYau/AcademicForge
Última actividad en el origen
2 de julio de 2026 a las 10:54
Idioma detectado de SKILL.md
inglés
Estrellas
2568
Forks
153

Opciones de instalación

De forma predeterminada está seleccionado el prompt que primero revisa el origen. Puedes cambiar a un comando directo o descargar una copia local.

Revisa los archivos de origen

Lee SKILL.md y los archivos complementarios que muestra SkillsMP antes de decidir si quieres instalarlo.

Explorador de archivos
5 archivos

Mostrando SKILL.md

SKILL.md
Instrucciones de origen · Vista previa de solo lectura
name
using-model-endpoint
description
Call a registered model endpoint over its native HTTP API from the endpoint's scoped inference kernel (BASE_URL preloaded). Load once a task needs predictions from a registered model endpoint.
license
Apache-2.0
You are a **pure HTTP client of `BASE_URL`**. Each registered model endpoint gets its own inference kernel — a Python REPL whose network egress is scoped to exactly that endpoint — reached via `compute_provider({'provider': '<slug>', 'code': '…'})` (`<slug>` from `list_compute`, without the `infer:` prefix). - `BASE_URL` is preloaded (as a Python variable AND as `os.environ["BASE_URL"]`) — build request URLs from it, never hardcode hosts/ports. Call the model's **native API** with `httpx` (preinstalled) or `requests`; request shapes live in the provider's own runbook skill (the registration's `skillName`). - Hosted endpoints: send `Authorization: Bearer $INFER_API_KEY` (always the canonical env name when a credential is delivered; the credential's own name is usually aliased too). Local endpoints need no auth header. - Requests ride the sandbox HTTP proxy (`HTTP_PROXY`/`HTTPS_PROXY` are set) — don't disable it (e.g. `trust_env=False`) or the endpoint is unreachable. - No job lifecycle here (no submit/harvest) — direct request/response only. **Managed endpoints** (entries with `managed: true` / a `location` field in `list_compute`): their lifecycle — daemon-owned start/stop, registration, `free_port()`/`register()` — lives in the **`managed-model-endpoints`** skill. Cells against them are still just HTTP calls to `BASE_URL`; the daemon brings the model up on demand (a cold start streams its progress into your cell and can take minutes).
Ver en GitHub