beehive-lab/jitllm

build-tornado

Build a TornadoVM SDK for jitllm. Use when TORNADOVM_HOME is unset, points at the wrong JDK line or backend, or at a TornadoVM older than 7.0.0.

Quellsprache: Englisch

build-n-run-engine

Build jitllm with Maven and run it on an accelerator. Use when target/ is missing or stale, after pulling changes, or when switching JDK line or backend.

Quellsprache: Englisch

update-quarkus-langchain4j-integration

Update the Quarkus LangChain4j jitllm extension to a new jitllm release. Use when bumping io.github.beehive-lab:jitllm in quarkus-langchain4j, adapting the runtime/deployment modules to API or capability changes, validating JDK/TornadoVM combinations and…

Quellsprache: Englisch

update-spring-ai-integration

Create or update the Spring AI jitllm integration (spring-ai-jitllm, spring-ai-autoconfigure-model-jitllm, spring-ai-starter-model-jitllm) for a jitllm release. Use when bumping io.github.beehive-lab:jitllm in spring-ai, adapting JitLlmChatModel to API or…

Quellsprache: Englisch

port-model-to-jitllm

Port a new model architecture to jitllm. Use when a GGUF file is not recognized, when a family needs its own program description or lowering, or when deciding whether an existing family's implementation can be reused for a new one.

Quellsprache: Englisch

update-langchain4j-integration

Update the LangChain4j jitllm integration to a new jitllm release. Use when bumping io.github.beehive-lab:jitllm, adapting the adapter to API or capability changes, enabling inherited integration tests, validating JDK/TornadoVM combinations and demos, or…

Quellsprache: Englisch

jitllm-ncu-analysis

Nsight Compute workflow for one jitllm CUDA kernel. Use after nsys, the TornadoVM profiler or the metrics output has already named the hot kernel.

Quellsprache: Englisch

jitllm-nsys-analysis

Nsight Systems workflow for jitllm on the CUDA backend. Use to capture a timeline and decide where the time goes: generated kernels, launch overhead, synchronization, host-device transfers, or GPU idle.

Quellsprache: Englisch