[]()
[]()
[]()
[]()
[]()
# Edge-AI-Libraries
Welcome to **Edge AI Libraries** - a set of Intel-optimized libraries, microservices, tools,
and demos intended for developing real-time edge AI solutions.
If you are an AI developer, data scientist, or system integrator, these assets will
help you organize data, train models, run efficient inference, and deliver
robust, industry-grade automation systems for computer vision, multimedia,
and industrial use cases.
## Key Components
These flagship components represent the most advanced, widely adopted, and
impactful tools in the repository:
- [Deep Learning Streamer](https://github.com/open-edge-platform/dlstreamer/blob/main/README.md)
Build efficient media analytics pipelines using streaming AI pipelines for
audio/video media analytics using GStreamer for optimized media operations
and OpenVINO for optimized inferencing
- [Scenescape](https://github.com/open-edge-platform/scenescape)
Create 3D/4D dynamic digital twins from multimodal sensor data for advanced
spatial analytics.
- [Geti™](https://github.com/open-edge-platform/geti)
Build computer vision AI models enabling rapid dataset management, model
training, and deployment to the edge.
- [Anomalib](https://github.com/open-edge-platform/anomalib)
Deploy visual anomaly detection with this state-of-the-art library, offering
algorithms for segmentation, classification, and reconstruction, plus features
like experiment management and hyperparameter optimization.
- [OpenVINO Toolkit](https://github.com/openvinotoolkit/openvino)
Optimize, run, and deploy AI models with this industry-standard toolkit,
accelerating inference on Intel CPUs, GPUs, and NPUs. Supports a broad range
of AI solutions including vision-based applications, generative AI,
and vision-language models.
## Component Categories
### Model Training and Optimization
This group provides core AI libraries and tools focused on computer vision
model building, training, optimization, and deployment for Intel hardware.
They address challenges such as dataset curation, model lifecycle management,
and high-performance inference on edge devices.
- [Geti™](https://github.com/open-edge-platform/geti)
Build computer vision AI models enabling rapid dataset management, model
training, and deployment to the edge.
- [Anomalib](https://github.com/open-edge-platform/anomalib)
Deploy visual anomaly detection with this state-of-the-art library, offering
algorithms for segmentation, classification, and reconstruction, plus features
like experiment management and hyperparameter optimization.
- [Geti™ SDK](https://github.com/open-edge-platform/geti-sdk)
Software for efficient model training and deployment.
- [OpenVINO Toolkit](https://github.com/openvinotoolkit/openvino)
Toolkit for optimizing and deploying AI inference, offering performance boost
on Intel CPU, GPU, and NPU devices.
- [OpenVINO Training Extensions](https://github.com/open-edge-platform/training_extensions)
& [Model API](https://github.com/open-edge-platform/model_api)
A set of advanced algorithms for model training and conversion.
- [Datumaro](https://github.com/open-edge-platform/datumaro)
Dataset management framework to curate and convert vision datasets.
- [Edge AI Tuning Kit](https://github.com/open-edge-platform/edge-ai-tuning-kit)
Create, tailor, and implement custom AI models directly on edge platforms.
### LLM Inference Optimization
These libraries reduce the compute, memory, and token cost of running large
language model and agent workloads on the edge, improving inference efficiency
without changing model behavior.
- [Adaptive Token Compressor](./libraries/adaptive-token-compressor)
Pluggable token compression for LLM agent systems — compresses system
prompts, context, and tool schemas to cut input token usage.
- [KVCache Quantization and Offload](./libraries/kv-quant-offload)
Near-lossless 4-bit KV-cache quantization for LMCache/vLLM, reducing
KV-cache memory and storage overhead for KV offload on Intel edge
accelerators.
### Streaming and Multimedia AI
Handling large-scale media analytics workloads, these components support
real-time audio and video AI pipeline processing, transcription, and multimodal
embedding generation, addressing common use cases like surveillance, content
indexing, and audio analysis.
- [Deep Learning Streamer](https://github.com/open-edge-platform/dlstreamer)
& [Deep Learning Streamer Pipeline Server](./microservices/dlstreamer-pipeline-server)
Streaming AI pipeline builder with scalable server for media
inferencing.
- [Audio Analyzer](./microservices/audio-analyzer)
Microservices providing real-time audio transcription and
intelligence extraction.
- [Multimodal Embedding](./microservices/multimodal-embedding-serving)
Services handling vision-language models and embedding generation
for multimodal search.
- [Scenescape](https://github.com/open-edge-platform/scenescape)
Software for creating dynamic 3D/4D digital twins for spatial
analytics.
- [Time Series Analytics Microservice](./microservices/time-series-analytics)
Real-time analytics microservice designed for anomaly detection
and forecasting on sensor time-series data.
- [Multi-level Video Understanding Microservice](./microservices/multilevel-video-understanding/)
Microservices providing a multi-level, temporal-enhanced approach to generate high quality summaries for video files, especially for long videos.
- [Sensor Manager](./microservices/sensor-manager)
Microservice discovering USB and ONVIF network cameras and describing
their best capture configurations and RTSP media profiles.
### Data Preparation and Retrieval
Efficient data management and retrieval are crucial for AI performance
and scalability. This group offers components for dataset curation,
vector search, and document ingestion across multimodal data.
- [Vector Retriever (Milvus)](./microservices/visual-data-preparation-for-retrieval/milvus)
& [Visual Data Preparation (Milvus and Multimodal-dataprep)](./microservices/visual-data-preparation-for-retrieval/multimodal-dataprep)
High-performance vector similarity search and visual data indexing.
- [Model Download](./microservices/model-download)
& [Document Ingestion](./microservices/document-ingestion/pgvector)
Model Download downloads AI models from external sources, converts
them to the OpenVINO™ Intermediate Representation (IR) format with optional optimization,
and caches them locally. Document Ingestion prepares documents for AI workflows.
- [Video Chunking Utils](./libraries/video-chunking-utils)
Splits/segments video streams into chunks, supporting batch and
pipeline-based analytics.
### Developer Tools and SDKs
- [OEP SDK Manager](./tools/oep-sdk-manager)
Discover and install SDKs for Intel edge AI development using an interactive
selector, installation scripts, and SDK-specific tutorials.
### Benchmarking Tools
These support tools provide visual pipeline evaluation and performance
benchmarking to help analyze AI workloads and industrial
environments effectively.
- [Visual Pipeline and Platform Evaluation Tool](./tools/visual-pipeline-and-platform-evaluation-tool)
Benchmark and analyze AI pipeline performance on various edge platforms.
- [PLCopen Benchmark](./sample-applications/plcopen-benchmark)
Compliance and performance testing toolkit for motion control.
- [Edge AI Sizing Tool](https://github.com/open-edge-platform/edge-ai-sizing-tool)
Showcase, monitor, and optimize the scalability and performance of
AI workloads on Intel edge hardware. Configure models, choose
performance modes, and visualize resource metrics in real time.
- [Edge System Qualification](https://github.com/open-edge-platform/edge-system-qualification)
Command Line Interface (CLI) tool that provides a collection of test suites to
qualify Edge AI system. It enables users to perform targeted tests, supporting
a wide range of use cases from system evaluation to data
extraction and reporting.
### Edge Control Libraries
Focused on real-time industrial automation, motion control, and fieldbus
communication, these components provide reliable, standards-compliant
building blocks for manufacturing and factory automation applications.
- [ECAT EnableKit](./libraries/edge-control-libraries/fieldbus/ecat-enablekit)
& [EtherCAT Masterstack](./libraries/edge-control-libraries/fieldbus/ethercat-masterstack)
EtherCAT communication protocol stack and development tools.
- [PLCopen Servo](./libraries/edge-control-libraries/plcopen-motion-control/plcopen-servo)
and
[RTmotion](./libraries/edge-control-libraries/plcopen-motion-control/plcopen-motion)
Libraries implementing motion control standards for servo drives
and real-time trajectory management.
- [PLCopen Databus](./sample-applications/plcopen-databus)
Tools for data communication in automation networks.
- [Real-time Data Agent](./libraries/edge-control-libraries/rt-data-agent)
Microservice for collecting, processing, and distributing
real-time sensor and industrial device data; supports both edge
analytics and integration with operational systems.
### Robotics Libraries
Optimized libraries for robotic perception, localization, mapping,
and 3D point cloud analytics. These tools are designed to maximize
performance on heterogeneous Intel hardware using oneAPI DPC++, enabling
advanced robotic workloads at the edge.
- [FLANN optimized with oneAPI DPC++](./libraries/robotics-ai-libraries/flann)
High-speed nearest neighbor library, optimized for Intel
architectures; supports scalable feature matching, search, and
clustering in robotic vision and SLAM.
- [ORB Extractor](./libraries/robotics-ai-libraries/orb-extractor)
Efficient ORB feature and descriptor extraction for visual
SLAM, mapping, and tracking; designed for multicamera and GPU
acceleration scenarios.
- [Point Cloud Library Optimized with Intel oneAPI DPC++](./libraries/robotics-ai-libraries/pcl)
Accelerated modules from PCL for real-time 2D/3D point cloud
processing—supports object detection, mapping, segmentation, and
scene understanding in automation and robotics.
- [Motion Control Gateway](./libraries/robotics-ai-libraries/motion-control-gateway)
Unified interface library bridging motion control commands
between AI modules and industrial/robotic devices; simplifies
real-time control integration and system interoperability in mixed
hardware environments.
### Sample Applications and Reference Implementations
Ready-to-use example applications demonstrating real-world AI use cases
to help users get started quickly and understand integration patterns:
- [Chat Question and Answer Core](./sample-applications/chat-question-and-answer-core)
Conversational AI application integrating retrieval-augmented
generation for question answering.Optimized for Intel(R) Core.
- [Document Summarization](./sample-applications/document-summarization)
AI pipeline for automated summarization of textual documents.
- [Video Search and Summarization](./sample-applications/video-search-and-summarization)
Application combining video content analysis with search and
summarization capabilities. 🧪 Now with experimental support for
Intel Arc Pro B-series GPUs (B60, B65, B70).
- [Edge Developer Kit Reference Scripts](https://github.com/open-edge-platform/edge-developer-kit-reference-scripts)
Automate the setup of edge AI development environments using these
proven reference scripts. Quickly install required drivers,
configure hardware, and validate platform readiness for Intel-based
edge devices.
> [!NOTE]
> Visit the Edge AI Suites repositories for a broader set of sample applications targeted at
> specific industry segments:
>
> - [Metro AI Suite](https://github.com/open-edge-platform/metro-ai-suite)
> - [Manufacturing AI Suite](https://github.com/open-edge-platform/manufacturing-ai-suite)
> - [Retail AI Suite](https://github.com/intel-retail/)
> - [Robotics AI Suite](https://github.com/open-edge-platform/robotics-ai-suite)
> - [Education AI Suite](https://github.com/open-edge-platform/education-ai-suite)
> - [Health and Life Sciences AI Suite](https://github.com/open-edge-platform/health-and-life-sciences-ai-suite)
> - [Federal and Aerospace AI Suite](https://github.com/open-edge-platform/federal-and-aerospace-ai-suite)
### Edge Analytics Microservices
Specialized microservices delivering machine learning-powered
analytics optimized for edge deployment. These microservices support
scalable anomaly detection, classification, and predictive analytics on
structured and time-series data.
- [isolation-forest-microservice](https://github.com/intel/isolation-forest-microservice)
An efficient Isolation Forest microservice for unsupervised
anomaly detection supporting high-performance training and inference
on tabular and streaming data.
- [random-forest-microservice](https://github.com/intel/random-forest-microservice)
High-speed Random Forest microservice for supervised
classification tasks, optimized for edge and industrial use cases
with rapid training and low-latency inference.
### Edge-device Enablement Framework (EEF)
A comprehensive framework providing hardware abstraction, device management,
and deployment tools for edge AI applications. Simplifies cross-platform
development and enables consistent deployment across diverse edge hardware
architectures.
- [Edge-device Enablement Framework](./frameworks/edgedevice-enablement-framework)
Framework for Intel® platform enablement and streamlining
edge AI application deployment across heterogeneous device platforms.
## AI Agent Skills
This repository ships a set of *agent skills** that automate
common development tasks — changelog generation, release notes authoring, and
security review — directly from your editor.
| Skill | Slash command | What it does |
|-------|--------------|--------------|
| `generate-changelog` | `/generate-changelog` | Generates or updates `CHANGELOG.md` from git history between two branches or tags |
| `generate-release-notes` | `/generate-release-notes` | Produces formatted release notes for a component folder by comparing two branches or tags |
| `security-review` | `/security-review` | On-demand security review for code, Dockerfiles, Helm charts, and CI/CD workflows |
### Quick start
**Auto-trigger** — describe what you want in Copilot/Claude Code/Codex chat in agent mode and the agent picks
the right skill:
```
Generate a changelog for microservices/time-series-analytics comparing release-2026.0.0 and release-2026.1.0
```
**Explicit slash command** — invoke a skill directly with optional inline
arguments:
```
/generate-changelog microservices/time-series-analytics release-2026.0.0 release-2026.1.0
```
**Parameterized prompts** — for guided, form-based input use the companion
prompt files (coding agent(github copio) pops up an input box for each parameter):
```
/run-changelog
/run-release-notes
```
## Contribute
To learn how to contribute to the project, see
[CONTRIBUTING.md](./CONTRIBUTING.md).
## Community and Support
If you need help, want to suggest a new feature, or report a bug, please use
the following channels:
- **Questions & Discussions:** Join the conversation in
[GitHub Discussions](https://github.com/open-edge-platform/edge-ai-libraries/discussions)
to ask questions, share ideas, or get help from the community.
- **Bug Reports & Feature Requests:** Submit issues via
[Github Issues](https://github.com/open-edge-platform/edge-ai-libraries/issues)
for bugs or feature requests.
## License
The **Edge AI Libraries** project is licensed under the [APACHE 2.0](./LICENSE) license, except for the following components:
| Component | License |
|:----------|:--------|
| Dataset Management Framework (Datumaro) | [MIT License](https://github.com/open-edge-platform/datumaro/blob/develop/LICENSE) |
| Intel® Geti™ | [Limited Edge Software Distribution License](https://github.com/open-edge-platform/geti/blob/develop/LICENSE) |
| Deep Learning Streamer | [MIT License](https://github.com/open-edge-platform/dlstreamer/blob/main/LICENSE) |
## Intended Use
Unless stated otherwise, software maintained under the Edge AI Libraries repository is intended
for demonstration and reference purposes only.
Certain features, such as authentication, TLS termination, and external access controls are
assumed to be covered at the infrastructure level.
For more information, refer to
[Notes on Usage](https://docs.openedgeplatform.intel.com/dev/OEP-articles/notes-on-usage.html).
README 원본 보기