Menü
Skills in diesem Repository
SkillsMP hat 1.228 Skills aus ADu2021/skillXiv gesammelt. Öffne einen Skill, um Quelle und Details zu prüfen.
ADu2021/skillXivEs werden 40 von 1.228 gesammelten Skills angezeigt.
Enhances RLVR through cooperative-adversarial flywheel, intent verification, and trap instructions. Detects reward hacking and improves training efficiency, achieving 87.43% on IFEval.
Quellsprache: Englisch
Evaluate reasoning model capabilities by analyzing three complexity-dependent behavioral regimes and identifying fundamental limitations in symbolic manipulation rather than computational budgets.
Quellsprache: Englisch
Upscale any degraded image to 4K using an agentic framework that analyzes image quality, selects appropriate restoration tools, and iteratively improves results through reasoning and reflection.
Quellsprache: Englisch
Imagine-then-Plan: Agent Learning from Adaptive Lookahead with World Models. From arXiv:2601.08955
Quellsprache: Englisch
Accelerate sparse attention by reusing token selection indices across layers. Partition layers into full indexer (F) and shared (S) types using greedy search or multi-layer distillation to eliminate 75% of indexer computation.
Quellsprache: Englisch
Introduce IMDD-1M dataset with 1M aligned image-text pairs spanning 60+ material categories and 400+ defect types. Train diffusion-based vision-language models requiring 5% task-specific data vs. dedicated expert models for manufacturing quality control.
Quellsprache: Englisch
Implement techniques from Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification. While the majority of existing efforts focus on enhancing policy capabilities via post-training, we propose an…
Quellsprache: Englisch
Combines SFT and DPO with robust data selection pipeline using multidimensional quality metrics. Achieves DeepSeek-R1 performance with 12% training data, enabling efficient reasoning model alignment.
Quellsprache: Englisch
Research contribution advancing agent and reasoning capabilities through novel approaches to model development, training, and evaluation.
Quellsprache: Englisch
Merge sliding window and linear attention (Gated DeltaNet) for unlimited VLM inputs with 3.6× speedup. InfiniteVL handles video understanding at 24 FPS with constant memory—ideal when context length must scale without quadratic overhead.
Quellsprache: Englisch
Implement dense-sparse switchable attention enabling LLMs to scale from short to long sequences with 4× speedup and 98-99.7% performance retention, requiring no extra parameters by reusing pretrained attention weights through trainable sparse pattern…
Quellsprache: Englisch
Optimize multi-turn agent policies by measuring turn-level information gain via counterfactual reasoning. Provide dense reward signals identifying which clarifying questions and observations improve the agent's decision distribution, then adaptively blend…
Quellsprache: Englisch
Enable more precise LLM error correction by having users directly edit the model's previous response, conditioning the next response on this corrected version. This approach reduces token overhead by 79% compared to traditional separate-feedback methods while…
Quellsprache: Englisch
Enable VLMs to perform generalized visual search—locating relational, fuzzy, and conceptual regions from free-form language descriptions. Introduces O3-Bench benchmark with high-density composite charts/maps, uses RL-trained vSearcher for spatial…
Quellsprache: Englisch
Convert pre-trained latent video diffusion into real-time autoregressive generators using adversarial post-training, achieving 24fps streaming on single H100.
Quellsprache: Englisch
Enhance multimodal models through cascade RL for reasoning improvement and visual resolution routing for inference efficiency, achieving 16% reasoning gains and 4.05x speedup.
Quellsprache: Englisch
Map text embeddings into visual representation space for multimodal fusion, eliminating expensive image-text alignment pre-training while improving reasoning-heavy tasks by up to 27.2%.
Quellsprache: Englisch
Connect LLM agents to IoT sensors and microcontrollers through MCP standardization. Use to build monitoring systems and smart home automation where LLMs reason over real-world sensor data.
Quellsprache: Englisch
Enable efficient parallel decoding while preserving causal inference properties through progressive distillation with cyclic noise scheduling. Reduce training complexity via block-wise sparse attention, implement rejection recycling and multi-block decoding.…
Quellsprache: Englisch
Enable scalable MoE inference by disaggregating attention and expert layers onto independent GPU sub-clusters. Use adaptive two-phase communication, activation load-balanced scheduling, and activation-aware expert management. Achieve 3.9× higher per-GPU…
Quellsprache: Englisch
Implement techniques from Jet-RL: Enabling On-Policy FP8 Reinforcement Learning with Unified Training and Rollout Precision Flow. Reinforcement learning (RL) is essential for enhancing the complex reasoning capabilities of large language models (LLMs)
Quellsprache: Englisch
Accelerate diffusion transformers by processing only sparse anchor tokens in early stages, then expanding to full spatial resolution using learnable extrapolation. Combines SAG-ODE velocity field lifting with importance-guided token activation for lossless…
Quellsprache: Englisch
Demonstrate that simple single-stage RL with fixed hyperparameters matches complex multi-stage approaches for training small LLMs on mathematical reasoning. Use basic setup: GRPO algorithm, rule-based verification, 16K token context, standard training data…
Quellsprache: Englisch
Generate optimized GPU kernels by treating LLMs as planning engines that co-evolve with a world model. Decouples high-level algorithmic planning from low-level implementation, enabling structured search through optimization strategies. LLM world model…
Quellsprache: Englisch
Pixel-based reinforcement learning agents often fail under purely visual distribution shift even when latent dynamics and rewards are unchanged, but existing benchmarks entangle multiple sources of shift and hinder systematic analysis. We introduce KAGE-Env,…
Quellsprache: Englisch
Automate compute kernel optimization via agentic AI and retrieval-augmented prompting. Unified context-aware transformation function, hardware-specific constraint KB, self-improving state machine exploring kernel variants—achieving 1.25-17× speedups on…
Quellsprache: Englisch
Reveals that memory bandwidth—not computation—dominates test-time costs; proposes eFLOPs metric incorporating both computation and memory, showing 14B+ minimum threshold for reasoning value.
Quellsprache: Englisch
Generative approach for creating complex dynamic scenes and content, supporting agent capabilities in understanding and reasoning about multi-agent environments.
Quellsprache: Englisch
Unify video generation, editing, and reasoning through Multimodal Visual Language (MVL) paradigm processing text instructions, reference images, and video contexts in shared embedding space. Employ prompt enhancer, omni-generator with diffusion transformer,…
Quellsprache: Englisch
Improve RL training for LLMs by dynamically allocating exploration budget (rollout count) to tasks based on their difficulty and current learning status. Solves the knapsack problem of maximizing gradient signal within fixed compute budget, increasing…
Quellsprache: Englisch
Enable real-time portrait animation via causal AR video generation with temporal coherence. Sliding window with global reference frame caching, temporal knot module overlapping adjacent chunks, global context running ahead—preventing error accumulation while…
Quellsprache: Englisch
Build knowledge agents that generalize across grounded reasoning tasks by combining agentic data synthesis via vector search with off-policy reinforcement learning. Use multi-task training on synthetic question-answer pairs to achieve robust cross-domain…
Quellsprache: Englisch
Enables 8x KV cache compression with minimal training overhead to improve reasoning accuracy by allowing more token generation within computational budgets.
Quellsprache: Englisch
Guide frozen language models toward multi-step reasoning by modifying cached key-value representations after the prefilling stage. Extract steering vectors from contrastive prompt pairs and apply them to KV cache with scalar coefficients. Improves reasoning…
Quellsprache: Englisch
Extract high-quality embeddings from frozen decoder-only LLMs by re-routing internal key-value states without training—outperforming training-free baselines by 10% on MTEB while maintaining robustness across sequences up to 4,096 tokens.
Quellsprache: Englisch
Build an 8B multimodal model specializing in short-form video understanding. Combines four-stage pre-training with instruction-tuning and reinforcement learning to enable advanced reasoning about dynamic video content while maintaining general vision-language…
Quellsprache: Englisch
Enable LLM agents to actively explore and adapt policies through meta-RL instead of converging to fixed behaviors. Uses cross-episode training with trajectory-level discounting and in-context policy adaptation via textual reflections—achieving 11-19%…
Quellsprache: Englisch
Align vision-language-action models with natural language instructions using Bayesian decomposition with latent action queries, improving robotic manipulation generalization. Use when building agents that follow language commands while observing visual scenes…
Quellsprache: Englisch
Advanced reasoning approach for optimizing inference efficiency through meta-cognitive planning, enabling agents to make better decisions with reduced computational overhead.
Quellsprache: Englisch
Compute reasoning rewards from the model's own next-token probability distribution at solution end. Integrates verification-based feedback into single model without separate evaluator, enabling efficient RL training with minimal overhead.
Quellsprache: Englisch