Dynamically modulate reasoning depth at test time using alpha moments and Bernoulli scheduling to optimize inference speed-quality tradeoffs without retraining.
Idioma do texto original: inglês
Menu
Skills neste repositório
O SkillsMP coletou 1.228 skills de ADu2021/skillXiv. Abra uma skill para revisar a origem e os detalhes.
ADu2021/skillXivMostrando 40 de 1.228 skills coletadas.
Dynamically modulate reasoning depth at test time using alpha moments and Bernoulli scheduling to optimize inference speed-quality tradeoffs without retraining.
Idioma do texto original: inglês
Enable LLMs to solve complex problems through multi-turn agentic reasoning with tool-assisted verification and iterative refinement loops. Trigger: improve reasoning reliability on long-horizon tasks by combining RL with verification.
Idioma do texto original: inglês
Use meta-learning to automatically balance Supervised Fine-Tuning and Reinforcement Learning signals, treating SFT and RL as complementary rewards in a unified single-stage training framework.
Idioma do texto original: inglês
Implements A^3-Bench from arXiv:2601.09274
Idioma do texto original: inglês
Evaluate language models using open-ended answer generation and semantic matching instead of multiple choice, eliminating test-taking shortcuts and achieving near-perfect alignment with human judgment.
Idioma do texto original: inglês
Automate sub-agent creation by treating agents as dynamically creatable executors defined by four-tuple abstraction (Instruction, Context, Tools, Model), enabling flexible delegation and cost-aware routing for complex multi-step tasks.
Idioma do texto original: inglês
Accelerate diffusion language model inference by dynamically adjusting parallel tokens per step using a small auxiliary autoregressive model, achieving substantial throughput gains.
Idioma do texto original: inglês
Enable LLM agents to autonomously retrieve information across multiple granularities using keyword search, semantic search, and chunk read tools. Simple ReAct-based loop with hierarchical interfaces outperforms dense retrieval by allowing adaptive information…
Idioma do texto original: inglês
Route generation dynamically based on relative model advantage for 2× latency reduction in reasoning. Arbitrage learns when draft models excel versus when target models are worthwhile—critical for balancing cost and quality in long reasoning chains.
Idioma do texto original: inglês
Reduces inference cost by compressing context into continuous representations using a separate encoder. Generates 4-8x fewer representations than token embeddings while maintaining model performance. Works with any decoder LLM without modification or…
Idioma do texto original: inglês
Scale RL training to large models through decoupled rollout and training workers with controlled data staleness.
Idioma do texto original: inglês
Calibrate exploration effort in reasoning traces based on problem difficulty by detecting high-entropy windows and applying hierarchical entropy rewards. Reduces unnecessary reasoning on easy tasks while increasing exploration on hard tasks.
Idioma do texto original: inglês
Reduce policy gradient variance in language agent training by aggregating rewards in semantic intention space, enabling 9.95% average performance gains across downstream tasks without exponential action space explosion.
Idioma do texto original: inglês
Build reusable skill libraries for mathematical reasoning through hierarchical RL. Maintain a high-level skills manager that summarizes successful solution traces and selects relevant strategies to condition future rollouts.
Idioma do texto original: inglês
Agentic reward model framework enabling active tool invocation (cropping, retrieval, validation) to ground judgments in verifiable evidence, using multi-stage GRPO with adaptive reward shaping for systematic evidence-based evaluation.
Idioma do texto original: inglês
Comprehensive empirical study recommending model-specific test-time scaling strategies (majority voting, first-finish search) across eight LLMs based on architectural family, problem difficulty, and compute budget rather than universal approaches.
Idioma do texto original: inglês
Train LLMs to effectively integrate tools through advantage shaping, directly modifying advantage functions to guide policy without compromising training stability.
Idioma do texto original: inglês
Recent advances in agentic Large Language Models (LLMs) have positioned them as generalist planners capable of reasoning and acting across diverse tasks. However, existing agent benchmarks largely focus on symbolic or weakly grounded environments, leaving…
Idioma do texto original: inglês
Optimize multi-turn agent policies via entropy-guided tree expansion and turn-level credit assignment. AT²PO addresses exploration diversity, sparse credit signal, and policy misalignment problems in LLM agents through structured tree search and turn-aware…
Idioma do texto original: inglês
Adaptive framework for dynamically selecting optimal model-tool combinations in multi-domain reasoning, using cluster-based routing and reinforcement learning for improved agent reasoning across diverse tasks.
Idioma do texto original: inglês
Decompose agent reasoning into atomic thoughts guided by curriculum-based reasoning reward models, enabling multi-hop information retrieval and interpretable deep research.
Idioma do texto original: inglês
Replace ratio-based clipping in GRPO with KL-divergence constraints using the KL3 estimator, improving exploration and training stability with asymmetric clipping that requires no additional computation.
Idioma do texto original: inglês
Demonstrates position bias where LLMs neglect middle content while over-attending to endpoints. Proposes Attention-Driven Reranking (AttnRank) to align content with model's intrinsic attention preferences.
Idioma do texto original: inglês
Replace uniform residual accumulation with depth-wise attention that selectively aggregates earlier layer representations. Improve gradient flow and model performance in deep architectures by learning content-dependent depth-wise selection.
Idioma do texto original: inglês
Guide LLM exploration in reasoning tasks using attention patterns as navigation signals. This technique branches exploration from high-attention tokens (likely reasoning steps) and applies adaptive sampling to maintain effective gradients, significantly…
Idioma do texto original: inglês
Identify influential texts in long contexts via attention weights using top-K filtering and context subsampling, achieving 10-20x speedup over perturbation methods.
Idioma do texto original: inglês
Build fully open audio-language models supporting reasoning over speech, sound, and music with 10-minute long-form comprehension and multi-turn conversation capabilities. Use when you need to process audio modalities alongside text for complex reasoning tasks…
Idioma do texto original: inglês
Generate realistic video footage of people from audio input using a unified self-attention framework, producing convincing speaker performances without domain-specific restrictions.
Idioma do texto original: inglês
Automatically generates diverse multilingual code benchmarks using LLMs, creating 3920 problems across 20 programming languages with quality assurance filtering.
Idioma do texto original: inglês
Generate diverse, validated game environments automatically using domain-specific language specifications and LLM coding agents with self-repair, enabling cost-effective (≈$4/env) creation of heterogeneous test domains for evaluating cross-environment agent…
Idioma do texto original: inglês
Improves LLM tool-use capabilities through automated environment construction that generates realistic feedback and verifiable rewards for RL-based training without external tools.
Idioma do texto original: inglês
Train specialized LLMs to generate optimized Triton GPU kernels using RL with dual rewards for correctness and syntax compliance. 8B model achieves parity with Claude-Sonnet and DeepSeek-R1 by combining supervised fine-tuning on curated code pairs with RL…
Idioma do texto original: inglês
Build LLM-driven data science agents grounded in empirical knowledge through expert knowledge base, tree search algorithms, and complexity-adaptive code generation, surpassing SOTA by 8% on MLE-Bench.
Idioma do texto original: inglês
Build autonomous research agents using pre-computed knowledge graphs instead of online reasoning. Extract methodological patterns from literature, organize them into structured knowledge, and enable agents to align user research intents with established…
Idioma do texto original: inglês
Autoregressive U-Net operating directly on raw bytes with hierarchical multi-scale pooling for adaptive token embedding, eliminating fixed vocabularies.
Idioma do texto original: inglês
Generate synthetic web environments at scale by specifying websites as Finite State Machines with explicit state transitions, then programmatically executing GUI actions to collect verified interaction trajectories. Reduces trajectory cost from $0.15–$1.00 to…
Idioma do texto original: inglês
Avey architecture pairs a ranker with autoregressive processor to select relevant tokens, decoupling context window from sequence length for efficient long-range processing.
Idioma do texto original: inglês
Accelerate agentic AI training by distributing task execution across clusters, achieving 14.6x speedup in experience collection and enabling practical large-scale agent development
Idioma do texto original: inglês
Stabilize off-policy RL for LLMs using adaptive clipping that dynamically rebalances positive/negative gradients and preserves entropy, improving mathematical reasoning performance vs standard PPO.
Idioma do texto original: inglês
Fixes batch speculative decoding ragged tensor problem where sequences in batches accept different token counts, desynchronizing state. EQSPEC guarantees output equivalence through proper synchronization. EXSPEC reduces overhead 40% via cross-batch…
Idioma do texto original: inglês