Bridge image understanding-generation gap via In-Context Chain-of-Thought reasoning and RL training with surrogate rewards. Improve faithful execution of mixed image-text prompts in generation and editing tasks.
Langue du texte source : anglais
Menu
Skills dans ce dépôt
SkillsMP a collecté 1 228 skills depuis ADu2021/skillXiv. Ouvrez un skill pour examiner sa source et ses détails.
ADu2021/skillXivAffichage de 40 skills collectés sur 1 228.
Bridge image understanding-generation gap via In-Context Chain-of-Thought reasoning and RL training with surrogate rewards. Improve faithful execution of mixed image-text prompts in generation and editing tasks.
Langue du texte source : anglais
Restructure latent representations in pretrained audio autoencoders without full retraining. Apply three variants—ordered, semantic, and equivariant—to enforce structure like channel ordering, semantic alignment, or filter correspondence. Achieves 20-60%…
Langue du texte source : anglais
Compress search trajectories into structured states capturing partial answers, evidence, and uncertainties. Recursive execution leverages compressed states to avoid redundant exploration, improving resource efficiency by 50%.
Langue du texte source : anglais
Implements RealMem from arXiv:2601.06966
Langue du texte source : anglais
Enhances passage ranking through reasoning capabilities via synthesized training data and multi-stage training combining supervised fine-tuning with reinforcement learning for improved ranking accuracy.
Langue du texte source : anglais
Enable image generators to reason explicitly through text before creating images using supervised fine-tuning and reinforcement learning optimization.
Langue du texte source : anglais
Optimize chain-of-thought reasoning under computational budgets using information-theoretic compression principles, improving reasoning efficiency without accuracy loss.
Langue du texte source : anglais
Reasoning Core procedurally generates verifiable symbolic reasoning datasets across formal domains (planning, logic, parsing), with external solvers and curriculum control.
Langue du texte source : anglais
Create infinite training environments for reasoning with automatic verification using procedural generation and domain-specific evaluators.
Langue du texte source : anglais
Large language models have achieved remarkable capabilities across domains, yet mechanisms underlying sophisticated reasoning remain elusive. Recent reasoning models outperform comparable instruction-tuned models on complex cognitive tasks, attributed to…
Langue du texte source : anglais
Overcome token-level randomness limitations in RL by shifting exploration to latent reasoning strategies. Train a VAE encoding diverse reasoning patterns, sample latents during RL, decode to prefix embeddings steering internal reasoning—enabling structured…
Langue du texte source : anglais
Reduce LLM sampling costs by 50% while maintaining reasoning performance through Reasoning Path Confidence (RPC), which combines perplexity-guided pruning with self-consistency sampling.
Langue du texte source : anglais
Extract and transfer reasoning capabilities between language models using task vectors derived from supervised fine-tuning and reinforcement learning weight differences. Apply reasoning vectors via simple arithmetic to enhance any compatible instruction-tuned…
Langue du texte source : anglais
Improves base model reasoning through iterative sampling without training or fine-tuning. Uses MCMC-inspired sampling to extract latent reasoning from pretrained models, achieving RL-comparable gains on math, coding, and QA tasks while preserving diversity.
Langue du texte source : anglais
Diagnose and correct reasoning inefficiencies (overthinking and underthinking) in large reasoning models using confidence-based steering vectors, without retraining. Enables optimal reasoning budgets across model scales.
Langue du texte source : anglais
Implement techniques from RebuttalAgent: Strategic Persuasion in Academic Rebuttal via Theory of Mind. Although artificial intelligence (AI) has become deeply integrated into various stages of the research workflow and achieved remarkable advancements,…
Langue du texte source : anglais
Prevents catastrophic forgetting in continual learning by merging models using layer-wise hidden representations as similarity proxies. Shallow layers preserve domain-general features while deep layers enable task-specific adaptation, enabling seamless…
Langue du texte source : anglais
Unifies planning and action by treating plans as abstract placeholder functions recursively decomposed to primitive actions. Enables agents to dynamically adjust abstraction levels per task without rigid hierarchies. Improves inference performance and…
Langue du texte source : anglais
Build self-evolving multi-agent browser systems that combine web reconnaissance with dynamic tool generation and execution. Enables autonomous agents to analyze failed trajectories, generate specialized tools on-the-fly, and adapt to novel web environments…
Langue du texte source : anglais
Enable efficient long-sequence generation by combining block-sparse attention with periodic dense rectification to bound error accumulation.
Langue du texte source : anglais
Extend neural network reasoning capabilities through recurrence (repeated computation cycles), external memory (intermediate state storage), and test-time compute scaling for multi-step reasoning.
Langue du texte source : anglais
Enable test-time compute scaling in vision-language-action models via weight-tied recurrent inference within latent space, with adaptive stopping based on action divergence.
Langue du texte source : anglais
Process prompts exceeding model context windows by recursively decomposing long inputs into manageable chunks and calling the model recursively on snippets—enabling inference on contexts 100x longer than native window while maintaining quality and improving…
Langue du texte source : anglais
Recursive Think-Answer Process enables models to iteratively refine reasoning and answers during inference, reducing self-correction errors and improving accuracy without retraining.
Langue du texte source : anglais
Comprehensive evaluation dataset for systematic vulnerability testing of language models, enabling identification and mitigation of failure modes before agent deployment.
Langue du texte source : anglais
Train language models for multi-step information-seeking using dual-constrained task synthesis and cost-efficient staged learning. Generate complex queries by controlling topological complexity and information dispersion, then train atomic reasoning skills…
Langue du texte source : anglais
Trains LLMs to autonomously debug and improve code through structured RL-optimized reflection cycles. Internalizes debugging process into model weights rather than relying on external oracles or expensive iterative prompting.
Langue du texte source : anglais
Identify and patch critical safety vulnerabilities in large reasoning models. Via linear probing and causal intervention, locate specific attention heads responsible for alignment degradation at final tokens. Recover safety via 'Cliff-as-a-Judge' data…
Langue du texte source : anglais
ReGFT pre-trains models on hybrid reference-augmented trajectories before RL, enabling them to solve harder problems and accelerate convergence.
Langue du texte source : anglais
Merge softmax and linear attention for video diffusion models using chunk-wise recurrent reformulation with constant memory usage. Enable efficient distillation from existing softmax models, reducing training cost two orders of magnitude to ~160 GPU hours.
Langue du texte source : anglais
Recover learning signals in RL for LLM reasoning by dynamically allocating sampling budget based on prompt difficulty. Use log-objective weighting (1/p for pass rate p) to prioritize challenging examples, achieving 2x convergence speedup versus uniform…
Langue du texte source : anglais
Extract maximum value from limited reasoning traces by leveraging both successful and failed examples through REINFORCE-style distillation.
Langue du texte source : anglais
Train multimodal LLMs with RL (PIVOT) instead of SFT to produce stronger, precisely-localized visual representations in vision encoders using <1% of standard pretraining cost.
Langue du texte source : anglais
Add an intermediate RL stage between pretraining and post-training using dynamic token budgeting, curriculum sampling, and dual training. Trigger: reduce reasoning steps while maintaining or improving performance in post-training.
Langue du texte source : anglais
Apply reinforcement learning to pre-training by framing next-token prediction as a reasoning task with verifiable rewards, achieving superior scaling compared to standard language modeling.
Langue du texte source : anglais
Reduce inference cost by dynamically switching from large to small LLMs during reasoning generation. Large model handles demanding reasoning phases; small model completes consolidation and answer stages triggered by discourse cues. Achieves 2.2× speedup with…
Langue du texte source : anglais
Enable small language models to dynamically invoke larger models at critical reasoning tokens rather than offloading entire queries. RelayLLM achieves 49.52% accuracy across benchmarks while invoking the large model for only 1.07% of tokens—98.2% cost…
Langue du texte source : anglais
Detect and eliminate data contamination that invalidates RL benchmarks by measuring benchmark reconstruction ability. Implement clean evaluation datasets to distinguish genuine reasoning improvements from memorization. Use when validating RL training results…
Langue du texte source : anglais
Compressed historical latents with camera poses in KV cache (4× compression), extended teacher training (20-second sequences), and replayed back-propagation (block-wise differentiation) enabling real-time interactive video generation with long-range spatial…
Langue du texte source : anglais
Improve LLM reasoning by reweighting pre-training data during mid-training based on discrepancies between RL-tuned and base models, boosting reasoning performance without external teachers or extra data.
Langue du texte source : anglais