Bridge image understanding-generation gap via In-Context Chain-of-Thought reasoning and RL training with surrogate rewards. Improve faithful execution of mixed image-text prompts in generation and editing tasks.
原文语言:英语
菜单
这个仓库中的 skills
SkillsMP 已收集 ADu2021/skillXiv 中的 1,228 个 Skill。打开任一 Skill 可查看来源和详情。
ADu2021/skillXiv已展示 40 / 1,228 个已收集 Skill。
Bridge image understanding-generation gap via In-Context Chain-of-Thought reasoning and RL training with surrogate rewards. Improve faithful execution of mixed image-text prompts in generation and editing tasks.
原文语言:英语
Restructure latent representations in pretrained audio autoencoders without full retraining. Apply three variants—ordered, semantic, and equivariant—to enforce structure like channel ordering, semantic alignment, or filter correspondence. Achieves 20-60%…
原文语言:英语
Compress search trajectories into structured states capturing partial answers, evidence, and uncertainties. Recursive execution leverages compressed states to avoid redundant exploration, improving resource efficiency by 50%.
原文语言:英语
Implements RealMem from arXiv:2601.06966
原文语言:英语
Enhances passage ranking through reasoning capabilities via synthesized training data and multi-stage training combining supervised fine-tuning with reinforcement learning for improved ranking accuracy.
原文语言:英语
Enable image generators to reason explicitly through text before creating images using supervised fine-tuning and reinforcement learning optimization.
原文语言:英语
Optimize chain-of-thought reasoning under computational budgets using information-theoretic compression principles, improving reasoning efficiency without accuracy loss.
原文语言:英语
Reasoning Core procedurally generates verifiable symbolic reasoning datasets across formal domains (planning, logic, parsing), with external solvers and curriculum control.
原文语言:英语
Create infinite training environments for reasoning with automatic verification using procedural generation and domain-specific evaluators.
原文语言:英语
Large language models have achieved remarkable capabilities across domains, yet mechanisms underlying sophisticated reasoning remain elusive. Recent reasoning models outperform comparable instruction-tuned models on complex cognitive tasks, attributed to…
原文语言:英语
Overcome token-level randomness limitations in RL by shifting exploration to latent reasoning strategies. Train a VAE encoding diverse reasoning patterns, sample latents during RL, decode to prefix embeddings steering internal reasoning—enabling structured…
原文语言:英语
Reduce LLM sampling costs by 50% while maintaining reasoning performance through Reasoning Path Confidence (RPC), which combines perplexity-guided pruning with self-consistency sampling.
原文语言:英语
Extract and transfer reasoning capabilities between language models using task vectors derived from supervised fine-tuning and reinforcement learning weight differences. Apply reasoning vectors via simple arithmetic to enhance any compatible instruction-tuned…
原文语言:英语
Improves base model reasoning through iterative sampling without training or fine-tuning. Uses MCMC-inspired sampling to extract latent reasoning from pretrained models, achieving RL-comparable gains on math, coding, and QA tasks while preserving diversity.
原文语言:英语
Diagnose and correct reasoning inefficiencies (overthinking and underthinking) in large reasoning models using confidence-based steering vectors, without retraining. Enables optimal reasoning budgets across model scales.
原文语言:英语
Implement techniques from RebuttalAgent: Strategic Persuasion in Academic Rebuttal via Theory of Mind. Although artificial intelligence (AI) has become deeply integrated into various stages of the research workflow and achieved remarkable advancements,…
原文语言:英语
Prevents catastrophic forgetting in continual learning by merging models using layer-wise hidden representations as similarity proxies. Shallow layers preserve domain-general features while deep layers enable task-specific adaptation, enabling seamless…
原文语言:英语
Unifies planning and action by treating plans as abstract placeholder functions recursively decomposed to primitive actions. Enables agents to dynamically adjust abstraction levels per task without rigid hierarchies. Improves inference performance and…
原文语言:英语
Build self-evolving multi-agent browser systems that combine web reconnaissance with dynamic tool generation and execution. Enables autonomous agents to analyze failed trajectories, generate specialized tools on-the-fly, and adapt to novel web environments…
原文语言:英语
Enable efficient long-sequence generation by combining block-sparse attention with periodic dense rectification to bound error accumulation.
原文语言:英语
Extend neural network reasoning capabilities through recurrence (repeated computation cycles), external memory (intermediate state storage), and test-time compute scaling for multi-step reasoning.
原文语言:英语
Enable test-time compute scaling in vision-language-action models via weight-tied recurrent inference within latent space, with adaptive stopping based on action divergence.
原文语言:英语
Process prompts exceeding model context windows by recursively decomposing long inputs into manageable chunks and calling the model recursively on snippets—enabling inference on contexts 100x longer than native window while maintaining quality and improving…
原文语言:英语
Recursive Think-Answer Process enables models to iteratively refine reasoning and answers during inference, reducing self-correction errors and improving accuracy without retraining.
原文语言:英语
Comprehensive evaluation dataset for systematic vulnerability testing of language models, enabling identification and mitigation of failure modes before agent deployment.
原文语言:英语
Train language models for multi-step information-seeking using dual-constrained task synthesis and cost-efficient staged learning. Generate complex queries by controlling topological complexity and information dispersion, then train atomic reasoning skills…
原文语言:英语
Trains LLMs to autonomously debug and improve code through structured RL-optimized reflection cycles. Internalizes debugging process into model weights rather than relying on external oracles or expensive iterative prompting.
原文语言:英语
Identify and patch critical safety vulnerabilities in large reasoning models. Via linear probing and causal intervention, locate specific attention heads responsible for alignment degradation at final tokens. Recover safety via 'Cliff-as-a-Judge' data…
原文语言:英语
ReGFT pre-trains models on hybrid reference-augmented trajectories before RL, enabling them to solve harder problems and accelerate convergence.
原文语言:英语
Merge softmax and linear attention for video diffusion models using chunk-wise recurrent reformulation with constant memory usage. Enable efficient distillation from existing softmax models, reducing training cost two orders of magnitude to ~160 GPU hours.
原文语言:英语
Recover learning signals in RL for LLM reasoning by dynamically allocating sampling budget based on prompt difficulty. Use log-objective weighting (1/p for pass rate p) to prioritize challenging examples, achieving 2x convergence speedup versus uniform…
原文语言:英语
Extract maximum value from limited reasoning traces by leveraging both successful and failed examples through REINFORCE-style distillation.
原文语言:英语
Train multimodal LLMs with RL (PIVOT) instead of SFT to produce stronger, precisely-localized visual representations in vision encoders using <1% of standard pretraining cost.
原文语言:英语
Add an intermediate RL stage between pretraining and post-training using dynamic token budgeting, curriculum sampling, and dual training. Trigger: reduce reasoning steps while maintaining or improving performance in post-training.
原文语言:英语
Apply reinforcement learning to pre-training by framing next-token prediction as a reasoning task with verifiable rewards, achieving superior scaling compared to standard language modeling.
原文语言:英语
Reduce inference cost by dynamically switching from large to small LLMs during reasoning generation. Large model handles demanding reasoning phases; small model completes consolidation and answer stages triggered by discourse cues. Achieves 2.2× speedup with…
原文语言:英语
Enable small language models to dynamically invoke larger models at critical reasoning tokens rather than offloading entire queries. RelayLLM achieves 49.52% accuracy across benchmarks while invoking the large model for only 1.07% of tokens—98.2% cost…
原文语言:英语
Detect and eliminate data contamination that invalidates RL benchmarks by measuring benchmark reconstruction ability. Implement clean evaluation datasets to distinguish genuine reasoning improvements from memorization. Use when validating RL training results…
原文语言:英语
Compressed historical latents with camera poses in KV cache (4× compression), extended teacher training (20-second sequences), and replayed back-propagation (block-wise differentiation) enabling real-time interactive video generation with long-range spatial…
原文语言:英语
Improve LLM reasoning by reweighting pre-training data during mid-training based on discrepancies between RL-tuned and base models, boosting reasoning performance without external teachers or extra data.
原文语言:英语