Improve LLM performance at test time through in-context learning and experience libraries, eliminating the need for parameter updates while maintaining competitive results.
Langue du texte source : anglais
Menu
Skills dans ce dépôt
SkillsMP a collecté 1 228 skills depuis ADu2021/skillXiv. Ouvrez un skill pour examiner sa source et ses détails.
ADu2021/skillXivAffichage de 40 skills collectés sur 1 228.
Improve LLM performance at test time through in-context learning and experience libraries, eliminating the need for parameter updates while maintaining competitive results.
Langue du texte source : anglais
Improve LLM outputs without parameter updates using learned token priors that guide inference. Trigger: optimize agent behavior in deployment without model retraining or fine-tuning.
Langue du texte source : anglais
Infer complete object structure despite occlusion using multi-camera video. Enables training models to predict hidden object appearance by combining temporal and spatial context from multiple viewpoints.
Langue du texte source : anglais
Select best reasoning trajectories from multiple samples using step-level scoring from a 0.6B lightweight verifier that exploits hidden states, outperforming external reward models by 4-12% without massive annotations.
Langue du texte source : anglais
Bridge labeled and unlabeled data through trajectory similarity in reinforcement learning. Select reliable unlabeled samples by comparing pass-rate evolution trajectories against labeled data. Achieve 42.6% accuracy with 1K labeled + 3K unlabeled samples,…
Langue du texte source : anglais
Train LLM agents via tree-search rollout sampling and step-wise advantage estimation. Achieve 1.5x more rollouts within fixed token budgets and implicit step-level preference learning through dual-level advantage computation on tree structures.
Langue du texte source : anglais
Scale GUI automation by organizing trajectories into tree structures for reuse and branching exploration, reducing data cost while maximizing step-level diversity through adaptive topology.
Langue du texte source : anglais
Achieve 2.4× faster RL training for diffusion models by restructuring denoising as tree search with shared computation. TreeGRPO computes fine-grained step advantages instead of trajectory-level rewards—crucial for efficient diffusion model optimization.
Langue du texte source : anglais
Train vision-language models to produce visually grounded reasoning by enforcing traceable evidence via bounding box localization, using a novel benchmark (TreeBench) and RL-based training with dual IoU rewards for both recall and precision.
Langue du texte source : anglais
T-PPO improves training efficiency via truncated rollouts and extended GAE, enabling batch continuity without waiting for full sequence completion.
Langue du texte source : anglais
Improve credit assignment in retrieval-augmented reasoning by truncating trajectories at single decision points. Generate k samples sharing a common prefix, differing only at the next step to isolate variation and reduce gradient variance by T-fold on T-step…
Langue du texte source : anglais
Convert natural language to SQL for unknown database schemas by formulating the task as a partially observable MDP. Use dual-track GRPO (token-level masked advantages) to learn schema discovery and query generation jointly.
Langue du texte source : anglais
Train LLMs to reduce hallucinations by 28.9% using a ternary reward scheme that explicitly incentivizes abstention (+0) over false claims (-1) while rewarding correct answers (+1). Apply when improving factual reliability is critical and verification signals…
Langue du texte source : anglais
Reduce LLM hallucinations by training with a ternary reward signal that distinguishes correct answers, hallucinations, and abstentions. This technique incentivizes truthfulness over accuracy-only metrics, enabling safer, more calibrated language models…
Langue du texte source : anglais
Improve model performance at test time by dynamically synthesizing curriculum of problem variants. Co-evolving synthesizer and solver agents create reinforcing feedback for continuous improvement without external labels.
Langue du texte source : anglais
Adapt vision-language models at test time without labels by extracting implicit reward signals (prediction frequency and entropy) and optimizing via GRPO.
Langue du texte source : anglais
Enable long-context modeling via test-time training with meta-learning. Inner loop continues training on context, compressing information into weights rather than KV cache, outer loop optimizes initialization—maintaining full-attention quality with RNN-like…
Langue du texte source : anglais
Cascaded VAE+SigLIP encoders creating single continuous representation space supporting both vision understanding and generation, trained jointly on both tasks without format mismatches. Deploy for unified multimodal models where understanding and generation…
Langue du texte source : anglais
Achieve 100-200× video generation speedup via algorithm-system co-optimization. Combines sparse attention acceleration (SageAttention + trainable Sparse-Linear Attention), step distillation, W8A8 quantization, and custom CUDA kernels—maintaining quality…
Langue du texte source : anglais
Stabilize multi-turn agent RL by shifting from token-level to turn-level MDPs. Reformulates states and actions at conversation-turn granularity, uses learned turn-level critics, and applies Generalized Advantage Estimation—eliminating misalignment that…
Langue du texte source : anglais
Mixture-of-Transformers jointly learning language modeling and video flow matching, enabling interleaved text-video generation where semantic decisions happen in language, pixel generation in video, and users can intervene textually at any step.
Langue du texte source : anglais
Implement techniques from TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformers. The fundamental premise of Vision-Language-Action (VLA) models is to harness the extensive general capabilities of…
Langue du texte source : anglais
Train single-step image generators without teacher models or standard adversarial networks. Achieves 0.83 GenEval score at 1-NFE with 100× computational efficiency gains—when you need real-time image synthesis from pre-trained diffusion models.
Langue du texte source : anglais
Reduce GRPO training cost by 87.5% using only 2 rollouts instead of 16 while achieving 98.1% of baseline performance. Leverage the insight that GRPO's group mechanism serves contrastive learning rather than advantage estimation.
Langue du texte source : anglais
Document extraction is a core component of digital workflows, yet existing vision-language models (VLMs) predominantly favor high-resource languages. Thai presents additional challenges due to script complexity from non-latin letters, the absence of explicit…
Langue du texte source : anglais
Research contribution advancing agent and reasoning capabilities through novel approaches to model development, training, and evaluation.
Langue du texte source : anglais
Scale memory networks to 120B parameters with improved long-context learning through integrated memory layers, simplified value projection, and optimized parameter ratios for superior memory-intensive tasks.
Langue du texte source : anglais
Transform uncertainty quantification in LLMs from passive reliability measurement into active control signals for reasoning optimization, autonomous agent decision-making, and reinforcement learning. Use when building systems where uncertainty drives…
Langue du texte source : anglais
Compress visual embeddings into compact latent space for unified image understanding and generation. Combines attention-based compression with diffusion decoding to bridge comprehension and generation through a shared semantic bottleneck.
Langue du texte source : anglais
Advanced computer vision technique for robust spatial understanding in complex scenes, supporting agent navigation and environmental reasoning capabilities.
Langue du texte source : anglais
Advanced reasoning approach for optimizing inference efficiency through meta-cognitive planning, enabling agents to make better decisions with reduced computational overhead.
Langue du texte source : anglais
Single cloud-side weight-sorting and fine-tuning supporting multiple on-device pruning rates via efficient SVD and MLP decomposition, achieving 4-5.7× memory reduction and 2.7-3.4× throughput across Transformers, SSMs, and hybrid architectures.
Langue du texte source : anglais
Improves LLM reasoning by rewarding correct solutions that exhibit rare high-level strategies, preventing exploration collapse and discovering more diverse solution approaches across mathematics, physics, and medical reasoning.
Langue du texte source : anglais
Enhance Universal Transformers for complex reasoning through ConvSwiGLU modules integrating depthwise convolution into feed-forward blocks and truncated backpropagation through loops (TBPTL) restricting gradient computation to final iterations. Achieve…
Langue du texte source : anglais
Combine semantic encoders from multimodal LLMs with contrastive learning to create unified high-resolution encoders for both visual understanding and generation tasks without relying on VAE compression.
Langue du texte source : anglais
Learn which tokens to unmask during diffusion sampling via reinforcement learning instead of heuristics. Policies eliminate manual tuning and scale across block sizes—crucial when semi-autoregressive generation needs dynamic, learned unmasking strategies.
Langue du texte source : anglais
Scale computer-use agents from 30% to 72% success rate by generating parallel rollouts and selecting best trajectories through behavior narrative evaluation. Use when deploying desktop agents on complex, high-variance task scenarios.
Langue du texte source : anglais
Unified MLLM processing four urban data types simultaneously: geospatial structures, trajectory information, satellite imagery, and street-view photos. Outperforms general-purpose models on 12-task urban benchmark with 31-375% improvements. Use for urban…
Langue du texte source : anglais
Enable vision-centric interactive reasoning by synthesizing diverse reasoning datasets through co-evolutionary loops, then training models with progressive curriculum that starts with perception and advances to tool-based problem solving.
Langue du texte source : anglais
Align autoregressive image models with pixel-space quality via variational optimization. Formulates alignment as ELBO combining reconstruction (pixel supervision) and prior regularization (token distribution), treating model as RL policy with tokenizer…
Langue du texte source : anglais