Improve LLM performance at test time through in-context learning and experience libraries, eliminating the need for parameter updates while maintaining competitive results.
Idioma del texto original: inglés
Menú
Skills en este repositorio
SkillsMP ha recopilado 1228 skills de ADu2021/skillXiv. Abre una skill para revisar su origen y sus detalles.
ADu2021/skillXivMostrando 40 de 1228 skills recopiladas.
Improve LLM performance at test time through in-context learning and experience libraries, eliminating the need for parameter updates while maintaining competitive results.
Idioma del texto original: inglés
Improve LLM outputs without parameter updates using learned token priors that guide inference. Trigger: optimize agent behavior in deployment without model retraining or fine-tuning.
Idioma del texto original: inglés
Infer complete object structure despite occlusion using multi-camera video. Enables training models to predict hidden object appearance by combining temporal and spatial context from multiple viewpoints.
Idioma del texto original: inglés
Select best reasoning trajectories from multiple samples using step-level scoring from a 0.6B lightweight verifier that exploits hidden states, outperforming external reward models by 4-12% without massive annotations.
Idioma del texto original: inglés
Bridge labeled and unlabeled data through trajectory similarity in reinforcement learning. Select reliable unlabeled samples by comparing pass-rate evolution trajectories against labeled data. Achieve 42.6% accuracy with 1K labeled + 3K unlabeled samples,…
Idioma del texto original: inglés
Train LLM agents via tree-search rollout sampling and step-wise advantage estimation. Achieve 1.5x more rollouts within fixed token budgets and implicit step-level preference learning through dual-level advantage computation on tree structures.
Idioma del texto original: inglés
Scale GUI automation by organizing trajectories into tree structures for reuse and branching exploration, reducing data cost while maximizing step-level diversity through adaptive topology.
Idioma del texto original: inglés
Achieve 2.4× faster RL training for diffusion models by restructuring denoising as tree search with shared computation. TreeGRPO computes fine-grained step advantages instead of trajectory-level rewards—crucial for efficient diffusion model optimization.
Idioma del texto original: inglés
Train vision-language models to produce visually grounded reasoning by enforcing traceable evidence via bounding box localization, using a novel benchmark (TreeBench) and RL-based training with dual IoU rewards for both recall and precision.
Idioma del texto original: inglés
T-PPO improves training efficiency via truncated rollouts and extended GAE, enabling batch continuity without waiting for full sequence completion.
Idioma del texto original: inglés
Improve credit assignment in retrieval-augmented reasoning by truncating trajectories at single decision points. Generate k samples sharing a common prefix, differing only at the next step to isolate variation and reduce gradient variance by T-fold on T-step…
Idioma del texto original: inglés
Convert natural language to SQL for unknown database schemas by formulating the task as a partially observable MDP. Use dual-track GRPO (token-level masked advantages) to learn schema discovery and query generation jointly.
Idioma del texto original: inglés
Train LLMs to reduce hallucinations by 28.9% using a ternary reward scheme that explicitly incentivizes abstention (+0) over false claims (-1) while rewarding correct answers (+1). Apply when improving factual reliability is critical and verification signals…
Idioma del texto original: inglés
Reduce LLM hallucinations by training with a ternary reward signal that distinguishes correct answers, hallucinations, and abstentions. This technique incentivizes truthfulness over accuracy-only metrics, enabling safer, more calibrated language models…
Idioma del texto original: inglés
Improve model performance at test time by dynamically synthesizing curriculum of problem variants. Co-evolving synthesizer and solver agents create reinforcing feedback for continuous improvement without external labels.
Idioma del texto original: inglés
Adapt vision-language models at test time without labels by extracting implicit reward signals (prediction frequency and entropy) and optimizing via GRPO.
Idioma del texto original: inglés
Enable long-context modeling via test-time training with meta-learning. Inner loop continues training on context, compressing information into weights rather than KV cache, outer loop optimizes initialization—maintaining full-attention quality with RNN-like…
Idioma del texto original: inglés
Cascaded VAE+SigLIP encoders creating single continuous representation space supporting both vision understanding and generation, trained jointly on both tasks without format mismatches. Deploy for unified multimodal models where understanding and generation…
Idioma del texto original: inglés
Achieve 100-200× video generation speedup via algorithm-system co-optimization. Combines sparse attention acceleration (SageAttention + trainable Sparse-Linear Attention), step distillation, W8A8 quantization, and custom CUDA kernels—maintaining quality…
Idioma del texto original: inglés
Stabilize multi-turn agent RL by shifting from token-level to turn-level MDPs. Reformulates states and actions at conversation-turn granularity, uses learned turn-level critics, and applies Generalized Advantage Estimation—eliminating misalignment that…
Idioma del texto original: inglés
Mixture-of-Transformers jointly learning language modeling and video flow matching, enabling interleaved text-video generation where semantic decisions happen in language, pixel generation in video, and users can intervene textually at any step.
Idioma del texto original: inglés
Implement techniques from TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformers. The fundamental premise of Vision-Language-Action (VLA) models is to harness the extensive general capabilities of…
Idioma del texto original: inglés
Train single-step image generators without teacher models or standard adversarial networks. Achieves 0.83 GenEval score at 1-NFE with 100× computational efficiency gains—when you need real-time image synthesis from pre-trained diffusion models.
Idioma del texto original: inglés
Reduce GRPO training cost by 87.5% using only 2 rollouts instead of 16 while achieving 98.1% of baseline performance. Leverage the insight that GRPO's group mechanism serves contrastive learning rather than advantage estimation.
Idioma del texto original: inglés
Document extraction is a core component of digital workflows, yet existing vision-language models (VLMs) predominantly favor high-resource languages. Thai presents additional challenges due to script complexity from non-latin letters, the absence of explicit…
Idioma del texto original: inglés
Research contribution advancing agent and reasoning capabilities through novel approaches to model development, training, and evaluation.
Idioma del texto original: inglés
Scale memory networks to 120B parameters with improved long-context learning through integrated memory layers, simplified value projection, and optimized parameter ratios for superior memory-intensive tasks.
Idioma del texto original: inglés
Transform uncertainty quantification in LLMs from passive reliability measurement into active control signals for reasoning optimization, autonomous agent decision-making, and reinforcement learning. Use when building systems where uncertainty drives…
Idioma del texto original: inglés
Compress visual embeddings into compact latent space for unified image understanding and generation. Combines attention-based compression with diffusion decoding to bridge comprehension and generation through a shared semantic bottleneck.
Idioma del texto original: inglés
Advanced computer vision technique for robust spatial understanding in complex scenes, supporting agent navigation and environmental reasoning capabilities.
Idioma del texto original: inglés
Advanced reasoning approach for optimizing inference efficiency through meta-cognitive planning, enabling agents to make better decisions with reduced computational overhead.
Idioma del texto original: inglés
Single cloud-side weight-sorting and fine-tuning supporting multiple on-device pruning rates via efficient SVD and MLP decomposition, achieving 4-5.7× memory reduction and 2.7-3.4× throughput across Transformers, SSMs, and hybrid architectures.
Idioma del texto original: inglés
Improves LLM reasoning by rewarding correct solutions that exhibit rare high-level strategies, preventing exploration collapse and discovering more diverse solution approaches across mathematics, physics, and medical reasoning.
Idioma del texto original: inglés
Enhance Universal Transformers for complex reasoning through ConvSwiGLU modules integrating depthwise convolution into feed-forward blocks and truncated backpropagation through loops (TBPTL) restricting gradient computation to final iterations. Achieve…
Idioma del texto original: inglés
Combine semantic encoders from multimodal LLMs with contrastive learning to create unified high-resolution encoders for both visual understanding and generation tasks without relying on VAE compression.
Idioma del texto original: inglés
Learn which tokens to unmask during diffusion sampling via reinforcement learning instead of heuristics. Policies eliminate manual tuning and scale across block sizes—crucial when semi-autoregressive generation needs dynamic, learned unmasking strategies.
Idioma del texto original: inglés
Scale computer-use agents from 30% to 72% success rate by generating parallel rollouts and selecting best trajectories through behavior narrative evaluation. Use when deploying desktop agents on complex, high-variance task scenarios.
Idioma del texto original: inglés
Unified MLLM processing four urban data types simultaneously: geospatial structures, trajectory information, satellite imagery, and street-view photos. Outperforms general-purpose models on 12-task urban benchmark with 31-375% improvements. Use for urban…
Idioma del texto original: inglés
Enable vision-centric interactive reasoning by synthesizing diverse reasoning datasets through co-evolutionary loops, then training models with progressive curriculum that starts with perception and advances to tool-based problem solving.
Idioma del texto original: inglés
Align autoregressive image models with pixel-space quality via variational optimization. Formulates alignment as ELBO combining reconstruction (pixel supervision) and prior regularization (token distribution), treating model as RL policy with tokenizer…
Idioma del texto original: inglés