Train language models for formal theorem proving via expert iteration with verifier-guided self-correction and checkpoint merging.
لغة النص الأصلي: الإنجليزية
القائمة
Skills في هذا المستودع
جمع SkillsMP عدد ١٬٢٢٨ من skills من ADu2021/skillXiv. افتح أي skill لمراجعة مصدره وتفاصيله.
ADu2021/skillXivعرض ٤٠ من أصل ١٬٢٢٨ skills مجمعة.
Train language models for formal theorem proving via expert iteration with verifier-guided self-correction and checkpoint merging.
لغة النص الأصلي: الإنجليزية
Synthesize unlimited verifiable training tasks from unverifiable text by converting reasoning passages into multiple-choice problems. Creates higher-quality training data for RLHF systems without requiring new human labels.
لغة النص الأصلي: الإنجليزية
Separates generative policy optimization through latent encoder (standard RL algorithms) and conditional decoder (frozen then refined), using two-timescale alternating schedule to eliminate gradient instability from direct generative policy optimization.
لغة النص الأصلي: الإنجليزية
Balance LLM flexibility with domain rigor in scientific agents through dual-layer architecture. Enforce role-based access control and artifact-centric state management to prevent hallucinations, while preserving free-form reasoning for lower-risk tasks.
لغة النص الأصلي: الإنجليزية
Improve adaptive learning rates by clustering gradient statistics within layers and applying cluster-specific scaling.
لغة النص الأصلي: الإنجليزية
Compress long context into compact memory tokens via iterative gradient descent. Learn to write information into prefix memory without storing full KV-caches, enabling efficient long-context reasoning and retrieval.
لغة النص الأصلي: الإنجليزية
Unifies supervised fine-tuning and reinforcement learning through GRAO framework that combines multiple-output generation with group direct alignment loss for improved preference learning.
لغة النص الأصلي: الإنجليزية
Unify positional encoding methods via group action theory, encompassing RoPE and ALiBi as special cases. GRAPE enables exploration of cross-subspace feature coupling—ideal when you need principled positional encoding beyond standard implementations.
لغة النص الأصلي: الإنجليزية
Optimize test-time computation through graph-based collaborative architecture where nodes represent models, edges represent information flow, and topology itself is optimizable via reinforcement learning to discover ideal model assignments and configurations.
لغة النص الأصلي: الإنجليزية
Train robot controllers via five-stage curriculum progressing from base vision-language models to embodiment-specific RL-refined policies. Unified action space enables cross-embodiment transfer with minimal performance loss.
لغة النص الأصلي: الإنجليزية
Improve ranking quality via groupwise reranking with RL—process document groups jointly for within-group comparisons using GRPO with composite rewards (recall, ranking metrics, distribution alignment).
لغة النص الأصلي: الإنجليزية
Enables efficient MoE architectures through heterogeneous expert sizing and dynamic activation mechanisms that adjust parameter count based on input complexity.
لغة النص الأصلي: الإنجليزية
Build language models layer-by-layer on frozen embeddings, training new Transformer blocks sequentially while keeping lower layers frozen. Achieves 5% improvement over monolithic baselines on MMLU while fitting 740M trainable parameters per stage on single…
لغة النص الأصلي: الإنجليزية
Stabilize and accelerate chain-of-thought RL training by sampling multiple answers per generated thought. GRPO-MA reduces gradient noise and improves convergence across math, code, vision, and manipulation tasks while cutting computational cost versus naive…
لغة النص الأصلي: الإنجليزية
Eliminate expensive external teacher dependencies in VLM RL training via merged-checkpoint teachers. Uses TIES merging of historical RL checkpoints to create free, stable teacher models for step-level guidance—matching external teacher performance while…
لغة النص الأصلي: الإنجليزية
Recover fine details at soft boundaries (hair, fur) through depth refinement networks and view synthesis. Integrate plug-and-play with existing depth models via adaptive combination across monocular, stereo, and novel view tasks.
لغة النص الأصلي: الإنجليزية
Enable training and evaluation of desktop computer-using agents through 1.2M action steps across diverse Windows applications, covering GUI grounding, screen parsing, and action prediction with hybrid GUI+API action space reflecting modern agent designs.
لغة النص الأصلي: الإنجليزية
Enable GUI agents to ground actions without generating pixel coordinates by using attention-based patch-level alignment and a verifier for selecting optimal action regions from candidates.
لغة النص الأصلي: الإنجليزية
Improve GUI agent planning and action grounding through test-time scaling and reinforcement learning. Sample and evaluate multiple action candidates, then use RL to precisely target visual interface elements.
لغة النص الأصلي: الإنجليزية
Implement techniques from Guidelines to Prompt Large Language Models for Code Generation: An Empirical Characterization. Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation
لغة النص الأصلي: الإنجليزية
Eliminate fixed tokenization by learning data-dependent segmentation jointly with the model through dynamic chunking, matching BPE-tokenized Transformers at equivalent compute while showing improved robustness and better downstream task performance without…
لغة النص الأصلي: الإنجليزية
Generate comprehensive test cases for code problems that reliably detect wrong solutions through LLM-based edge case synthesis and test quality ranking.
لغة النص الأصلي: الإنجليزية
Evaluate LLM-based document rerankers using hardware-agnostic FLOPs metrics instead of latency, enabling fair comparison of ranking quality per unit of computation across different models and deployment scenarios.
لغة النص الأصلي: الإنجليزية
Multi-agent framework that balances safety compliance with task completion through adaptive policy extraction and dual-objective optimization. Achieves 38% improvement in policy compliance while maintaining 20% higher task completion.
لغة النص الأصلي: الإنجليزية
Compute step-level credit assignments via hindsight generative verification: condition the LLM on successful outcomes to compute importance ratios that filter credit by causal relevance. Synergizes macro stability with micro precision.
لغة النص الأصلي: الإنجليزية
Use KV cache as hierarchical memory for real-time video stream understanding with minimal GPU overhead, achieving 10x faster response times compared to standard methods. Use when processing continuous video streams where latency and memory efficiency are…
لغة النص الأصلي: الإنجليزية
Scale disaggregated LLM inference (prefill-decode) via topology-aware scheduling and metric-driven policies, achieving 26.6% GPU utilization improvement and conserving hundreds of thousands GPU-hours daily
لغة النص الأصلي: الإنجليزية
Reason about long-horizon dynamics by disentangling structure and motion in video VAE latents. Learn continuous latent motion chains that preserve temporal coherence while predicting terminal keyframes, enabling efficient reasoning about multi-step scenarios.
لغة النص الأصلي: الإنجليزية
Optimize only high-entropy tokens during RL training to achieve better reasoning performance with 80% fewer gradient updates.
لغة النص الأصلي: الإنجليزية
Enable data-dependent higher-order interactions in attention using prefix-sufficient statistics that maintain linear time and constant state, replacing quadratic dot-product attention while preserving expressivity through compact matrix operations.
لغة النص الأصلي: الإنجليزية
Solves long-horizon planning problems with global constraints by decoupling planning into strategic (resource allocation) and tactical (execution) levels. Prevents constraint drift through synchronized state tracking and cooperative bargaining.
لغة النص الأصلي: الإنجليزية
Novel error categorization framework examining failures across hops (diversity), coverage, and overthinking. Combines human annotation with automated metrics to diagnose why reasoning models hallucinate on multi-step tasks.
لغة النص الأصلي: الإنجليزية
A VLM-based preference scoring system trained on 1.17M annotated comparisons to evaluate text-to-image generation quality at scale. Uses uncertainty-aware ranking loss for fine-grained assessment across diverse images and supports iterative quality…
لغة النص الأصلي: الإنجليزية
Improve multimodal reasoning by requiring explicit context understanding before reasoning. Use specialized reward mechanisms and context-aware training to prevent information-skipping shortcuts.
لغة النص الأصلي: الإنجليزية
Design hybrid architectures mixing linear and full attention at optimal ratios. Superior standalone linear models don't necessarily excel in hybrids; recall improves significantly with more full attention layers at ratios below 3:1, enabling efficient…
لغة النص الأصلي: الإنجليزية
Combine sparse verifier rewards with dense reward model scores using stratified normalization to overcome limitations of either approach alone.
لغة النص الأصلي: الإنجليزية
Enable AI systems to recursively improve themselves by making the meta-level modification procedure itself editable, achieving open-ended capability growth.
لغة النص الأصلي: الإنجليزية
Build hypergraph-structured memory systems for multi-step RAG that capture high-order relationships between facts, enabling stronger reasoning across long contexts. Use when combining multiple retrieved documents in complex reasoning chains that require…
لغة النص الأصلي: الإنجليزية
Improve LLM reasoning through iterative refinement where the model refines its best previous attempts. Two-stage training: exploratory draft generation, then conditioned refinement using GRPO. Dynamic conditioning signals evolve with policy, enabling…
لغة النص الأصلي: الإنجليزية
Enable robust image editing by decomposing free-form instructions into sequential atomic operations executed through a neural program interpreter.
لغة النص الأصلي: الإنجليزية