ADu2021/skillXiv - Page 12

flare-fast-low-rank-attention

Implement low-rank attention routing using encode-decode factorization to achieve linear-time complexity on long sequences while maintaining compatibility with optimized attention kernels.

flash-prefill

Accelerates long-context LLM prefilling by identifying sparse attention patterns without expensive scoring, using block-level approximations and dynamic thresholding. Achieves 27.78x speedup at 256K tokens while maintaining accuracy.

flash-sampling-efficient-decoding

Fuse categorical sampling directly into LM-head matrix multiplication to eliminate logits materialization. Use Gumbel noise during computation and hierarchical reduction to achieve 19% token-level latency reduction.

flash-searcher-dag-parallel-agents

Reduce agent execution steps by 35% and latency by parallelizing sequential tool calls through task dependency graphs (DAGs). Use when deploying information-retrieval agents where tool execution ordering is flexible.

flex-continuous-agent-evolution

Enable LLM agents to improve continuously during deployment by constructing structured experience libraries through self-reflection on successes and failures—achieving 23% improvement on reasoning without gradient-based parameter updates or external training.

flexibility-trap-diffusion-reasoning

Understand how token generation flexibility in diffusion LMs paradoxically constrains reasoning, as models exploit ordering flexibility to avoid uncertain tokens, and apply simplified approaches that preserve parallel decoding benefits. Use when optimizing…

flexible-data-mixture-of-experts

Train language models where each expert learns independently on closed datasets, enabling flexible inference with selective data inclusion or exclusion. 41% performance improvement while allowing users to opt out of specific data sources without retraining.

flow-map-trajectory-tilting

Uses flow maps as look-ahead operators to enable principled reward-guided diffusion by predicting trajectory endpoints at any denoising step. Deploy when applying rewards or preferences to diffusion trajectories with meaningful gradients throughout generation.

flowblending-video-inference

Accelerate video generation by allocating smaller models to intermediate diffusion timesteps and larger models to capacity-critical early and late stages. Achieves 1.65x speedup and 57% FLOP reduction while maintaining visual quality. Use when video…

flowprefill-scheduling-preemption

Improve LLM serving under mixed workloads by decoupling execution granularity from scheduling frequency. Operator-level preemption allows fine-grained interruption at natural boundaries (attention, feed-forward layers) without efficiency loss. Event-driven…

flowrl-reward-distribution-matching

Train LLMs with distribution-matching rewards instead of reward maximization to achieve 10% improvement on math reasoning while improving solution diversity by matching the full reward distribution via flow balancing, addressing mode collapse in long…

focus-agent-context-trimming

Use a lightweight LLM to filter accessibility tree observations by task relevance, reducing agent context size by 50-80% while maintaining equivalent task performance.

focus-agent-context-trimming-web-agents

Reduce web agent context size by 51% while maintaining task performance using lightweight LLM retrieval to extract relevant accessibility tree lines. Task-guided filtering removes irrelevant elements, improving inference cost and security by neutralizing…

focused-chain-of-thought

Training-free prompting strategy that pre-organizes query information into compact structured format, reducing generation tokens by 2-3× while maintaining reasoning accuracy. Apply when reasoning performance is bottlenecked by verbose input formatting.

foreagent-predict-execute

Replace expensive test-based execution loops with learned prediction models that forecast agent action outcomes before commitment. Framework uses internalized execution priors and structured analysis reports to achieve 6x faster convergence and 6% higher…

formal-uncertainty-llm-reasoning

Predict when LLM outputs are trustworthy for formal reasoning by analyzing domain-specific uncertainty signals.

fourier-approximated-kv-cache

Training-free framework compressing KV caches using Fourier basis functions, exploiting heterogeneous transformer head roles for memory-efficient long-context LLMs.

fp32-reproducible-llm-inference

Diagnose and solve LLM reproducibility failures caused by floating-point precision across hardware configurations using LayerCast optimization for deterministic inference with minimal memory overhead.

freelong-plus-plus-long-video-generation

Extend video diffusion models to generate 4-8× longer sequences without retraining. Uses frequency-aware attention to blend local detail preservation with global consistency, identifying and fixing high-frequency distortion in extended videos.

freemorph-tuning-free-image-morphing

Generate smooth morphing sequences between images without fine-tuning or alignment. Uses guidance-aware spherical interpolation and step-oriented attention blending to handle diverse semantic and layout scenarios, completing morphs 50× faster than fine-tuning…

frugal-reasoning-short-math-solutions

Achieve emergent brevity in reasoning by retaining and up-weighting easy problems during RL training, implicitly regularizing solution length without explicit penalties while maintaining accuracy on hard problems.

fs-researcher-scaling

Scale research agent capability using persistent filesystem as external memory. Dual-agent architecture with context builder accumulating knowledge and report writer composing outputs enables computation scaling beyond context windows.

fuselip-multimodal-embeddings

Build unified multimodal embeddings with a single transformer encoder processing image and text tokens together, improving performance on structure-aware tasks through early fusion.

fusionroute-token-llm-collaboration

Combine multiple specialized language models at token-level granularity without joint training or architectural compatibility. FusionRoute performs expert selection and generates complementary logits to overcome routing limitations, achieving superior…

g2rl-gradient-guided

Guide LLM exploration through the model's own gradient geometry rather than external signals. Extract sequence-level gradient features measuring how tokens would reshape output distributions. Reward responses introducing novel gradient directions while…

gain-rl-angle-concentration

Improve RL training efficiency by 2.5× using angle concentration between token hidden states as a cost-effective data scheduling signal, selecting high-gradient samples dynamically.

gametalk-training-llms-for-strategic-conversation

Implement techniques from GameTalk: Training LLMs for Strategic Conversation. Strategic decision-making in multi-agent settings is a key challenge for large language models (LLMs), particularly when coordination and negotiation must unfold over extended…

gdpo-multi-reward-optimization

Optimize language models against multiple reward signals simultaneously by decoupling reward normalization. GDPO prevents reward combination collapse that undermines training signal quality when aligning models to multiple human preferences like accuracy,…

gem-agentic-llm-environment

A standardized environment framework for training and evaluating LLM agents, providing 24+ tasks with asynchronous vectorized execution, extensible wrappers, and integration examples for five RL frameworks. Enables reproducible agent research and training at…

gen3r-3d-scene-generation-meets-feed-forward-recon

Generative approach for creating complex dynamic scenes and content, supporting agent capabilities in understanding and reasoning about multi-agent environments.

general-agentic-memory-jit

Build persistent, lossless agent memory using just-in-time compilation: store complete history in a universal page-store while performing dynamic deep research at query time, enabling test-time scalability through iterative information synthesis and…

genie-envisioner-robotic-foundation

Unified platform combining instruction-conditioned video diffusion, flow-matching action decoder, and action-conditioned simulator. Enables scalable robot learning without extensive labeled demonstrations.

geometry-forcing-video-diffusion-3d

Improve video diffusion consistency by aligning intermediate diffusion features with 3D geometric representations from pretrained foundation models, enabling spatially coherent and temporally stable video generation through angular and scale alignment losses.

geometry-grounded-vlm

Extend vision-language models with 3D spatial understanding by adding geometric expert stream alongside semantic expert: predict pixel-aligned 3D point maps, surface normals, and camera poses from 2D images, enabling unified reasoning across 2D semantic and…

gere-continual-learning

Prevents catastrophic forgetting in continual LLM learning using threshold-based margin loss with fixed general replay samples from pretraining data.

gigaevo-llm-evolution

Evolve Python algorithms and programs using LLMs as mutation operators combined with MAP-Elites quality-diversity search, achieving competitive results on geometric optimization and algorithmic problems by iteratively mutating code informed by historical…

gimbaldiffusion-camera-control

Control video camera motion using gravity-aligned absolute coordinates instead of relative trajectories. GimbalDiffusion enables precise camera control with null-pitch conditioning—ideal when you need interpretable, physics-aware camera motion in…

glance-phase-aware-acceleration

Phase-aware acceleration using two lightweight LoRA adapters (Slow-LoRA for semantic reconstruction, Fast-LoRA for texture refinement) trained on a single image in one GPU hour, achieving 5× speedup via smart per-phase acceleration rather than uniform speedup.

glm-multimodal-reasoning

Train vision-language models with curriculum-based reinforcement learning (RLCS) to improve reasoning across diverse multimodal tasks. Dynamically adjust training difficulty to model capability, preventing both trivial and overly-hard examples.

gnosis-llm-self-awareness

Enable frozen LLMs to predict their own correctness by decoding signals from internal hidden states and attention patterns, achieving reliable self-verification without external judges—adding only 5M parameters while reducing inference cost and improving…