논문 정리 Chameleon Adaptive Code Optimization for Expedited Deep Neural Network Compilation(ICLR 2020) 02-12
간단논문 정리 Fast and Effective Orchestration of Compiler Optimizations(Zhelong Pan,Rudolf Eigenmann;Purdue University ;CGO’06) 02-12
논문 정리 Chameleon Adaptive Code Optimization for Expedited Deep Neural Network Compilation(ICLR 2020) 02-12
간단논문 정리 Fast and Effective Orchestration of Compiler Optimizations(Zhelong Pan,Rudolf Eigenmann;Purdue University ;CGO’06) 02-12
Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching 04-13
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers 04-07
SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations 04-02
SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention 03-24
AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution 03-17
JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generation 02-11
DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search 02-10
Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models 02-10
DeepSeek-Coder: When the Large Language Model Meets Programming - The Rise of Code Intelligence 02-07
Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models 02-05
Qwen-VL: AVersatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond 02-04
TokenRing: An Efficient Parallelism Framework for Infinite-Context LLMs via Bidirectional Communication 01-20
EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism 01-02
The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction 12-26
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality 12-24
SageAttention2 Technical Report: Accurate 4 Bit Attention for Plug-and-play Inference Acceleration 12-20
Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache 12-18
Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models 12-17
FFSplit: Split Feed-Forward Network For Optimizing Accuracy-Efficiency Trade-off in Language Model Inference 12-17
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving 12-16
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design 12-15
Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inferenc 12-14
Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time 12-13
FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning 12-12
No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization 12-12
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression 12-10
Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference 12-09
Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters 11-28
Dynamic Discriminative Operations (D2O) for Efficient Generative Inference of Large Language Models 11-27
Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction 11-21
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection 11-18
VL-Cache: Sparsity and Modality-Aware KV Cache Compression for Vision-Language Model Inference Acceleration 11-18
The CoT Collection Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning 11-14
Scientific Beta Multi-Beta Multi-Strategy Indices Implementing Multi-Factor Equity Portfolios with Smart Factor Indices 11-11
RAG4ITOps A Supervised Fine-Tunable and Comprehensive RAG Framework for IT Operations and Maintenance 11-11
Enabling Tensor Language Model to Assist in Generating High-Performance Tensor Programs for Deep Learning 11-07
BUZZ Beehive-structured Sparse KV Cache with Segmented Heavy Hitters for Efficient LLM Inference 11-06
SpecExec Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices 11-04
GraphPipe Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism 11-04
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches 11-01
논문 정리 Chameleon Adaptive Code Optimization for Expedited Deep Neural Network Compilation(ICLR 2020) 02-12
간단논문 정리 Fast and Effective Orchestration of Compiler Optimizations(Zhelong Pan,Rudolf Eigenmann;Purdue University ;CGO’06) 02-12
Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching 04-13
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers 04-07
SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations 04-02
SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention 03-24
AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution 03-17
JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generation 02-11
DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search 02-10
Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models 02-10
DeepSeek-Coder: When the Large Language Model Meets Programming - The Rise of Code Intelligence 02-07
Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models 02-05
Qwen-VL: AVersatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond 02-04
TokenRing: An Efficient Parallelism Framework for Infinite-Context LLMs via Bidirectional Communication 01-20
EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism 01-02
The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction 12-26
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality 12-24
SageAttention2 Technical Report: Accurate 4 Bit Attention for Plug-and-play Inference Acceleration 12-20
Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache 12-18
Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models 12-17
FFSplit: Split Feed-Forward Network For Optimizing Accuracy-Efficiency Trade-off in Language Model Inference 12-17
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving 12-16
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design 12-15
Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inferenc 12-14
Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time 12-13
FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning 12-12
No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization 12-12
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression 12-10
Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference 12-09
Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters 11-28
Dynamic Discriminative Operations (D2O) for Efficient Generative Inference of Large Language Models 11-27
Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction 11-21
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection 11-18
VL-Cache: Sparsity and Modality-Aware KV Cache Compression for Vision-Language Model Inference Acceleration 11-18
The CoT Collection Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning 11-14
Scientific Beta Multi-Beta Multi-Strategy Indices Implementing Multi-Factor Equity Portfolios with Smart Factor Indices 11-11
RAG4ITOps A Supervised Fine-Tunable and Comprehensive RAG Framework for IT Operations and Maintenance 11-11
Enabling Tensor Language Model to Assist in Generating High-Performance Tensor Programs for Deep Learning 11-07
BUZZ Beehive-structured Sparse KV Cache with Segmented Heavy Hitters for Efficient LLM Inference 11-06
SpecExec Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices 11-04
GraphPipe Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism 11-04
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches 11-01
Scientific Beta Multi-Beta Multi-Strategy Indices Implementing Multi-Factor Equity Portfolios with Smart Factor Indices 11-11
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression 12-10
Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference 12-09
DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search 02-10
AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution 03-17