논문 정리 NeuroVectorizer: End-to-End Vectorization with Deep Reinforcement Learning (CGO 20)

제목

NeuroVectorizer: End-to-End Vectorization with Deep Reinforcement Learning

저자

Ameer Haj-Ali, Nesreen K. Ahmed, Ted Willke, Sophia Shao, Krste Asanovic, Ion Stoica

Motivation

  • Compilers are designed today to use fixed-cost models that are based on heuristics to make vectorization decisions on loops. However, these models are unable to capture the data dependency, the computation graph, or the organization of instructions
  • The vectorization is critical to enhancing the performance of compute-intensive workloads in modern computers.

Contribution

해당논문은 머신러닝 High 

  • A comprehensive data set of more than 10,000 synthetic loop examples.
  • An end-to-end deep reinforcement learning (RL) based auto loop-vectorization method

The Proposed Framework Architecture

Code Embedding

  • Code2vec(Embedding Network) represents a code snippet as a single fixed-length code vector, which can be used to predict the semantic properties of the snippet.
  • This vector captures many characteristics of the code, such as semantic similarities, combinations, and analogies
A code snippet and its predicted labels as computed by code2vec
reference : https://arxiv.org/pdf/1803.09473.pdf
The architecture of our path-attention network. A full-connected layer learns to combine embeddings of
each path-contexts with itself; attention weights are learned using the combined context vectors, and used to
compute a code vector. The code vector is used to predicts the label.
reference : https://arxiv.org/pdf/1803.09473.pdf

Automatic Vectorization Example

The RL Environment Definition

where baseline is the execution time when compiled with the currently implemented baseline cost model in LLVM and RL is the execution time when compiled with the injected pragmas by the RL agent
where MAX_VF and MAX_IF are respectively the maximum
VF and IF supported by the underlying architecture

Dataset Description

To speed up the training, and make it more efficient,
we built a dataset that includes loops only. We built generators that generate more than 10,000 synthetic loop examples automatically from the LLVM vectorization test-suite.

Handling Long Compilation Time

  • During training, some of the programs took a long time to compile, mainly when the agent was trying to vectorize more than plausible
  • giving a penalty reward of −9 (equivalent to assuming it takes ten times the execution time of the baseline) so that the agent will learn not to overestimate the vectorization and avoid it

Results:Reward mean and training loss for different action space definitions

Results:The performance of the proposed vectorizer

The performance is normalized to the baseline(VF = 4, IF =
2)

Results:Normalized average performance of supervised FCNN and deep RL

Results:The performance of the proposed vectorizer on
Mibench compared to Polly and the baseline cost model

The performance is normalized to the baeline(VF = 4, IF =
2)

references

https://arxiv.org/abs/1909.13639

1803.09473.pdf에 액세스하려면 클릭하세요.

Project Page

NeuroVectorizer is a framework that uses deep reinforcement learning (RL) to predict optimal vectorization compiler pragmas for for loops in C and C++ codes.
https://github.com/intel/neuro-vectorizer
12 forks.
37 stars.
0 open issues.
Recent commits:

댓글을 남겨주세요~