Warranted Attention: Learning What to Pass from Attention to Prediction

Relevance of information read by attention does not guarantee that its contribution benefits the current prediction. We propose Warrant, which learns how strongly attention-derived item contributions should be transmitted under the current query. Warrant applies learned item-wise permission before a