Edge#3: Attention that Transformed Machine Learning

This issue is dedicated to Attention and Transformers that are likely to be key building blocks of the next decade of AI:

• we explain the concept of the Attention mechanism that led to a few major breakthroughs in ML;

• we discuss the research paper “Attention is All You Need” that introduced the concept of the hot Transformer architecture;

• we evaluate freshl…