Question 1: Short answer
easyAI-checkedAttention & TransformersThe original Transformer for translation has 6 encoder layers and 6 decoder layers. How many multi-head attention layers does it contain in total?
1 question from Attention & Transformers
1 question · 1 min · score and explanations at the end
The original Transformer for translation has 6 encoder layers and 6 decoder layers. How many multi-head attention layers does it contain in total?