Alibaba ACA GenAI Practice Questions - Alibaba Cloud Certified Associate Generative AI Engineer (ACA-GenAI GAA-C01) Exam

In a Transformer self-attention block, what role do the Query, Key and Value projections play?

Query and Key compute attention weights, which are then used to combine Values into the output Query produces the output, Key and Value are discarded after training Query stores the vocabulary, Key stores positions, Value stores embeddings All three are identical copies of the input embedding

Correct Answer:

Query and Key compute attention weights, which are then used to combine Values into the output

Access more questions from this quiz

Continue to Alibaba ACA GenAI Practice Questions - Alibaba Cloud Certified Associate Generative AI Engineer (ACA-GenAI GAA-C01) Exam for more practice questions and the full quiz experience.

Access More Questions