NCP-GENL Practice Questions - NVIDIA-Certified Professional Generative AI LLMs Exam

Access More Questions
In a decoder-only transformer using scaled dot-product attention, what is the purpose of dividing the dot product of Q and K by the square root of the head dimension?
Correct Answer:
It keeps the softmax in a regime with usable gradients as head dimension grows

Access more questions from this quiz

Continue to NCP-GENL Practice Questions - NVIDIA-Certified Professional Generative AI LLMs Exam for more practice questions and the full quiz experience.

Access More Questions