NCP-GENL Practice Questions - NVIDIA-Certified Professional Generative AI LLMs Exam

Compared to Post-LN, why have modern large language models largely adopted Pre-LN placement of the normalization layer?

Pre-LN reduces total parameter count Pre-LN provides better training stability at large depths and removes the need for warmup tricks Pre-LN is required for RoPE to function Pre-LN enables INT8 quantization automatically

Correct Answer:

Pre-LN provides better training stability at large depths and removes the need for warmup tricks

Access more questions from this quiz

Continue to NCP-GENL Practice Questions - NVIDIA-Certified Professional Generative AI LLMs Exam for more practice questions and the full quiz experience.

Access More Questions