The Curse of Depth in Large Language Models (arxiv.org) AI

The arXiv preprint “The Curse of Depth in Large Language Models” argues that increasing model depth can create negative effects for large language models, based on evidence and analysis described in the paper.