What is Wrong with Perplexity for Long-context Language Modeling? — Blankdot
arxiv.org
What is Wrong with Perplexity for Long-context Language Modeling?
Mar 2, 2025 ... While recent approaches have extended the context windows of LLMs and employed perplexity (PPL) as a standard evaluation metric, PPL has proven ...