Transformers Are Inherently Succinct (openreview.net) AI

The paper “Transformers Are Inherently Succinct” argues that transformer models’ computations can be expressed in a more compact (succinct) form, implying an efficiency advantage in how these models represent or process information.