Recurrent Neural Networks (RNNs)
Lately I have been involved in many conversations in my current company regarding Transformers, but what I feel is that people love to understand what Transformers are, but they do not want to understand the tradeoffs. Maybe the problem that we are solving could've been solved by RNNs