If current large language model engineering hits a plateau, as some scientists suspect it will, there are already alternative architectures waiting in the wings.