The base model is a standard transformer with:

This paper is a conceptual proposal; actual implementation results may vary.