Abstract

In this talk, I discuss the Transformers architecture in some detail along with the evolution of embeddings in the NLP sub-area of AI. The talk also features various other architectures and example of the fine tuning process. Some slides have been redacted as they are ongoing investigations in our research group. These were presented internally at the University.