With the advent of ChatGPT large language models are the talk of the town. These models are changing the very foundations of our interactions with computers and computers' ability to process text. This talk will introduce you to fundamental ideas of the building blocks behind large language models while examining key innovations that have enabled transformer-based large language models, and how they are able to solve various language tasks. A brief overview of OpenAI API will also be provided.