Today, we are excited to release a new learning capsule that provides an overview into the history of neural networks used for sequence modeling and the origins of Transformers. To learn the concepts of generative AI, developers can use easy-to-consume, bite-sized learning capsules in the AWS DeepComposer console. In this new learning capsule, developers will learn about the kind of problems sequence modeling is used to solve, the history of sequence modeling neural networks, and why Transformers are the new standard for solving sequence modeling problems. Transformers are a machine learning architecture model designed to handle sequential data. With this new model, developers can extend an input melody by up to 30 seconds.