Alert Logic: Scaling Storage and Delivery of Petabytes of Search Data
In this episode of This is My Architecture – https://amzn.to/2JAqGUZ, Alert Logic shares the architecture behind their search solution. They have 25 PB of data stored in an Amazon S3 data lake. To support each customer’s search, they use Amazon ECS, Amazon SQS, and AWS Lambda to receive, queue, and process each search request. The search result is then stored in Amazon S3 before being returned to the user. The solution scaled from 0 to 55,000 concurrent Lambda executions, or 18 million within an hour while maintaining their execution time duration goal.
Host: Toby Knight, Manager, Solutions Architecture
Customer: Alert Logic