{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"Code and Cognition","title":"AI Development, Streaming, and Scaling with AWS Lambda","html":"<iframe width=\"100%\" height=\"180\" frameborder=\"no\" scrolling=\"no\" seamless src=\"https://share.transistor.fm/e/48e89ef1\"></iframe>","width":"100%","height":180,"duration":2188,"description":"Olio Apps can help you build your app: ⁠⁠https://www.olioapps.com/contact-us⁠⁠\nHey! We're Scott and Aron. We are software engineers, and business operators running Olio Apps. We help our clients build the best software possible. We're always learning and improving our methods and practices, and we want to share that with you.\n--\nShow Notes:\n(0:00) Intro(0:35) Welcome(0:52) Zach’s Background(2:22) Working with LLMs vs ML Models(6:02) Applying AI to Backrs - Hyper Personalization(9:01) From prototype to scale(12:57) Streaming with Lambda(17:34) Python streaming lambda wrapper(22:17) Journey to get to 100 concurrent users - db connections - database pool via proxy(25:21) Lifting LLM provider quota limits(27:29) Lambda rate limits(31:17) Backrs UI(33:49) Backrs Streaming Example(36:11) Conclusion","thumbnail_url":"https://img.transistorcdn.com/FibZYR2Jc4bAsvUYB_faLieYy39Memr1SvaXdzAp7Qc/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS82ODFl/ZTE4MWM5YjQyMzM2/MzhkNjViNzUxYmFl/YmIyYi5qcGc.webp","thumbnail_width":300,"thumbnail_height":300}