Code and Cognition

Olio Apps can help you build your app: ⁠⁠https://www.olioapps.com/contact-us⁠⁠Hey! We're Scott and Aron. We are software engineers, and business operators running Olio Apps. We help our clients build the best software possible. We're always learning and improving our methods and practices, and we want to share that with you.--Show Notes:(0:00) Intro(0:35) Welcome(0:52) Zach’s Background(2:22) Working with LLMs vs ML Models(6:02) Applying AI to Backrs - Hyper Personalization(9:01) From prototype to scale(12:57) Streaming with Lambda(17:34) Python streaming lambda wrapper(22:17) Journey to get to 100 concurrent users - db connections - database pool via proxy(25:21) Lifting LLM provider quota limits(27:29) Lambda rate limits(31:17) Backrs UI(33:49) Backrs Streaming Example(36:11) Conclusion

Show Notes

Olio Apps can help you build your app: ⁠⁠https://www.olioapps.com/contact-us⁠⁠


Hey! We're Scott and Aron. We are software engineers, and business operators running Olio Apps. We help our clients build the best software possible. We're always learning and improving our methods and practices, and we want to share that with you.


--


Show Notes:


(0:00) Intro

(0:35) Welcome

(0:52) Zach’s Background

(2:22) Working with LLMs vs ML Models

(6:02) Applying AI to Backrs - Hyper Personalization

(9:01) From prototype to scale

(12:57) Streaming with Lambda

(17:34) Python streaming lambda wrapper

(22:17) Journey to get to 100 concurrent users - db connections - database pool via proxy

(25:21) Lifting LLM provider quota limits

(27:29) Lambda rate limits

(31:17) Backrs UI

(33:49) Backrs Streaming Example

(36:11) Conclusion

What is Code and Cognition?

Discover the Cutting Edge of Gen AI Integration

Step into the world of Gen AI and cloud computing with Code & Cognition — the podcast where industry leaders, developers, and innovators reveal the latest breakthroughs and strategies in AI.