{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"Practical AI","title":"The landscape of AI infrastructure","html":"<iframe width=\"100%\" height=\"180\" frameborder=\"no\" scrolling=\"no\" seamless src=\"https://share.transistor.fm/e/9b817c8f\"></iframe>","width":"100%","height":180,"duration":3093,"description":"Being that this is “practical” AI, we decided that it would be good to take time to discuss various aspects of AI infrastructure. In this full-connected episode, we discuss our personal/local infrastructure along with trends in AI, including infra for training, serving, and data management.Sponsors:DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog. DataEngPodcast – A podcast about data engineering and modern data infrastructure. Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. Featuring:Chris Benson – Website, GitHub, LinkedIn, XDaniel Whitenack – Website, GitHub, XShow Notes:Our locally installed stuff:JupyterDockerPythonGoPostmanWhere we see AI workflows running:AWSGCPAzureKubernetes and KubeFlowOn-prem workstations: NVIDIALambda LabsSystem76Experimentation / model development:JupyterLabGoogle ColaboratoryAWS SageMakerData Science platforms: DominoDataBricksDataRobotH2O.aiPipelining and automation:PachydermAirflowLuigiModel optimization: OpenVinoTensorRTTensorFlow LiteServing:MXNetTensorFlow servingSeldonMonitoring/visibility:TensorBoardNetronKnock knockPrometheusElasticSearchUpcoming Events: Register for upcoming webinars here!","thumbnail_url":"https://img.transistorcdn.com/Ox7ZlyiQOhdDa4Qy1MnJH5WFoksAetrzb40Jo1pePFs/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS8wMTZi/ZWJmNWIwNDdmYTcw/NGJjMTExZjNjZmYy/M2ZjNS5wbmc.webp","thumbnail_width":300,"thumbnail_height":300}