#313 Nick Pandher: How Inference-First Infrastructure Is Powering the Next Wave of AI

Ciriscale is a NeoCloud specializing in lots of different areas around AI, but most specifically today, we're gonna focus on inference. I'm VP of product. And as part of my role as VP of product is, working with our development teams to build out unique capabilities for AI services around inference and, other areas as well. My background comes out of the GPU space. I was at NVIDIA very early on at AMD and several startups that have touched, AI models and other type of models in their use cases as well. Although I don't think of that as the cloud provider's job. Is that unusual that you're getting involved in, you know, optimizing inference, as opposed to just providing the compute? Okay. Yeah. So, Nick, why don't you start by introducing yourself to listeners, and then we'll talk about inference. Absolutely. So hello, everybody. I'm Nick Pander with Cirascale. Cirascale is a NeoCloud specializing in lots of different areas around AI. But most specifically today, we're gonna focus on inference. I'm VP of product. And as part of my role as VP of product is working with our development teams to build out unique capabilities for AI services around inference and other areas as well. My background comes out of the GPU space. I was at NVIDIA very early on at AMD and several startups that have touched AI models and other type of models in their use cases as well. Yeah. Tell us first what Cirascale does. Absolutely. So we're a more white glove type of cloud services provider. What we're focusing on is trying to understand customer specific issues and when they're looking for outside cloud services. So, typically, we're taking customers who are coming from an on premise environment or a hyperscaler and are just looking for services and capabilities that may not be part of what they're getting today. So if we look at it from an AI point of view, it's being able to deliver the correct AI fleets for given use cases. It's covering any sort of compute needs that might be required for pre or post processing data. It's delivering services that, you know, help bring high performance, reliable type of solutions, specifically, you know, if we look at inference being a differentiated area. We really wanted to, you know, increase those services and expand from our AI accelerated fleet where customers typically bring their own stacks and bring their own solutions into more ready to go solutions that a customer can take and utilize for, you know, training, fine tuning, and also for for inference capabilities as well. Yeah. And is that primarily your differentiator primarily in the software, or is it that you have, you know, specialized GPUs tuned for inference? Yes. So that's a great question. So we a few different facets there. One is we're all about operating a cloud service that's taking the highest performance with the capabilities a customer is looking for with the highest reliability …