Unlocking AI Potential: Insights into Google Cloud's Vertex AI Platform
Transcript
all right cot tap from Google clouds Cloud fil day 20 presentation which I attended yesterday vertex AI what is it what problem is it solving it's I'm still formulating my thoughts thus a hot take I'm going to do a lightboard on this but the overall problem that it solves is putting a rapper around AI in the way that enterprises and developers data scientists can actually leverage yes I can take a OEM server put some graphics cards in that server install pytorch python my software layer in
bod day solution if I have distributed data challenges if I have data sovereignty issues compliance issues yes that is the route that more than likely I have to take but if I don't have those concerns or if I can go around those concerns vertex Ai and similar Solutions solve this problem of creating a platform that's not fragile I don't think people realize how early AI we are from a platform perspective getting the right drivers setting up the environment optimizing for Speed containerizing applications Solutions exist but
we're still extremely ear early days this is like managing early kubernetes or or Worse on premises Google Cloud vertex is taking away that complexity and just simply giving you a platform do you want to use Gemini do you want to use llama 3 do you want to use any of the models that you can get from a model Marketplace apply that to your data and then use something like a Google Cloud run to create the logic the application logic to trigger that off all you're worried
about is the application logic your data and what model you want to use in the compute it's all handled for you Google is using gke in the background in it's uh CPUs gpus Etc whatever you want to inference off of and it becomes a portable way to create AI more more importantly it becomes a portable way to develop for AI it's a hot tap there's a lot more to unpack there's a lot more to discover we spent seven eight hours with Google yesterday amazing conversations I'm
going to pour through my notes and uh promise a little bit more detail around kind of cloud AI versus on Prem AI versus hybrid