
In fact, Flexential is now building its own set of offerings on top of the VMware AI Factory, set to be released early next year. “Basically, you can do everything there,” Cook tells Network World. “You can bring your own model. You can spin up your agents. You can orchestrate it. And they’ve got observability, which is critical.”
Flexential will bundle that with hosting and services for a complete private AI solution. “Their stuff sits next to most of the data in the enterprise today, and that latency, that proximity, is important,” he says.
Running AI on premises instead of in the cloud can offer cost, latency, and compliance benefits, but it can also be a management challenge, and organizations are still struggling to find the right balance.
According to an Omdia survey of 1,201 IT leaders released in August, 96% currently use a mix of cloud, on-premise, and edge infrastructure for AI. As share of workload, 59% of inferencing workloads currently run in the cloud, and 41% on-prem. In three years, companies expect to run 63% of AI inferencing workloads in the cloud and 37% on-prem. Meanwhile, other workloads are moving in the opposite direction—according to the survey, 60% of companies have repatriated some workloads back from the cloud to on-prem.
For companies running AI workloads on prem, integrating AI security with a virtualization platform makes sense, says Ryan Sheehan, senior vice president of advanced solutions at SHI International, an IT consultancy. “That’s where I think VMware is in a very good position,” he tells Network World. “They’re close to the infrastructure.”
That puts VMware in the right place to enforce controls. “They’re at the hypervisor,” he says. “They are the hypervisor.”





















