Foundation Model Virtualization

Serving and managing a growing zoo of foundation models at enterprise scale is hard: models differ in cost, capability, and reliability, and workloads change over time. This line of work rethinks foundation model serving through the lens of operating-system principles — introducing a self-evolving OS layer that virtualizes foundation models, dynamically routes requests, and adapts as new models and domains arrive.

Applications range from private-cloud AI platforms to autonomous scientific agents (e.g., microscopy) that retrieve domain knowledge on demand.

Representative publications (Bhattacharya et al., 2026; Saranathan et al., 2025).

References

2026

ICML

It is Time to Virtualize Foundation Models with a Self-evolving Operating System Layer

Suparna Bhattacharya, Tarun Kumar, Cong Xu, and 7 more authors

In International Conference on Machine Learning (ICML), 2026

Bib

@inproceedings{bhattacharya2026virtualize,
  title = {It is Time to Virtualize Foundation Models with a Self-evolving Operating System Layer},
  author = {Bhattacharya, Suparna and Kumar, Tarun and Xu, Cong and Mopur, Satish Kumar and Li, Jiahao and Mishra, Ashish and Tripathy, Aalap and Koomthanam, Annmary Justine and Foltin, Martin and Foster, Ian},
  booktitle = {International Conference on Machine Learning (ICML)},
  year = {2026},
}

2025

TPC

Advancing Autonomous Microscopy Agents with Domain-Guided Dynamic Retrieval in a Virtual Foundation Model OS

Gayathri Saranathan, Martin Foltin, Cong Xu, and 12 more authors

In Trillion Parameter Consortium (TPC), 2025

Bib

@inproceedings{saranathan2025microscopy,
  title = {Advancing Autonomous Microscopy Agents with Domain-Guided Dynamic Retrieval in a Virtual Foundation Model OS},
  author = {Saranathan, Gayathri and Foltin, Martin and Xu, Cong and Bhattacharya, Suparna and Justine, Annmary and Kumar, Tarun and Shah, Arpit and Tripathy, Aalap and Sharma, Rishab and Kulkarni, Shreyas and Ziatdinov, Maxim and Ghosh, Ayana and Roccapriore, Kevin and Faraboschi, Paolo and Foster, Ian},
  booktitle = {Trillion Parameter Consortium (TPC)},
  year = {2025},
}