Cloud Foundry Summit 2026

Running Large Language Models typically requires massive, expensive GPU resources—but the landscape is shifting rapidly. In this 5-minute lightning talk, Maurice will demonstrate how to deploy a fully functional AI inference engine directly on Cloud Foundry using standard compute resources.

Maurice will showcase the magic of 1.58-bit ternary models, specifically running Falcon3 Edge via the BitNet framework. The attendees will see how these heavily quantized, low-memory models make it perfectly viable to push an LLM as a standard CF app without melting the underlying infrastructure. Maurice will quickly walk the attendees through the deployment steps, highlight the container footprint, and prove it works with a live, on-platform prompt execution.