FluxServe: A Flexible and High-Performance Inference Engine for Open Diffusion Language Models
FluxServe is a lightweight inference serving engine built specifically for open diffusion language models. FluxServe is designed and implemented to deliver low latency and high throughput for autoregressive (AR) diffusion models through an optimized attention runtime, dynamic block-level scheduling, and efficient multi-GPU serving.
FluxServe Team