1. FlagOS Technology Stack Overview

The figure below shows the latest FlagOS technology stack. The FlagOS ecosystem currently includes three categories of open-source projects. The FlagOS open-source core libraries include the FlagGems general-purpose large-model and domain-specific operator libraries, the FlagScale training and inference framework, the FlagTree unified compiler, and the FlagCX unified communication library. We also define ecosystem-enabling projects, including plugins for training and inference engines and open-source tools designed by the FlagOS community, such as KernelGen for automatic operator generation, FlagRelease for automatic migration and release, and FlagPerf for multi-chip evaluation.

Figure 1. FlagOS technology stack overview