FrameworkLauncher (or Launcher for short) is an OpenPAI subproject and standalone component, that is built to orchestrate all kinds of applications on YARN and Kubernetes through the same interface without making changes to the applications themselves.
These applications include but not limited to:
- Long-Running Services (DeepLearning Serving, HBase, Kafka, etc)
- Batch Jobs (DeepLearning Training, KDTree Building, etc)
- Streaming Jobs (Data Processing, etc).
FrameworkLauncher Natively Supports YARN: YARN FrameworkLauncher.
Note, it ALSO includes scheduling features, such as Topology-Aware Gpu Scheduling.
FrameworkLauncher Natively Supports Kubernetes: Kubernetes FrameworkController.
Note, it does NOT includes scheduling features, for the scheduling counterpart, we have already splitted it to another dedicated project: HiveDScheduler, and you can directly leverage it with the Kubernetes FrameworkController.