cold start

Cold start is the tax on serving many models from few GPUs. Splitting weights from the skeleton takes frontier-model wake-up from minutes to seconds.