ChatDynamic: Manually failover to desired LLM at runtime.
ChatLoadBalance: Load balance LLMs based on loading balancing algorithm.
ChatChaos: Substitute normal LLM behavior with chaotic behavior.
ChatNotDiamond: Leverage Not Diamond's optimized LLM routing functionality.
ChatCustomRouter: Implement custom LLM routing logic.
ChatDynamicParams: Dynamically set model parameters (e.g. temperature, presence_penalty, max_tokens) based on the prompt.