ChatDynamic: Manually failover to desired LLM at runtime.

ChatLoadBalance: Load balance LLMs based on loading balancing algorithm.

ChatChaos: Substitute normal LLM behavior with chaotic behavior.

ChatNotDiamond: Leverage Not Diamond's optimized LLM routing functionality.

ChatCustomRouter: Implement custom LLM routing logic.

ChatDynamicParams: Dynamically set model parameters (e.g. temperature, presence_penalty, max_tokens) based on the prompt.