My best guess is that it's a fine-tuning of the base Instruct-GPT model combined with some search algorithm, but is there any information about what that search algorithm is? Has anyone reproduced the functionality with any other models?

For reference, this is the functionality I'm referring to: Insert <https://platform.openai.com/docs/guides/completion/inserting-text> Edit <https://platform.openai.com/docs/guides/completion/editing-text>