Entropy Decoding in Optillm and Early Results on GSM8k

1 point

2 years ago

Optillm (https://github.com/codelion/optillm) now has an implementation of entropy decoding based adaptive sampling based on the work of @\_xjdr (https://github.com/xjdr-alt/entropix). The original repo is in a state of flux but the idea seems to work well.

I also did an eval of the entropy decoding on GSM8k with Qwen2.5-0.5B-Instruct model in a zero shot setting. I found improvements over the base model but they are not better than what we get with a much simple CoT decoding.

You can try them both in this free Gogole Colab -(https://colab.research.google.com/drive/1SpuUb8d9xAoTh32M-9wJsB50AOH54EaH?usp=sharing)