Ask HN: Has degradation in the quality of ChatGPT and Claude been proven?

42 points

2 years ago

Has there been any consensus on this phenomenon I've seen where there are reports of decrease in model performance? This decrease in quality seems to take many forms: laziness, lower expressiveness, mistakes, laziness etc.

One the other hand there are people who claim there hasn't been any degradation at all[0]?

If there is indeed no degradation how could the perceived degradation be explained?

[0] https://community.openai.com/t/declining-quality-of-openai-m...

https://community.openai.com/t/declining-quality-of-openai-m...

https://www.reddit.com/r/OpenAI/comments/18sc92o/with_all_th...

http://arxiv.org/pdf/2307.09009

40 comments