I think changing the port blocks them for a little bit until they scan all my ports again. They found me at 2222, so I had to change again. They were using up about 8-10GB of bandwidth per month just on SSH login attempts.
Bonus bandwidth usage: https://i.imgur.com/T0sJCpM.png
Seems like 1-2GB per day sometimes, hah.