It'll change so that it's paid back over a certain amount of time and your tax free amount is reduced until it's paid back.
If I'm right in thinking, you can ring them and arrange to pay it off in one go, so that your tax code goes back to how it should be, without any further instalments being paid.