What happens in each situation
Moving from a subscription to Pay-as-you-go is not a downgrade. It is a different product, and the balance does not follow you. If you have unused traffic and you are thinking about switching, use the traffic first.
An upgrade or a downgrade is different: your remaining traffic transfers to the new plan in both cases.