I believe you have to manually generate a new address -- I don't think it changes them without you initiating that change.