There's a feature being worked on allowing a player to switch saved skins without having to relog, so that's probably going to be the solution. It is also in the nether starts settings menu, which is where, hopefully, the feature I'm suggesting will be placed too.