Unzip (rather than install) different versions of Audacity into separate folders.
Then launch a version by clicking on the Audcaity icon in that folder.
If you install two versions they will share the hidden Audacity preferences file and corruption will ensue.