For a complete removal of any application, you will need to delete the leftover keys in Windows’ registry after uninstalling. If you do clean the registry, make a backup first as any registry edit cannot be undone. I am not sure why you would want to use an earlier version of Audacity: the new one is nice once you get used to the few changes.