What exact path, for example on that user’s Desktop? is this when logging in, or when launching Audacity?
Is this a Windows behaviour rather than an Audacity behaviour? You haven’t said what version of Windows you are using.
I cannot replicate the problem on Windows 8.1 if I install Audacity as Admin using the GUI installer (without creating a Desktop icon) then log in as a standard user or launch the installed version.