On the other hand, and as you note here, if you want the latest bug fixes, you have to update.
Personally I like to thoroughly test updated software before using it for anything important. If I’m in the middle of a big project, I’ll defer updating until I’ve finished the project.
Note that most old versions of Audacity are available on FossHub if you need to revert to an older version for any reason (Old Audacity versions download)