It’s possible squeeze down the noise using noise-reduction & an expander …
Rather than using Audcaity’s amplify, have you tried turning-up the mic-gain/boost in Window’s recording devices ?
Doing that maybe could also improve the signal-to-noise ratio, (worth a try).
That mic currently costs less than $40 : it’s not really a professional spec item.
A stand-alone recording device will have lower-noise, (they can be hired by the day).