The problem is with your USB mic or even the USB cable/port.
It’s a clock problem. Audio and video need to be timed precisely. To do that, a clock signal is generated by the AD chip in the mic. USB doesn’t know about a clock, it just knows about data. And when you send data to a disk, or to a printer, there’s no need for a clock. It doesn’t matter if the data arrives on time. For AV, the clock is mixed in with the data.
When using USB for audio, the clock needs to be “extracted” from the data. Simple enough, except when the clock in AD chip starts to drift. And that’s what you’re hearing.
The mic has warmed up. The clock drifted. And your computer lost track. When there’s no clock, it stops. And restarts, but with old data and a new clock.
Some computers are more sensitive than others. If your USB port is loose, dirty or the cable is so-so, more packets will need to be retransmitted. And that’s when the clock regeneration can’t follow.
A stupid way to avoid this, is powering the mic at least an hour before recording. Put a towel over it. Studio’s keep all their gear at constant temperature. Well, at least big professional studio’s. I also know some that go dead cold at night. They have far more noise and gear problems, also because of condensation. 
In the modern digital world, there seem to be no limits. It seems all so easy, because you can’t see the limits. If you need to record long takes, you need to test. Try a better/shorter cable, fi.
Filesize is another limit. When recording at 24/96, you eat up a lot of disk space. WAV has a filesize limit of 2 or 4 GB. Audacity has an internal limit. And so on. It’s a long, but fairly interesting journey. 