One trick to avoid false-positives is to reverse the audio before processing for click removal and then reverse it back again afterwards.
Personally I use Brian Davies’ excellent ClickRepair software fo my click removal (it costs a little but is well wort it IMO). It has a setting to do the “reverse processing” automatically. See this sticky thread: https://forum.audacityteam.org/t/click-pop-removal-clickrepair-software/1933/1
WC