Re: How can I remove all frequencies above a certain pitch with Audactiy?

Use the “Low Pass Filter” (see: Low-Pass Filter - Audacity Manual)

However, that will probably make the recording sound dull.
Piezo pickups often over-emphasize frequencies around 2000 Hz (2 kHz). If you use “Plot Spectrum” (Plot Spectrum - Audacity Manual) you will probably see a pronounced bump, spike or bunch of spikes around 2 kHz (may be at a higher frequency depending on the pickup).
Make a note of where that peak occurs, then try the Filter Curve EQ effect to reduce those frequencies. (See: Filter Curve EQ - Audacity Manual).

[Unfortunately Hamm542 was a spammer and has been permanently banned. Leaving this reply as it may be useful for future users.]