Yes is there a way I can play mp4 videos with audacity?
MP4 is a “container format” that usually contains video and audio.
Depending on which codec was used to encode the audio, the audio can usually be imported into Audacity if you have “FFmpeg for Audacity” installed.
See: https://manual.audacityteam.org/man/installing_and_updating_audacity_on_windows.html#winff