<audio> Firefox tag, wav vs ogg

I exported a recorded test as wav and ogg using Audacity 1.2.6 on Windows XP, and tried to play them in Firefox 3.6.3
using the internal ogg-player with the the html5

This is the html file:

<audio src="123.ogg" controls>
<audio src="123.wav" controls>

HTML 5 is very new. Try encoding an OGG with some other application (such as SOX) and see if you get the same issue. If so, contact Mozilla.