I know this thread is old. However it was one of the first search results when I was looking for the same problem.
This is not an issue with Behringer devices or Audacity, Windows is to blame. You have to change the setting for the USB input to be 2 channels.
This youtube-video explains it:
https://youtu.be/59QY0WL3f64