Please use more words to describe the latency issue.
Set Babyface as the Audacity playback and recording device and monitor by plugging headphones into the Babyface. Turn off Transport > Software Playthrough in Audacity. That should deal with playthrough latency.
Are you recording overdubs on top of a track already in Audacity and the new track does not line up with the previous one? If so, that is recording latency. Here is how to set Audacity up to correct for that: Latency Test.
Gale