Apparently, one way to make the kittehs not sing along is to pet them nonstop!
At some point, I really need to learn to do more with Audacity than just record. For instance, getting rid of those pesky feedback thingies, or changing the settings so that they don't happen would be a good start.