I contacted Yamaha customer support. We ran through a few checks, although I think the whole setup was working better with the tech over the phone (of course). He seemed to think that it was my router blocking/restricting WAN access. That's somewhat difficult for me to believe because the Yamaha receiver is the ONLY device in my house (I also have multiple iPhones, an iPad, a PS3, two Rokus, two internet TVs, a media server, multiple PCs, a Macbook Air, etc.) that has issues.
I've all but given up.. I just relocated my Bluetooth receiver to the Yamaha to avoid pulling my hair out.