There is this thread on the Home Assistant forum https://community.home-assistant.io/t/yamaha-receiver-official-intergration-works-1-2-times-and-then-looses-control-update-problem/245121/53
and the relating issue
home-assistant/core#52955 (comment)
However we were told that this is a rxv issue...
Maybe you can have a look?
Thanks for all the hard work!