RTX 5080 Problems

Hey guys, I recently paired a rtx 5080 palit gamerock oc to my system (32 gb of ram, and a ryzen 7 9800x3d) I use Virutal Desktop and H.264+ codec, In vrchat for some reason, from time to time my fps will drop to 45 or lower and stay there constantly until i switch to my desktop and back in vr mode (in VD), i dont know why, my gpu and cpu arent nearly at the % thry could be (also i play on high and 90hz on VD) I updated drivers, i used ddu and reinstalled them and srs dont know what to do anymore