So basically any time I join an instance over 10 people my headset says too many avatars when I just cleared my cache and only have vrchat installed

Help!
1

I keep getting kicked out because VRchat is using almost 3.4 GB to 5.6 GB of memory any time it goes too much. If I change avatars or use the menu it drops my FPS to around 10-3 FPS. Quest 2 btw