A lot of factors can affect world performance! This post lists ways to optimize your world: Luna's General Tips for optimizing VRChat worlds
Here’s a guide by Unity on how to optimize your VR content. (Please note that some of the steps/settings are not available in the VRChat Worlds SDK)