Weird vibrant visuals performance

While performance can be a bit choppy with vibrant visuals only a bit higher than the performance preference, selecting performance does a good job (from my experience) keeping it in the 50-60fps range. However, when changing cloud range from "high" (default settings for performance preference with vibrant visuals) to "medium" or "low", the game doesn't seem to run as smoothly for me (at around 30-50fps) despite the detail being reduced. It only fixes itself when I select the performance preference again as manually changing the settings to match the performance preference doesn't seem to fix the performance