NodeBB's cache buster is based on its current git hash (so if you've upgraded it will try to send you the new CSS and JS, which works well, but it remains the same if switching themes, which results in your issue)
I suppose the dev team hasn't run into this because we usually run with cache disabled while testing (and because Persona is so awesome so why switch? Kidding)
https://github.com/NodeBB/NodeBB/issues/3573