Vitamin D3 makes me literally insane with anxiety. I've tested it dozens of times, each time with the exact same insane anxiety effect.
So, recently I tried D2, and no apparent negative reaction. You seem to even react to that.
On amazon.com you can get plant based D2 made from yeast and D2 made from mushrooms.
Perhaps one or the other might work for your body chemistry.
And if neither, then just get outside in the sun.