The order in which the globes are given to you is buggy--it's not always the LAST globe of each color that is meant to go in the pillar of that color. The only way is trial and error: Try equipping each Globe in your quickslots--the one that won't go in is that you that you have to put into the pillar. Confusing, I know. And
then there's the fact that the colors on the pillars are difficult to see, as they're in shadow.