Glory and luxury without dispassion is a nauseating pomp and show. Such glory does not bring fulfillment for anyone; it is shallow. Alternately, the dispassion that is afraid of glory is weak. True dispassion is oblivious to glory.
The glory that comes with dispassion is something that is true; it is permanent and authentic. When someone chases after glory, they are shallow.
Movie stars, politicians and religious leaders who try to hold on to their status, to their glory, are certain to lose it. If you run after glory all that you get is misery. When you are dispassionate, glory comes to you.
If you are afraid of glory, that means you are not well-founded in dispassion. In India the sadhus run away from glory. They think they will lose their dispassion and get trapped in the web of the world, the circus. The dispassion is so blissful that they get attached to it. They are afraid of losing the dispassion, the centeredness and the bliss that comes along with it. This is weak dispassion.
Dispassion is a state of being and glory is the happening around it. True dispassion can never be lost or overshadowed by glory.