As the Buddha once said,
"The wind cannot shake a mountain. Neither praise nor blame moves the wise man. Happiness or sorrow - whatever befalls you, walk on untouched, unattached."
I guess the Buddha placed emphasis on the element of suffering that comes from our own thoughts - usually negative thinking, but also being misled by unfounded positivity.
The Buddha practiced non-attachment - not going so far as to renounce all material items (as Seneca, the Stoic, did when he renounced attachment to his own child) - but rather a distancing between you and your thoughts. Non-attachment means having the ability to maintain faith in the self when faced with a loss of a certain status (to be blamed), such as losing out on a job promotion, or having an especially terrible job interview.
Self-esteem is a positive reflection of the self. This is something that needs to be cultivated to the point of solidity. My self-esteem needs to be based on something external to worldly praise and blame. I shouldn't hate on myself for having a shitty car - I also shouldn't love myself for having a nice car.
Musing in Lake Country,
Andrew Edwards, Jan 2016