Even if being a stimulant were its only property, what makes it decidedly bad? Researchers understand it as a stimulant as it is, they're not evaluating its worth "despite" being a stimulant. If consumption in small doses poses a net harm for that reason, there ought to be stronger consensus, which is lacking.
I personally believe the net effect is to make your body work harder to get through the day.
I think it's bad unless you were funded by the coffee industry.