The bigger size of the Desire HD means its not for everyone. It will fit into most pockets, but those who are smaller in stature or like to wear tight jeans may not feel too comfortable with it, especially when trying to sit down.
As with the HD2, this product is meant for those who want the latest and greatest in a smartphone, and such users generally accept the trade off of having a larger device.