One source for the misfortune interpretation of passive is the semantic specification in a verb. In the deep case structure, it is specified as to which case-category is the recipient of the misfortuneness.
A second source is the movement of some element out of NP which is immediately dominated by some other case category.
A third is the culture space. Without specification of a culture space, some sentences such as 24) become ambiguous as to MISFORTUNE.