I disagree. It would be one thing if only always referred to one and only one thing, but that's not the case. Webster's New World defines only as "alone of its or their kind," and nobody objects to "only two people . . ." and the like. If "only two people" have done something, wouldn't one of those people be one of only two people, or one of the only people, who have done it?