It is shown that the operator algebraic setting of local quantum physics leads to a uniqueness proof for the inverse scattering problem. The important mathematical tool is the thermal KMS aspect of wedge-localized operator algebras and its strengthening by the requirement of crossing symmetry for generalized formfactors. The theorem extends properties which were previously seen in d=1+1 factorizing models.