Well, but we're not talking about the chained scabbard... that could have been added later.
We're talking about the dagger himself. I think you can clearly see that Himmler is wearing such dagger. So mu conclusion is that they did exist.