I would think that, in the challenge, his toughness would just be 3, given that there is no ambiguity whatsoever as to wound allocation. The challenge is essentially treated as an entirely separate combat for all intents and purposes.
Because otherwise it would be INSANE.
(also: "duking")