While you raise a valid point, I think we should also be careful to not accidentally apply so-called "question substitution" here: whether or not his mind already was "warped" compared to the norm is a different question from whether or not it was warped before and did not warp any further.

To me it seems pretty difficult to argue that the time spent underground did not affect his mind, regardless of the state it was in before.