We hung up because we just had nothing to talk about. And because I was "being quiet" after he brought up topics and then dismissed them without actually finishing the conversation, which continues to annoy me...
But... still. I don't know. I don't know that it makes him uncomfortable, anymore, so much as annoys him. He has no reason to be particularly uncomfortable that I know of, unlike me...