What do the time references next to the confidence level and in the peer section indicate?

They indicate the time elapsed from the moment the question was asked until the other action "answer", "peer comment" took place. The times shown are measured in relation to moment the question was asked.