We know what the climate was like in the past by looking at layers in the earth, tree rings, even carbon dating can sometimes given evidence of how the composition of the atmosphere was in the past. There a lot of neat chemistry that we can use to learn what composition the atmosphere and climate had. Obviously there is some amount of error in models, but we do know.