Each Doctor's performance had strengths and weaknesses. There are two ratings for Baker given how dramatically different his performance is between when he started and when he left. While Baker put more emphasis on comedy in the latter half of his run, he was funnier when his eccentric humour broke real dramatic tension. Without that juxtaposition, it's just Baker hamming it up on set.
The early and the late era Doctors from the original show I saw the least of, so take it all with a grain of salt.