The first few chapters of

ET Jaynes: 'Probability Theory: The Logic of Science': http://bayes.wustl.edu/etj/prob/book.pdf

Are great (and free) as a thorough introduction to bayesian reasoning.