In the chart below, the inch measurements are the size of the sweater you would want, which is usually a few inches more than your own chest size, depending on how close or loose a fit you like.
One way to gauge the fit you want is by measuring a sweater which fits you the way you like. Lay it flat, measure it across the chest from underarm to underarm, and double that measurement (to get the sweater circumference).