The normal tracing angle measurement system based on Risley prisms can eliminate the influence of aberrations other than the dispersion of Risley prisms on the angle measurement accuracy. Although the traditional dispersion optimization method based on the extreme point can make the beam directions of different wavelengths more consistent after passing through the Risley prisms, the light intensity distribution that deviates from the extreme point wavelength causes the spot centroid to deviate from the target position, thus introducing the angle measurement error. In this paper, we propose a highly symmetry-glued achromatic Risley prisms optimization method for the needs of a normal tracing angle measurement system. Our method not only realizes the beam direction as closely as possible after the deflection of the Risley prisms but also compensates for the centroid error caused by the beam deviating from the central wavelength. ZEMAX simulation shows that, in the normal tracing angle measurement system, within the angle measurement range of ±700 ^″ and the light source wavelength range of 600 to 700 nm, the angle measurement error introduced by the dispersion of the optimized Risley prisms is not >0.01 ^″ .