The ground-based laser heterodyne radiometer (LHR), which exhibits the advantages of small size, high spectral resolution, and easy integration, has been used for the remote sensing detection of several gases to meet a wide range of needs. This study aims to optimize the laser heterodyne system for detecting CO2 gas by focusing on existing research. Firstly, using the all-fiber laser heterodyne detection system built by our research group, the power spectrum associated with the radio frequency signals of the detection system is discussed under different conditions: under no irradiation, under sunlight only, under sunlight and laser irradiation at the absorption peak, and under a filter in the spectrum range of 185–270 MHz. Signal-to-noise ratios (SNRs) of the high-resolution spectrum have been obtained using different filter bands of 185–270, 225–270, and 225–400 MHz. Finally, the filter in the 225–270 MHz band, which has the highest SNR, is selected. Consequently, the resolution is improved and the system is further optimized. Furthermore, an optical fiber attenuator is used to change the power of the local oscillator light entering the system, and hyperspectral spectra with varying percentages of input energy and total energy are obtained. When the laser attenuation reaches 40%, the optimal SNR of the system is 486 and can be further improved to meet the expected requirements. This study will provide insights for improving the applicability of laser heterodyne technology in atmospheric sounding. © 2023 Wiley Periodicals LLC.