An investigation focused on the transformation and distribution behaviors of trace elements and natural radionuclides around a coal gangue brick plant was conducted. Simultaneous sampling of coal gangue, brick, fly ash and flue gas were implemented. Soil, soybean and earthworm samples around the brick plant were also collected for comprehensive ecological assessment. During the firing process, trace elements were released and redistributed in the brick, fly ash and the flue gas. Elements can be divided into two groups according to their releasing characteristics, high volatile elements (release ratio higher than 30%) are represented by Cd, Cu, Hg, Pb, Se and Sn, which emitted mainly in flue gas that would travel and deposit at the northeast and southwest direction around the brick plant. Cadmium, Ni and Pb are bio-accumulated in the soybean grown on the study area, which indicates potential health impacts in case of human consumption. The high activity of natural radionuclides in the atmosphere around the plant as well as in the made-up bricks will increase the health risk of respiratory system.