Weeds bring severe threats to agricultural production and most traditional herbicides cause serious pollution to the environment. Caffeic acid is a potential allelochemical of many crops. To develop novel herbicides, a series of trans-caffeic acid analogues were prepared to evaluate their growth inhibition on S. viridis and investigate structure-activity relationships. Presence of hydroxyl groups on the benzene ring greatly reduced the phytotoxicity of analogues and the double bond seemed not to be necessary. Moreover, it was found that halogenated cinnamic acid analogues showed potent inhibitory activity. 4-Fluorocinnamic acid (4-FCA) displayed the strongest growth inhibition in a concentration-dependent manner, whereas it induced significantly weaker inhibition on wheat. This selectivity could help us to develop a novel herbicide. Exposure of S. viridis to 4-FCA increased levels of H2O2 and catalase (CAT) in roots, suggesting that the inhibitory effect of 4-FCA might be related to oxidative stress. Thus, we have found an active lead compound for a novel herbicide derived from crop allelochemicals, which may help in the development of new environmentally safe herbicides.