The visual environment changes at multiple timescales. It has been recently demonstrated that visual adaptation is composed of multiple mechanisms operating at differing timescales to accommodate the environmental changes. However, whether multiple adaptation mechanisms correspond to different stages of visual processing remains unclear. To address this issue, in the current study, we compared the timescales of adaptation between the stages of early and mid-level visual processing by tracking the decay of the curvature aftereffect after adaptation to either a compound stimulus or a component stimulus. The results revealed a slower decay for the compound adaptation condition than for the component adaptation condition. Our finding indicates that neural mechanisms for visual adaptation are more sluggish at the mid level than those at the early stage of visual processing.