[Background] Small watershed management aiming at the prevention of soil erosion has a long history in China. After 30 years of exploration and practices on the comprehensive management of soil erosion using small watershed as a unit, a set of management system including management notion and governance measures suitable for specialized situation in China has been gradually earned, and great achievements with significantly ecological, social and economic benefits have been acquired. [Methods] Since 1980s, China has taken comprehensive measures on millions of watersheds covering 380,000 km2. However, with the socioeconomic development and increasing needs of people on environmental quality, some issues emerged in the comprehensive management of small watershed, including management notions and objectives cannot meet the demand of the public, the mechanism of management is not complete, and the fund input should be improved urgently, et al. [Results] In the new era, small watershed management cannot only be limited to the original ideological framework, based on the inheritance of management experience, it is revitalized by adding new connotation according to the national economic and social development, and then it better serves for people with the increasing needs of living, production and environment. [Conclusions] In the current management of small watershed, we should focus on the needs of local people, design proper prevention system based on local condition, and gradually adjust governance contents, measures and objectives; moreover, we should improve the funding input and management systems, and build the related laws and regulations to adapt to the continuing development of our society.