In order to rehabilitate the vegetation of the abandoned quarry at the eastern foot of the northern section of Taihang Mountain, we analyzed 14 indicators in terms of topography, vegetation and soil, and determined the main impact factors that affect vegetation recovery, by using correlation analysis, principal component analysis and clustering analysis. The site types of the abandoned quarry were divided and their quality was evaluated. The results showed that soil nutrient content, soil layer thickness and topography feature were the main factors restricting the vegetation restoration in the study area as well as the important factors to assess the condition of a waste site in the studied quarry area. Based on field investigation and the results of principal component analysis and clustering analysis, the abandoned quarry in the study area was divided into eight site types. According to the site quality evaluation, the sample sites were divided into four categories, namely, site with good conditions (the overall score was greater than 24), site with slightly poor conditions (the overall score was between 20 and 24), site with poor conditions (the overall score was between 18 and 20) and site with very poor conditions (the overall score was less than 18). Finally, some suggestions for vegetation restoration were put forward in accordance with the site conditions.