The responsibility system of archival work is the requirement of the times to administer archives according to law under the background of modernization of archival management, and is the institutional guarantee for the high-quality development of archival undertakings. The establishment and implementation of the responsibility system of archival work is conducive to improving the archival work system, and solving the practical problems such as unclear rights and responsibilities and poor coordination of the multi-governance subjects of archival work. On the basis of constructing the framework of the archival work responsibility system, this study adopts the qualitative research method to clarify the influencing factors of the archival work responsibility system. The research shows that the factors affecting the construction and implementation of the responsibility system of archival work mainly include four dimensions: the organization of the responsibility system, the characteristics of the responsibility system, the environment of the responsibility system and the subject of the responsibility system, and specific suggestions are put forward to promote the construction of the responsibility system of archival work.