数据时代网络爬虫的内部管理型规制

网络爬虫作为数据时代一种被普遍应用的自动化数据收集技术,有着独特功能和价值。目前爬虫行为失范却对现有法律制度适用及网络空间秩序产生了严峻挑战,亟需在反思现有网络爬虫规范体系不足的基础上,引入内部管理型规制以回应网络爬虫规制的现实需求。基于网络爬虫的技术逻辑,内部管理型规制适用有行为限定、内容延展和效力涵摄面向,且功能多元。由于内部管理型规制兼有行政规制与自我规制的双重因素,因而可以上述两种规制方式为基点,对网络爬虫内部管理型规制进行横向和纵向的体系化构建。横向体系化构建应明确所涉主体形态、权义结构和责任内容;而纵向体系化构建应包括标准制定、组织建制、守法监督和执行反馈。

Management-based Regulation of Web Crawler in the Data Age

As a widely used automated data collection technology in the data age,web crawler have its unique functions and values.The current anomie of web crawler has created severe challenges to the application of the existing legal system and the order of cyberspace.It is urgent to introduce management-based regulation to respond to the actual needs of web crawler regulation on the basis of rethinking the insufficiency of the existing web crawler normative system.Based on the technical logic of web crawler,management-based regulation are applicable to behavior limitation,content extension and effectiveness coverage,and have multiple functions.Since management-based regulation have dual characteristics of administrative regulation and self-regulation,the above two regulations can be used as the basis to systematically construct the management-based regulation of web crawler both in a horizontal and vertical way.The horizontal system construction should clarify the subject form,the right and obligation structure and the responsibility content;while the vertical system construction should include standard formulation,organizational structure,law-abiding supervision and implementation feedback.