跳到主要导航 跳到搜索 跳到主要内容

Offensive and defensive strategy of web crawler

  • Yuanshu Jiang*
  • , Wenzhong Tang
  • , Liyong Guo
  • *此作品的通讯作者
  • Beihang University

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Crawling strategies of web crawler affect not only the quality of search engine, but also the working status of web server. Many web servers restrict the access of unknown crawler or the crawler with excessive visiting frequency. This paper analyzes these restrictions and proposes a strategy of proxybased, login by simulating verification code automatically; give some guidance on the design of web crawler.

源语言英语
主期刊名WCICA 2012 - Proceedings of the 10th World Congress on Intelligent Control and Automation
355-358
页数4
DOI
出版状态已出版 - 2012
活动10th World Congress on Intelligent Control and Automation, WCICA 2012 - Beijing, 中国
期限: 6 7月 20128 7月 2012

出版系列

姓名Proceedings of the World Congress on Intelligent Control and Automation (WCICA)

会议

会议10th World Congress on Intelligent Control and Automation, WCICA 2012
国家/地区中国
Beijing
时期6/07/128/07/12

学术指纹

探究 'Offensive and defensive strategy of web crawler' 的科研主题。它们共同构成独一无二的学术指纹。

引用此