ITPub博客

首页 > Linux操作系统 > Linux操作系统 > Extracting Structured Data from Web Pages

Extracting Structured Data from Web Pages

原创 Linux操作系统 作者:knowlesys 时间:2008-06-10 10:11:15 0 删除 编辑

Keywords: Automatic Data Extraction

 

Many web sites contain large sets of pages generated using a common template or layout. For example, Amazon lays out the author, title, comments, etc. in the same way in all its book pages. The values used to generate the pages (e.g., the author, title,...) typically come from a database. In this paper, we study the problem of automatically extracting the database values from the web pages without any learning examples or other similar human input. We formally define the notion of a template, and propose a model that describes how values are encoded into pages using a template. We present an extraction algorithm that uses sets of words that have similar occurrence pattern in the input pages, to construct the template. The constructed template is then used to extract values from the pages. We show experimentally that the extracted values make semantic sense in most cases.

 For more information, please visit our website: http://www.knowlesys.com

来自 “ ITPUB博客 ” ,链接:https://blog.itpub.net/14387573/viewspace-343224/ ,如需转载,请注明出处,否则将追究法律责任。

下一篇: Web2DB Services
请登录后发表评论 登录
全部评论

注册时间:2008-05-30

  • 博文量
    14
  • 访问量
    10635