Using content-based and link-based analysis in building vertical search engines

Michael Chau; Hsinchun Chen

doi:10.1007/978-3-540-30544-6_3

Using content-based and link-based analysis in building vertical search engines

Michael Chau
, Hsinchun Chen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

5 Scopus citations

Abstract

This paper reports our research in the Web page filtering process in specialized search engine development. We propose a machine-learning-based approach that combines Web content analysis and Web structure analysis. Instead of a bag of words, each Web page is represented by a set of content-based and link-based features, which can be used as the input for various machine learning algorithms. The proposed approach was implemented using both a feedforward/backpropagation neural network and a support vector machine. An evaluation study was conducted and showed that the proposed approaches performed better than the benchmark approaches.

Original language	English (US)
Title of host publication	Digital Libraries
Subtitle of host publication	International Collaboration and Cross-Fertilization - 7th International Conference on Asian Digital Libraries, ICADL 2004
Editors	Qihao Miao, Ee-peng Lim, Zhaoneng Chen, Yuxi Fu, Hsinchun Chen, Edward Fox
Publisher	Springer-Verlag
Pages	515-518
Number of pages	4
ISBN (Print)	9783540240303
DOIs	https://doi.org/10.1007/978-3-540-30544-6_3
State	Published - 2005
Event	7th International Conference on Asian Digital Libraries, ICADL 2004 - Shanghai, China Duration: Dec 13 2004 → Dec 17 2004

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	3334 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	7th International Conference on Asian Digital Libraries, ICADL 2004
Country/Territory	China
City	Shanghai
Period	12/13/04 → 12/17/04

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-540-30544-6_3

Cite this

Chau, M., & Chen, H. (2005). Using content-based and link-based analysis in building vertical search engines. In Q. Miao, E. Lim, Z. Chen, Y. Fu, H. Chen, & E. Fox (Eds.), Digital Libraries: International Collaboration and Cross-Fertilization - 7th International Conference on Asian Digital Libraries, ICADL 2004 (pp. 515-518). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3334 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-540-30544-6_3

Using content-based and link-based analysis in building vertical search engines. / Chau, Michael; Chen, Hsinchun.
Digital Libraries: International Collaboration and Cross-Fertilization - 7th International Conference on Asian Digital Libraries, ICADL 2004. ed. / Qihao Miao; Ee-peng Lim; Zhaoneng Chen; Yuxi Fu; Hsinchun Chen; Edward Fox. Springer-Verlag, 2005. p. 515-518 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3334 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chau, M & Chen, H 2005, Using content-based and link-based analysis in building vertical search engines. in Q Miao, E Lim, Z Chen, Y Fu, H Chen & E Fox (eds), Digital Libraries: International Collaboration and Cross-Fertilization - 7th International Conference on Asian Digital Libraries, ICADL 2004. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3334 LNCS, Springer-Verlag, pp. 515-518, 7th International Conference on Asian Digital Libraries, ICADL 2004, Shanghai, China, 12/13/04. https://doi.org/10.1007/978-3-540-30544-6_3

Chau M, Chen H. Using content-based and link-based analysis in building vertical search engines. In Miao Q, Lim E, Chen Z, Fu Y, Chen H, Fox E, editors, Digital Libraries: International Collaboration and Cross-Fertilization - 7th International Conference on Asian Digital Libraries, ICADL 2004. Springer-Verlag. 2005. p. 515-518. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-540-30544-6_3

Chau, Michael ; Chen, Hsinchun. / Using content-based and link-based analysis in building vertical search engines. Digital Libraries: International Collaboration and Cross-Fertilization - 7th International Conference on Asian Digital Libraries, ICADL 2004. editor / Qihao Miao ; Ee-peng Lim ; Zhaoneng Chen ; Yuxi Fu ; Hsinchun Chen ; Edward Fox. Springer-Verlag, 2005. pp. 515-518 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{204ebf8b1eb34f708cdbe05f3252fa1b,

title = "Using content-based and link-based analysis in building vertical search engines",

abstract = "This paper reports our research in the Web page filtering process in specialized search engine development. We propose a machine-learning-based approach that combines Web content analysis and Web structure analysis. Instead of a bag of words, each Web page is represented by a set of content-based and link-based features, which can be used as the input for various machine learning algorithms. The proposed approach was implemented using both a feedforward/backpropagation neural network and a support vector machine. An evaluation study was conducted and showed that the proposed approaches performed better than the benchmark approaches.",

author = "Michael Chau and Hsinchun Chen",

note = "Funding Information: This project has been supported in part by the following grants: NSF Digital Library Initiative-2, “High-performance Digital Library Systems: From Information Retrieval to Knowledge Management” (IIS-9817473, Apr 1999-Mar 2002), NIH/NLM Grant (PI: H. Chen), “UMLS Enhanced Dynamic Agents to Manage Medical Knowledge” (1 R01 LM06919-1A1, Feb 2001-Jan 2004), and HKU Seed Funding for Basic Research, “Using Content and Link Analysis in Developing Domain-specific Web Search Engines: A Machine Learning Approach” (Feb 2004-Jul 2005). We also thank the medical experts who participated in the user studies. Publisher Copyright: {\textcopyright} Springer-Verlag Berlin Heidelberg 2004.; 7th International Conference on Asian Digital Libraries, ICADL 2004 ; Conference date: 13-12-2004 Through 17-12-2004",

year = "2005",

doi = "10.1007/978-3-540-30544-6\_3",

language = "English (US)",

isbn = "9783540240303",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer-Verlag",

pages = "515--518",

editor = "Qihao Miao and Ee-peng Lim and Zhaoneng Chen and Yuxi Fu and Hsinchun Chen and Edward Fox",

booktitle = "Digital Libraries",

}

TY - GEN

T1 - Using content-based and link-based analysis in building vertical search engines

AU - Chau, Michael

AU - Chen, Hsinchun

N1 - Funding Information: This project has been supported in part by the following grants: NSF Digital Library Initiative-2, “High-performance Digital Library Systems: From Information Retrieval to Knowledge Management” (IIS-9817473, Apr 1999-Mar 2002), NIH/NLM Grant (PI: H. Chen), “UMLS Enhanced Dynamic Agents to Manage Medical Knowledge” (1 R01 LM06919-1A1, Feb 2001-Jan 2004), and HKU Seed Funding for Basic Research, “Using Content and Link Analysis in Developing Domain-specific Web Search Engines: A Machine Learning Approach” (Feb 2004-Jul 2005). We also thank the medical experts who participated in the user studies. Publisher Copyright: © Springer-Verlag Berlin Heidelberg 2004.

PY - 2005

Y1 - 2005

N2 - This paper reports our research in the Web page filtering process in specialized search engine development. We propose a machine-learning-based approach that combines Web content analysis and Web structure analysis. Instead of a bag of words, each Web page is represented by a set of content-based and link-based features, which can be used as the input for various machine learning algorithms. The proposed approach was implemented using both a feedforward/backpropagation neural network and a support vector machine. An evaluation study was conducted and showed that the proposed approaches performed better than the benchmark approaches.

AB - This paper reports our research in the Web page filtering process in specialized search engine development. We propose a machine-learning-based approach that combines Web content analysis and Web structure analysis. Instead of a bag of words, each Web page is represented by a set of content-based and link-based features, which can be used as the input for various machine learning algorithms. The proposed approach was implemented using both a feedforward/backpropagation neural network and a support vector machine. An evaluation study was conducted and showed that the proposed approaches performed better than the benchmark approaches.

UR - https://www.scopus.com/pages/publications/35048817047

UR - https://www.scopus.com/pages/publications/35048817047#tab=citedBy

U2 - 10.1007/978-3-540-30544-6_3

DO - 10.1007/978-3-540-30544-6_3

M3 - Conference contribution

AN - SCOPUS:35048817047

SN - 9783540240303

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 515

EP - 518

BT - Digital Libraries

A2 - Miao, Qihao

A2 - Lim, Ee-peng

A2 - Chen, Zhaoneng

A2 - Fu, Yuxi

A2 - Chen, Hsinchun

A2 - Fox, Edward

PB - Springer-Verlag

T2 - 7th International Conference on Asian Digital Libraries, ICADL 2004

Y2 - 13 December 2004 through 17 December 2004

ER -

Using content-based and link-based analysis in building vertical search engines

Abstract

Publication series

Conference

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this