從網際網路上定位及檢索所需要的資訊是一重要的問題。目前所存在的搜尋引擎給予過多無用且重複的資訊。由於搜尋的架構隨著搜尋引擎的不同而不同，對於所有的主題，要找到一個合適的搜尋機制是非常困難的。在本論文中，我們提出了一套基因規劃網際網路搜尋系統，可以根據使用者的興趣而自動產生查詢句。此系統可以從搜尋引擎上檢索資訊，並將搜尋結果過濾中去掉重複性與無用的資訊，然後結果將以單一的使用者介面呈現給使用者。而實驗的結果使用本系統所得的查詢結果比起由隨機來產生查詢句所得的查詢結果，與使用者興趣的相似度獲得改善。

To locate and to retrieve the needed information from the Internet is an important issue. Existing search engines may give too much useless and redundancy information. Due to the search feature is different for different search engines, it’s very difficult to find an optimal search scheme for all subjects. In this paper, we propose a genetic programming web search system (GPWS) to generate exact query according to a user’s interests. The system can retrieve the information from the search engines, filter the retrieved results and remove the redundancy and useless results. The filtered results are displayed on a uniform user interface. Compared with the queries generated by randomly, the degree of similarity of results and user’s interests are improved.

Contents
1. Introduction 1
2. Background Materials and Literature Reviews 3
2.1 Background Materials 3
2.1.1 Information Retrieval Technology 4
2.1.2 Genetic Programming 5
2.2 Literature Reviews 6
2.2.1 Web Search Engine 6
2.2.2 Web Search Using Genetic Algorithm 7
3. The Genetic Programming Web Search System Framework 9
3.1 Query Model 10
3.2 Genetic Programming Web Search System Architecture 11
3.2.1 The Web Subsystem 11
3.2.2 The Genetic Programming Subsystem 12
3.3 The Genetic Programming Algorithm 16
3.3.1 Definition of Genetic Programming Algorithm 16
3.3.2 The Genetic Programming Algorithm 18
4. Experimental Results 24
5. Conclusions 34
References 35

[1] Z. Z. Nick and P. Themis, “Web Search Using a Genetic Algorithm,” Journal of IEEE Internet Computing, pp. 18-26, 2001.
[2] S. Aggarwal, F. Hung, and W. Meng, “WIRE--- A WWW-based Information Retrieval and Extraction System,” Proceedings of the Ninth International Workshop on Database and Expert Systems Applications, pp. 887–892,1998.
[3] C. Faloutsos and D. Oard, “A Survey Of Information Retrieval and Filtering Methods,” Iniversity Of Maryland college Park CS-TR-3514, 1995. Also available at Http://www.enee.umd.edt/medlab/filter/papers/survey.ps
[4] T. K. Shih, “Agent Communication Network-A Mobile Agent Computation Model fro Internet Applications,” Proceedings of the IEEE International Symposium on Computers and Communications, pp. 425-431, 1999.
[5] X. H. Zhang, H. Y. Wang, and H. Zhao, “An Autonomous System-based Distribution System for Web Search,” Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Vol. 1, pp. 435-440, 2001.
[6] K. L. Hung, “Design and Construction of Learning Purchasing Agent on the Internet,” Proceedings of the National Computer Symposium, Vol. 1, pp. 97-102, 2001.
[7] L. M. Stephens and M. N. Huhns, “Consensus Ontologies- Reconciling the Semantics of Web pages and Agents,” IEEE Internet Computing, Vol. 5, Issue 5, pp. 92-95, 2001.
[8] M. Brameier and W. Banzhaf, “A Comparison of Linear Genetic Programming and Neural Networks in Medical Data Mining,” IEEE Transactions on Evolutionary Computation, Vol. 5, No.1, 2001.

[9] R. Jain and F. Anjum, “Mobile Agents for Personalized Information Retrieval: When Are They A Good Idea?” Proceedings of Wireless Communications and Networking Conference, Vol.1, pp. 242–245, 2000.
[10] S. Murugesan, “Intelligent Agents on the Internet and Web,” Proceedings of the IEEE International Conference on Global Connectivity in Energy, Computer, Communication and Control, Vol. 1, pp. 97-102, 1998.
[11] J. R. Koza, Genetic Programming, 3rd Printing, MIT press, 1993.
[12] X. Li, and W. B. Croft, “Evaluating Question-Answering Techniques in Chinese,” Proceedings of HLT 2001, pp. 201-206, 2001.
[13] D. Lawrie, W. B. Croft, A. Rosenberg, “Finding Topic Words for Hierarchical Summarization,” Proceedings of SIGIR 01 conference, pp. 349-357, 2001.
[14] I. H. Witten, A. Moffat, and T. C. Bell, Managing Gigabytes- Compressing and Indexing Documents and Images, 2nd Edition, Morgan Kaufmann Publishers, 1999.
[15] M. R. Henzinger, “Hyperlink Analysis for the Web,” IEEE Internet Computing, Vol. 5, Issue 1, pp. 45-50, 2001.
[16] B. G. Silverman, M. Bachann, and K. AI-Akharas “Do What I Mean: Online Shopping with a Natural Language Search Agent,” IT Professional, Vol. 16, Issue 4, pp. 48-53, 2001.
[17] J. Williams and R. Starzl, “Tuning up the Search Engine,” IEEE Internet Computing, Vol. 3, Issue 3, pp. 60-62, 2001.
[18] V. Thong, P. J. Moreno, B. Logan, B. Fidler, K. Maffey, and M. Moores, “Speechbot: an Experimental Speech-based Search Engine for Multimedia Content on the Web,” IEEE Transactions on Multimedia, Vol. 4, Issue 1, pp. 88-96, 2002.
[19] R. Jain, F. Anjum, and A. Umar, “A Comparison of Mobile Agent and Client-Server Paradigms for Information Retrieval Task in Virtual Enterprises,” Proceedings of Academia/Industry Working Conference, pp. 209 –213, 2000.
[20] S. Papastavrou, G. Samaras, and E. Pitoura, “Mobile Agents for World Wide Web Distributed Database Access,” IEEE Transactions on Knowledge and Data Engineering, Vol.12, Issue: 5, pp. 802–820, 2000.
[21] P. Bellavista, A. Corradi, and C. Stefanelli, “Mobile Agent Middleware for Mobile Computing,” Computer, Vol. 34, Issue: 3, pp. 73–81, 2001.
[22] C. W. Chiang, “A Skeleton Supporting Group Collaboration, Load Distribution, and Fault Tolerance for Internet-based Computing,” Doctorial Thesis Of National Sun Yat-Sen University Taiwan, ROC, 2001.
[23] S. Wu and C. C. Liao “Virtual Proxy Servers for WWW and Intelligent Agents on the Internet,” Proceedings of the Thirtieth Hwaii International Conference on System Sciences, Vol. 4, pp. 200-209, 1997.
[24] M. R. Henzinger, “On Near-Uniform URL sampling,” Proceedings of the Ninth International World Wide Web Conference, pp. 295-308, 2000.