Dynamic Load Balancing Model: Preliminary Results for Parallel Pseudo-search Engine Indexers Crawler Mechanisms Using MPI and Genetic Programming
Created by W.Langdon from
gp-bibliography.bib Revision:1.8098
- @InProceedings{Walker:2001:DLB,
-
author = "Reginald L. Walker",
-
title = "Dynamic Load Balancing Model: Preliminary Results for
Parallel Pseudo-search Engine Indexers Crawler
Mechanisms Using {MPI} and Genetic Programming",
-
year = "2001",
-
booktitle = "4th International Conference on Vector and Parallel
Processing - VECPAR 2000. Selected Papers and Invited
Talks",
-
editor = "J. M. L. M. Palma and J. Dongarra and V. Hernandez",
-
volume = "1981",
-
series = "Lecture Notes in Computer Science",
-
pages = "61--74",
-
address = "Porto, Portugal",
-
month = "21-23 " # jun,
-
publisher = "Springer",
-
keywords = "genetic algorithms, genetic programming",
-
CODEN = "LNCSD9",
-
ISSN = "0302-9743",
-
bibdate = "Sat Feb 2 13:03:02 MST 2002",
-
DOI = "doi:10.1007/3-540-44942-6_5",
-
acknowledgement = ack-nhfb,
-
isbn13 = "978-3-540-41999-0",
-
abstract = "Methodologies derived from Genetic Programming (GP)
and Knowledge Discovery in Databases (KDD) were used in
the parallel implementation of the indexer simulator to
emulate the current World Wide Web (WWW) search engine
indexers. This indexer followed the indexing strategies
that were employed by AltaVista and Inktomi that index
each word in each Web document. The insights gained
from the initial implementation of this simulator have
resulted in the initial phase of the adaption of a
biological model. The biological model will offer a
basis for future developments associated with an
integrated Pseudo-Search Engine. The basic
characteristics exhibited by the model will be
translated so as to develop a model of an integrated
search engine using GP. The evolutionary processes
exhibited by this biological model will not only
provide mechanisms for the storage, processing, and
retrieval of valuable information but also for Web
crawlers, as well as for an advanced communication
system. The current Pseudo-Search Engine Indexer,
capable of organizing limited subsets of Web documents,
provides a foundation for the first simulator of this
model. Adaptation of the model for the refinement of
the Pseudo-Search Engine establishes order in the
inherent interactions between the indexer, crawler and
browser mechanisms by including the social
(hierarchical) structure and simulated behavior of this
complex system. The simulation of behavior will
engender mechanisms that are controlled and coordinated
in their various levels of complexity. This unique
model will also provide a foundation for an
evolutionary expansion of the search engine as WWW
documents continue to grow. The simulator results were
generated using Message Passing Interface (MPI) on a
network of SUN workstations and an IBM SP2 computer
system.",
- }
Genetic Programming entries for
Reginald L Walker
Citations