download60 view187
twitter facebook

CC_BYThis item is licensed Creative Commons License

Title
Has Retrieval Technology in Vertical Site Search Systems Improved over the Years? A Holistic Evaluation for Real Web Systems
Author(s)
Thomas MandlChrista Womser-HackerNatalia Gätzke
Publisher
Korea Institute of Science and Technology Information
Publication Year
2015-12-30
Abstract
Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.
Keyword
Site Search; Information Retrieval; Evaluation
Journal Title
Journal of Information Science Theory and Practice
Citation Volume
3
ISSN
2287-4577
DOI
10.1633/JISTaP.2015.3.4.2
Files in This Item:
Thumbnail E1JSCH_2015_v3n4_19.pdf193.38 kBDownload
Appears in Collections:
8. KISTI 간행물 > JISTaP > Vol. 3 - No. 4
Type
Article
URI
https://repository.kisti.re.kr/handle/10580/9375
Export
RIS (EndNote)
XLS (Excel)
XML

Browse