One of the challenges of modern information retrieval is to rank the most relevant documents at the top of the large system output. This calls for choosing the proper methods to evaluate the system performance. The traditional performance measures, such as precision and recall, are based on binary relevance judgment and are not appropriate for multi-grade relevance. The main objective of this paper is to propose a framework for system evaluation based on user preference of documents. It is shown that the notion of user preference is general and flexible for formally denying and interpreting multi-grade relevance. We review 12 evaluation methods and compare their similarities and differences. We find that the normalized distance performance measure is a good choice in terms of the sensitivity to document rank order and gives higher credits to systems for their ability to retrieve highly relevant documents. This study introduces the design and implementation of WAP based information retrieval system, WBIRS.
TABLE OF CONTENT
TITLE PAGE
CERTIFICATION
APPROVAL
DEDICATION
ACKNOWLEDGEMENT
ABSTRACT
ORGANIZATION OF WORK
TABLE OF CONTENT
TITLE PAGE
CERTIFICATION
APPROVAL
DEDICATION
ACKNOWLEDGEMENT
ABSTRACT
ORGANIZATION OF WORK
TABLE OF CONTENT
CHAPTER ONE
1.0 INTRODUCTION
1.1 STATEMENT OF PROBLEM
1.2 AIMS AND OBJECTIVES
1.3 PURPOSE OF STUDY
1.4 SIGNIFICANT OF STUDY
1.5 SCOPE/DELIMITATIONS
1.6 LIMITATIONS/CONSTRAINTS
1.7 ASSUMPTION OF STUDY
1.8 DEFINITION OF TERMS
CHAPTER TWO
2.0 LITERATURE REVIEW
CHAPTER THREE
3.0 DESCRIPTION AND ANALYSIS OF THE EXISTING SYSTEM
3.1 FACT-FINDING METHOD/ METHODOLOGY
3.2 ORGANISATIONAL STRUCTURE/ORGANOGRAM
3.3 OBJECTIVES OF THE EXISTING SYSTEM
3.4 INPUT, PROCESS, AND OUTPUT ANALYSIS
3.4.1 INPUT ANALYSIS
3.4.2 PROCESS ANALYSIS
3,4.3 OUTPUT ANALYSIS
3.5 INFORMATION FLOW DIAGRAM
3.6 PROBLEMS OF THE EXISTING SYSTEM
3.7 JUSTIFICATION OF THE NEW SYSTEM
CHAPTER FOUR
4.0 DESIGN OF THE NEW SYSTEM
4.1 DESIGN STANDARD
4.2 OUTPUT SPECIFICATION AND DESIGN
4.3 INPUT SPECIFICATION AND DESIGN
4.3.1 FILE DESIGN
4.4 PROCEDURE CHART
4.5 SYSTEMS FLOWCHART
4.6 SYSTEM REQUIREMENTS
4.6.1 HARDWARE REQUIREMENTS
4.6.2 SOFTWARE REQUIREMENTS
4.6.3 OPERATIONAL REQUIREMENTS
4.6.4 PERSONNEL REQUIREMENTS
CHAPTER FIVE
5.0 IMPLEMENTATION
5.1 DESIGN STANDARD
5.2 PROGRAM DESIGN
5.2.1 PROGRAM FLOWCHART
5.2.2 PSEUDO CODE
5.3 CODING
5.4 TEST DATA/TEST RUN
5.5 USER TRAINING – AN OVERVIEW
5.6 CUTOVER PROCESS
CHAPTER SIX
6.0 DOCUMENTATION
6.1 THE USER DOCUMENTATION
6.2 THE PROGRAMMER DOCUMENTATION
CHAPTER SEVEN
7.0 RECOMMENDATIONS, SUMMARY AND CONCLUSION
7.1 RECOMMENDATION
7.2 SUMMARY
7.3 CONCLUSION
REFERENCES
BIBLIOGRAPHY
APPENDIX
SOURCE LISTING
LIST OF FIGURES
