WHY THERE IS A NEED TO EVALUATE INFORMATION RETRIEVAL SYSTEM

Why there is a need to evaluate Information Retrieval System
prior to the application?

Title: Evaluating Information Retrieval Systems parallel with evaluating image processing techniques in medicine
Author: Milliers, H. 2003
Publisher: Division of Medical informatics-- University of Geneva
URL: http:\\www.efmi-ws-mip.net/documents

Title: Evaluation of Information Retrieval Systems. Introduction to Modern Information Retrieval System, 13 (243-255).
Author: Chowdhury, G.G. (2001)
Publisher: Library Association

ABSTRACT:

Evaluation is absolutely necessary in all research to show progress and to have arguments for the use of certain program or technology.
There are some complexities in pursuing information retrieval system because more people are needed to be involved in the evaluation and ; the evaluation does not just have to focus on the technical proof or technical aspects o the system but also on the effects of the human factors in the process.

In the evaluation process it is essential to verify if the system is build correctly and if it will satisfy its purpose on the organization or institution that will utilize it; and as well as, knowing whether the system satisfies the users or not about the outcome of its search and retrieval functions.

THINGS THAT I HAVE LEARNED:

It is important in any institution to have an effective and efficient information retrieval system-- an IRS that will truly fulfill the objectives of the organization, satisfies the needs of clienteles.

Evaluation of information retrieval system is very important, and this has to be done regularly in order for the organization to have a grasp of the possible or existing problem of the system prior to its application, hence through the tests conducted and evaluation, they could develop plan on how they could minimize the effect of the problem. Or even re-think its performance and cost-effectiveness or efficiency before they implement its application.

Moreover, since information retrieval system performance effectiveness and efficiency is something immeasurable, at the verge of evaluating the system, is important to not only focus on the technicalities related of the system but also on the existing influences of the human factors, specifically the role of the system's end user.

IMPLICATIONS OF WHAT I HAVE LEARNED

I realized that my role as an information service provider is crucial when it comes to providing an effective- efficiency information retrieval system. It is my responsibility to think of a way on how I can make the information on my collection accessible and usable for the users.

Now, considering the fact that not all institutions are prepared for adapting or even implementing an information retrieval system, our skills as information professionals are always put into test. It is our sole responsibility (especially for those one-man librarians – information specialist) to provide a simple retrieval system (for the meantime) to be able to have at least a retrieval system for our institution’s library collection.

Bearing in mind the essence and demand for timeless access to information, we sometimes dared to stick on devising only from what is the available resources we have (although we know that these resources would not suffice the needed support for the system that we are doing), just for us to immediately respond the clientele information needs.

On my part, I opted to devise a simple retrieval system, since my institution immediately necessitates a retrieval system (that will respond to their fast-phased information needs on media materials), in which later I found unsatisfactory because the system application inadequacies became a hindrance to the extensiveness of information that i should have provided for my clienteles.

Hence through this experience, I have seen the importance of a constant evaluation of IR system to be able to know the existing inadequacies, and immediately develop a plan on how to improve the system. Taking also into consideration that, prior to the application of the system, it is better that we have at least a contingency plan so that we will be able to respond immediately to the unexpected fall backs of the system.

We should be able to set what evaluation criteria we will be using for us to know immediately if that particular system fulfills our institution’s objectives, and purposes as retrieval system--- provided that we know the purpose of our system evaluation.

With set criteria, we are certain that we know what areas we need to evaluate, and who will be the people involve in the evaluation of this system----- of course, it should not only be the institution’s management but most importantly, also the end-users of information.

For librarians involve in creating the retrieval system, it is our responsibility to provide appropriate and uniform indexed terms for our collection that will be later used as retrieval points for the user search. Hence, the relevance of the documents retrieve will also depend on how we index the documents/ materials in our collections to make its information retrievable. And on the stage of client searching, we should exercise our roles in providing search assistance, at least provide guidance on familiarizing the clienteles on how the system works to ease their trouble in searching, and also actually observe if the interface or systems application is something that they can easily understood, thus, help minimize the user-cost.

Amidst the existing cost factors, in the end, what ever is the outcome of the IR system evaluation prior to application, it is our responsibility as information professionals to strive for the improvement and the implementation of this IR system in our institutions ( with the hope of gaining support from them, provided that we supplied proper justifications for the importance of this IRS) so we could adequately serve our clientele community.