WHY THERE IS A NEED TO EVALUATE INFORMATION RETRIEVAL SYSTEM

Why there is a need to evaluate Information Retrieval System
prior to the application?

Title: Evaluating Information Retrieval Systems parallel with evaluating image processing techniques in medicine
Author: Milliers, H. 2003
Publisher: Division of Medical informatics-- University of Geneva
URL: http:\\www.efmi-ws-mip.net/documents

Title: Evaluation of Information Retrieval Systems. Introduction to Modern Information Retrieval System, 13 (243-255).
Author: Chowdhury, G.G. (2001)
Publisher: Library Association

ABSTRACT:

Evaluation is absolutely necessary in all research to show progress and to have arguments for the use of certain program or technology.
There are some complexities in pursuing information retrieval system because more people are needed to be involved in the evaluation and ; the evaluation does not just have to focus on the technical proof or technical aspects o the system but also on the effects of the human factors in the process.

In the evaluation process it is essential to verify if the system is build correctly and if it will satisfy its purpose on the organization or institution that will utilize it; and as well as, knowing whether the system satisfies the users or not about the outcome of its search and retrieval functions.

THINGS THAT I HAVE LEARNED:

It is important in any institution to have an effective and efficient information retrieval system-- an IRS that will truly fulfill the objectives of the organization, satisfies the needs of clienteles.

Evaluation of information retrieval system is very important, and this has to be done regularly in order for the organization to have a grasp of the possible or existing problem of the system prior to its application, hence through the tests conducted and evaluation, they could develop plan on how they could minimize the effect of the problem. Or even re-think its performance and cost-effectiveness or efficiency before they implement its application.

Moreover, since information retrieval system performance effectiveness and efficiency is something immeasurable, at the verge of evaluating the system, is important to not only focus on the technicalities related of the system but also on the existing influences of the human factors, specifically the role of the system's end user.

IMPLICATIONS OF WHAT I HAVE LEARNED

I realized that my role as an information service provider is crucial when it comes to providing an effective- efficiency information retrieval system. It is my responsibility to think of a way on how I can make the information on my collection accessible and usable for the users.

Now, considering the fact that not all institutions are prepared for adapting or even implementing an information retrieval system, our skills as information professionals are always put into test. It is our sole responsibility (especially for those one-man librarians – information specialist) to provide a simple retrieval system (for the meantime) to be able to have at least a retrieval system for our institution’s library collection.

Bearing in mind the essence and demand for timeless access to information, we sometimes dared to stick on devising only from what is the available resources we have (although we know that these resources would not suffice the needed support for the system that we are doing), just for us to immediately respond the clientele information needs.

On my part, I opted to devise a simple retrieval system, since my institution immediately necessitates a retrieval system (that will respond to their fast-phased information needs on media materials), in which later I found unsatisfactory because the system application inadequacies became a hindrance to the extensiveness of information that i should have provided for my clienteles.

Hence through this experience, I have seen the importance of a constant evaluation of IR system to be able to know the existing inadequacies, and immediately develop a plan on how to improve the system. Taking also into consideration that, prior to the application of the system, it is better that we have at least a contingency plan so that we will be able to respond immediately to the unexpected fall backs of the system.

We should be able to set what evaluation criteria we will be using for us to know immediately if that particular system fulfills our institution’s objectives, and purposes as retrieval system--- provided that we know the purpose of our system evaluation.

With set criteria, we are certain that we know what areas we need to evaluate, and who will be the people involve in the evaluation of this system----- of course, it should not only be the institution’s management but most importantly, also the end-users of information.

For librarians involve in creating the retrieval system, it is our responsibility to provide appropriate and uniform indexed terms for our collection that will be later used as retrieval points for the user search. Hence, the relevance of the documents retrieve will also depend on how we index the documents/ materials in our collections to make its information retrievable. And on the stage of client searching, we should exercise our roles in providing search assistance, at least provide guidance on familiarizing the clienteles on how the system works to ease their trouble in searching, and also actually observe if the interface or systems application is something that they can easily understood, thus, help minimize the user-cost.

Amidst the existing cost factors, in the end, what ever is the outcome of the IR system evaluation prior to application, it is our responsibility as information professionals to strive for the improvement and the implementation of this IR system in our institutions ( with the hope of gaining support from them, provided that we supplied proper justifications for the importance of this IRS) so we could adequately serve our clientele community.

Boolean and Modern Info. Retrieval

MODERN INFORMATION RETRIEVAL-Inside a Computer: How it Works?Critique on: Boolean Search and Retrieval


Title: Computerized information searching. How to find information in science and technology. 4, 51-71.
Author: Lambert, J. & Lambert, P. (1991)
Publisher: Library Association

Title: Searching and Retrieval. Introduction to Modern Retrieval System. 4, 170-191
Author: Chowdhury, G. G. (2001)
Publisher: Library Association

Title of Article: Beyond recall and Precision: From System – Oriented to User- Oriented Evaluation
Author: Hersh, William (retrieved June 26 ’08)
URL: http://davinci.ohsu.edu/~hersh/user-studies.pdf

Title: Information Technology. 2006 Board Review for Librarians, 6-10.
Author: Esposo, S. S. (2006)
Publisher: Institute of Library and Information Science

ABSTRACT:

The process of searching starts with the user’s construction of his/her query statement based on his/her search topic and then narrow it down into concepts. But prior to the searching process, user should have at least idea on the measures to be taken during the search process. And then during the input of search query (keywords are determined, and Boolean operators are use on the search query), all symbols, images and other details are converted into binary digits (0s and 1s) in order for it be understood and processed by the computer. Query statements that are gathered are converted and instructed in a computer through the input devices, and then the data are processed and manipulated in the CPU which controls the other parts of the computer systems while the microprocessor speeds up the process and retrieval of the information.

Once query statement is entered into the system, the computer is then instructed to find all the references in the database about the search concept. The Boolean operators play an important role during the search process.; it in the coordination of the search concepts----- with user’s familiarity of the keyword synonyms and use the Boolean operators the number of relevant document retrieved varies, it depends on how the search statement is being constructed. The results now can be too narrow or too broad, it could focus solely on one concept excluding the other concept (NOT logic), could retrieve all relevant concepts (AND logic), or relevant documents on either of the two concepts (OR logic). In an online based system, the search processing involves several communication devices that allow the transfer of information searched from one network to another; these communication devices are also the one responsible for connecting on databases that matches the concept being searched through host computers. The search results are then translated into language that human can understand, as output, and viewed through computer screens, printers, and other output devices.

3 THINGS I LEARNED:

The things that I learned from what I have read:

First, knowledge of the effective search strategy is a must for a researcher. And knowing at least the basics of Boolean operators is a great advantage, and could help minimize the cost of searching. Second, although the Boolean searching is widely used on most computer- based system it still has its limitations especially with regard to the relevance of retrieve references---some of the retrieved references are not relevant to the user; and at the end of the search process its still the users that decides which material among the retrieved relevant by the system are said to be relevant on his/her evaluation. Lastly, in some cases that although the user is familiar with the Boolean operators, his/her understanding about the concept of his/her research is still the major influencing factor of the retrieval result since the user is the one providing the key concepts, and the Boolean operators functions only as connectors that coordinates the concepts provided by the users.

IMPLICATIONS OF THE NEW THINGS I LEARNED:

It is important for information specialist like to at least have knowledge in Boolean operators which will definitely help me in adapting with the modern retrieval system. Familiarity with the Boolean operators and key concepts of data searching will be a great advantage for someone working on a library (like me) to immediately assist library clienteles on doing web-based research, and other computer based systems. It can limit the time cost needed for just searching for relevant references. But of course, prior to the search process I should know the details of the client information need to be able to apply a more effective search strategy.