Monica Landoni

Evaluation of digital libraries

Digital libraries (DLs) are new and innovative information systems, under constant development and change, and therefore evaluation is of critical importance to ensure not only their correct evolution but also their acceptance by the user and application communities. The Evaluation activity of the DELOS Network of Excellence has performed a large-scale survey of current DL evaluation activities. This study has resulted in a description of the state of the art in the field, which is presented in this paper. The paper also proposes a new framework for the evaluation of DLs, as well as for recording, describing and analyzing the related research field. The framework includes a methodology for the classification of current evaluation procedures. The objective is to provide a set of flexible and adaptable guidelines for DL evaluation.

The WEB Book experiments in electronic textbook design

This paper describes a series of three evaluations of electronic textbooks on the Web, which focused on assessing how appearance and design can affect users’ sense of engagement and directness with the material. The EBONI Projects methodology for evaluating electronic textbooks is outlined and each experiment is described, together with an analysis of results. Finally, some recommendations for successful design are suggested, based on an analysis of all experimental data. These recommendations underline the main findings of the evaluations: that users want some features of paper books to be preserved in the electronic medium, while also preferring electronic text to be written in a scannable style.

Usability and impact of digital libraries : a review

Purpose - The main objective of this paper is to review work on the usability and impact of digital libraries. Design/methodology/approach - Work on the usability and impact of digital libraries is reviewed. Specific studies on the usability and impact of digital libraries in specific domains are also discussed in order to identify general and specific usability and impact measures. Findings - The usability studies reviewed in this paper show that a number of approaches have been used to assess usability. In addition to the technical aspects of digital library design (e.g. architecture, interfaces and search tools), there are a number of usability issues such as globalisation, localisation, language, culture issues, content and human information behaviour. Digital libraries should, however, be evaluated primarily with respect to their target users, applications and contexts. Research limitations/implications - Although a digital library evaluation study may have several objectives, ranging from the evaluation of its design and architecture to the evaluation of its usability and its impact on the target users, this paper focuses on usability and impact. Originality/value - This paper provides insights into the state-of-the art in relation to the usability and impact of digital libraries.

From the Visual book to the WEB book: the importance of design

This paper presents the results of two studies into electronic book production. The Visual book study explored the importance of the visual component of the book metaphor for the production of more effective electronic books, while the WEB book study took the findings of the Visual book and applied them to the production of books for publication on the World Wide Web (WWW). Both studies started from an assessment of which kinds of paper book are more suitable for translation into electronic form. Both also identified publications which are meant to be used for reference rather than those which are read sequentially, and usually in their entirety. This group includes scientific publications and textbooks which were both used as the target group for the Visual book and the WEB book experiments. In this paper we discuss the results of the two studies and how they could influence the design and production of more effective electronic books.

Uncertainty in information seeking and retrieval: A study in an academic environment

This research focuses specifically on uncertainty and information seeking in a digital environment. In this research we argue that different types of uncertainty are associated with the information seeking process and that, with the proliferation of new and different search tools, sources and channels, uncertainty, positive/desirable or negative/undesirable, continues to be a significant factor in the search process. Users may feel uncertain at any stage of the information search and retrieval process and uncertainty may remain even after completion of the process resulting in what may be called persistent uncertainty. An online questionnaire was used to collect data from users in the higher education sector. There were three parts to the questionnaire focusing on: information seeking activities, information seeking problems, and access to specific information channels or sources. Quantitative analysis was carried out on the data collected through the online questionnaire. A total of 668 responses were returned from the chosen user categories of academic staff, research staff and research students. This research has shown that there are some information seeking activities and information seeking problems that are the most common causes of uncertainty among significant number of users from different disciplines, age, gender, ICT skills, etc. This is also the case with respect to access to and use of specific information sources/channels, although the degrees of uncertainty in relation are relatively small. Possible implications of this study and further research issues are indicated.

The role of visual rhetoric in the design and production of electronic books: the visual book

This paper starts from the observation that the appearance of information contributes to its overall value and that, because there are many ways to represent information, it is very important to find the model which is going to be the most effective and conveys the greatest value of the original information. Appearance has always played a key role in the learning process, as it facilitates the discovery of new concepts by allowing visual association with those which are already familiar. This is why metaphors are so important in learning in general, and have therefore proved to be a valuable tool for designing alternative paradigms when adapting traditional tasks to novel environments. This paper will briefly discuss the link between paper books and their electronic counterparts. It will then focus on the role of metaphors in producing electronic books and introduce and discuss the importance of the visual rhetoric concept in driving the design process. Finally it will also present the main results of the visual book experiment and how these results can be interpreted in the context of the visual rhetoric approach.

A User-Centred Approach to E-Book Design.

This paper considers the Electronic Books ON‐screen Interface (EBONI) Project’s research into the importance of the user when designing electronic textbooks. The results of the Visual Book and the WEB Book experiments, which explored design aspects of e‐books and provide a backdrop to EBONI’s research, are presented. EBONI’s methodology and evaluations, involving over 200 students, lecturers and researchers in UK Higher Education, are described, and the findings discussed. It is proposed that, while aspects of paper books such as tables of contents, indexes and typography should be retained, books delivered electronically should also adapt to fit the new medium through use of hypertext, search engines and multimedia. In terms of the design of e‐book hardware, issues such as size and weight, display technology and functionality are of primary importance to users. These findings have been presented to creators of educational digital content in the form of a set of Electronic Textbook Design Guidelines.

Evaluating Electronic Textbooks: A Methodology

EBONI (Electronic Books ON-screen Interface) [1] builds on the premise to emerge from the Visual Book [2] and WEB Book projects [3], that appearance is important in the design of electronic textbooks, and offers an evaluation model, or general methodology, from which ebook usability experiments in a range of areas can be extracted and remain comparable at a basic level. The methodology sets out options for selecting material, participants, tasks and techniques, which vary in cost and level of sophistication. Results from each study will feed into a set of best practice guidelines for producing electronic textbooks on the Web, reflecting the requirements of students and academics throughout the UK.

Appearance and functionality of electronic books

We present the results and the lessons learned from two separate and independent studies into the design, development, and evaluation of electronic books for information access: the Visual Book and the Hyper-TextBook. The Visual Book explored the importance of the visual component of the book metaphor in the production of “good” electronic books for referencing. The Hyper-TextBook concentrated on the importance of models and techniques for the automatic production of functional electronic versions of textbooks. Both studies started from similar considerations on what kinds of paper books are suitable for translation into electronic form but di.er on the prominence given to book appearance and functionalities. The results of these two research projects are critically presented in this paper, with the aim of helping designers and implementers to better integrate appearance and functional aspects of books into a more general methodology for the automatic production of electronic books for information access.

E‐book reading groups: interacting with e‐books in public libraries

– The purpose of this paper is to describe an experiment in introducing fiction e‐books in two reading groups run by a public library., – A user study involving two reading groups run over a period of three months. Electronic versions of titles of interest to each group were given out to each participant on Personal Digital Assistants (PDAs). Readers were then asked to fill in a satisfaction questionnaire and discuss their experience with the rest of their group., – Readers were not too negative about using a new tool/gadget like the PDA but they did not see any advantage in reading an electronic version of the selected book., – It was realised quite earlier on that the target readers were emotionally so attached to physical books to feel as if they were betraying them when reading them electronically. A different sample of users more inclined to use technology and more open to different publishing models would have possibly provided a better insight., – The group reading approach introduced a social side to the adoption of e‐books and it was hoped that that would have made a difference. It was also one of the first attempts to look into the use of fiction e‐books in public libraries as opposed to an already existing number of studies looking into e‐books and their use in education and academic libraries. As such it can benefit both publishers and librarians.