Graham Coulson

The JISC User Behaviour Monitoring and Evaluation Framework

Describes key aspects of the methodology and outcomes of the JISC User Behaviour Monitoring and Evaluation Framework in its first three annual cycles (1999‐2002). The Framework was initiated to assure the JISC that their investment in digital content and network infrastructure facilitates use and learning, and to identify barriers and facilitators to the use of electronic information services (EIS). Key Framework outcomes are: a multi‐dimensional across sector methodology for the continued monitoring of user behaviour in respect of EIS and the factors that impact on that behaviour; a profile of user behaviour in respect of EIS over the three annual cycles of the Framework; the EIS Diagnostic Toolkit that can be used to benchmark development in the provision and use of EIS in specific disciplines or at specific institutions; a methodology for monitoring, and a profile of the EIS resources available to higher and further education users; and a summary of some of the key issues in their provision. The challenge for the future is the embedding of EIS in curricula and learning experiences.

Providing access to electronic information resources in further education

This article aims to provide a baseline for future studies on the provision and support for the use of digital or electronic information services (EIS) in further education. The analysis presented is based on a multi-level model of access, which encompasses access to and availability of information and communication technology (ICT) resources, access to and availability of EIS resources, and the third leg of staff skills and their development. The research was conducted within the third cycle of the JISC (Joint Information Services Committee) User Behaviour Monitoring and Evaluation Framework, in 2001/2002. Evidence was gathered from library and information service web sites and various stakeholders, including library and information service staff, academic staff and students to generate insights into the provision of access to EIS in further education. Sector-wide funding initiatives have had a significant impact on ICT infrastructures, and these attract a positive response from students. EIS are represented on some library web sites but both web site development and EIS availability is very much less advanced than in higher education. Staff, however, lack sufficient dedicated access to ICT to be able to develop their own skills and use. There remains a low level of access to electronic information resources, with only limited access to these resources through library web sites. LIS managers face a number of challenges in enhancing this provision, including licensing arrangements, tight budgets that need to be spread across many discipline areas, and the absence of EIS designed specifically for the further education student. The other key challenge lies in the provision of time and opportunity for academic and LIS staff to develop their ICT and EIS skills, and, more generally in the further development of the role of Information and Learning Technology (ILT) Champions.

The need for a converged approach to EIS provision? Evidence from the JUBILEE project

This paper reports and reflects upon a number of the findings and issues emerging from evidence collated to date as part of JUBILEE (Joint Information Systems Committee (JISC) user behaviour in information seeking: longitudinal evaluation of electronic information services), a significant, ongoing UK research project. The evidence is largely based on analysis and interpretation of the qualitative data from the research, with discussion focusing on information seeking behaviour and information skills in relation to electronic information sources. The background and aims of the research are outlined, succeeded by an exploration of the differing types of information technology (IT) skills needed by users to ensure effective use of electronic information services (EIS). Finally, extrapolating from the research data, there is consideration as to how these IT skills can be effectively developed in the higher education environment. Referring back to the title of this paper, a stress is placed on the importance of a converged, “joined up” approach to EIS provision.

The impact of the JUBILEE Toolkit in institutions

Scope of paper. Through a discussion of the processes employed with case studies participating in the research project this paper will reflect upon JUBILEEs development of its EIS improvement Toolkit, and its experience of integrating the JUBILEE Toolkit into the research process. Evidence of both the strengths and limitations of the use of Toolkit themes in research and practice will be highlighted, and the potential improvements to EIS provision of such collaboration between practitioners and research staff outlined.

Evaluation, impact and outcomes – the JUBILEE project

The paper is based on a presentation made at Northumbria Lite, the one‐day session held by the Northumbria Performance Measures Conference series team at IFLA in Glasgow, August 2002, on the invitation of the IFLA Statistics and Library Theory and Research Roundtables. It has been supplemented with some up‐dated figures and graphs. Dr Linda Banwell, Director of the JUBILEE project, gave the presentation, which focuses on evaluation in JUBILEE, with specific reference to the derivation and representation of impact and outcomes for library services.

Using the JUBILEE Toolkit to Bridge the Research-Practice Divide

The focus of the paper is on the use of a toolkit to bridge the divide between research and practice. The JUBILEE project (JISC User Behaviour in Information seeking: Longitudinal Evaluation of Electronic Information Services (EIS)) is being funded by the UK JISC (Joint Information Systems Committee) to: • improve the understanding of information behaviour in relation to EIS in a variety of disciplines and organisational contexts, and • develop an evaluation toolkit for use by Higher and Further Education managers to guide and benchmark their own institutions development in relation to the adoption of EIS. The ongoing development and use of the JUBILEE toolkit is described, with examples. It is argued that the toolkit brings structure and coherence for both researchers and participating practitioners alike, and thereby does indeed bridge the divide between research and practice.

Accessing electronic information in UK further education: Findings from JUBILEE in FE, a JLSC‐funded research project

The further education sector has been exposed to many changes during the last decade, including the development of a National Information and Technology structure, an increasing emphasis on ‘lifelong learning’, ‘key skills’, collaboration and regional planning, changes in funding arrangements and growth in student numbers and wider participation. Growing emphasis on the use of Electronic Information Services (EIS) in teaching is forcing academic staff to acquire and expand their ICT and information literacy skills. In the course of this paper some of the main barriers and impediments faced by academic staff in the present climate are discussed as identified by the JUBILEE research. These included access to technology, staff attitudes and skill levels and the focus of available EIS. Enabling access to EIS has emerged as a pivotal aim and the research found that through the implementation of an informed EIS strategy, effective communication and awareness raising, tailored user training programmes, and embedding EIS into the curriculum, the ability of users to access and use EIS effectively is enhanced. The necessity for further education institutions to succeed in this aim is vital given that, in an increasingly digital world of information, access is the key.

Bidding for records: local authority archives and competitive funding

If competition, in the form of Compulsory Competitive Tendering or the Local Management of Schools, for example, was a key feature of the so-called new public management of local government in the 1980s, competitive bidding for funds would in turn become a characteristic of the public service managerialism of the 1990s. Resource allocation by competition has become a reality of contemporary public policy. The decade saw the introduction of many such schemes, the best known in the field of urban policy perhaps being initiatives such as TEC Challenge or the Local Initiative Fund (1991), City Challenge (1991), the Single Regeneration Budget (1994), Estates Renewal Challenge (1995) and Capital Challenge (1996), to mention only a handful of examples. The advantages of allocating funds in response to competitive bids, rather than by traditional methodologies revolving around census-derived statistical indicators of ‘need’, were deemed to include less bureaucracy, cost savings, better value for money, more innovative, enterprising and imaginative proposals, sharper strategies, greater flexibility, more local choice and enhanced responsiveness as well as greater policy integration through partnership. Critics, on the other hand, pointed to finite and diminishing resource bases, the substitution of core funding with opportunistic funding, the large financial and human costs of bidding, fragmentation, and the distorting allocative and distributional effects of sexy bids, glossy submissions and slick presentations succeeding at the expense of genuine indicators of local need. Local authority archive, library and museum services have not been insulated from these developments. Indeed, some of the earliest challenge fund initiatives such as the National Heritage Memorial Fund (1980), The Arts Pairing Scheme (1984) and the Heritage Lottery Fund (HLF, 1994) all addressed aspects of heritage provision. Over recent years, funding from a diverse range of bodies such as the Department for Bidding for Records: local authority archives and competitive funding

Securing funding in the local government bidding culture: are records sufficiently ‘sexy’ to succeed?

This paper presents some of the findings from research into the effects that the emergent bidding culture has had on the development of English local government archive, library and museum services. The project was funded by Resource and undertaken by the Information Management Research Institute at the University of Northumbria at Newcastle. The research revealed that the extent of involvement by archives and record management services in competitive bidding for external funds was dependent on a number of factors including the level of existing resource bases of archive services; the geographical and cognitive locations of archives; and the focus of external funding opportunities. However, the need for archives and records management services to engage in effective bidding is not likely to disappear, and it is suggested that these organisations must adopt a dynamic approach to bidding and marketing, asserting that their needs – ‘sexy’ or otherwise – deserve appropriate funding.