Clare Thornley

The scholarly impact of TRECVid (2003–2009)

This paper reports on an investigation into the scholarly impact of the TRECVid (Text Retrieval and Evaluation Conference, Video Retrieval Evaluation) benchmarking conferences between 2003 and 2009. The contribution of TRECVid to research in video retrieval is assessed by analyzing publication content to show the development of techniques and approaches over time and by analyzing publication impact through publication numbers and citation analysis. Popular conference and journal venues for TRECVid publications are identified in terms of number of citations received. For a selection of participants at different career stages, the relative importance of TRECVid publications in terms of citations vis a vis their other publications is investigated. TRECVid, as an evaluation conference, provides data on which research teams ‘scored’ highly against the evaluation criteria and the relationship between ‘top scoring’ teams at TRECVid and the ‘top scoring’ papers in terms of citations is analyzed. A strong relationship was found between ‘success’ at TRECVid and ‘success’ at citations both for high scoring and low scoring teams. The implications of the study in terms of the value of TRECVid as a research activity, and the value of bibliometric analysis as a research evaluation tool, are discussed.

A dialectical approach to information retrieval

Purpose – The purpose of this paper is to explore the question of whether the often paradoxical and conceptually contradictory discipline of information retrieval (IR) can be understood more clearly when it is analyzed from a dialectical perspective.Design/methodology/approach – Conceptual analysis and literature review.Findings – A dialectical understanding of meaning can assist in clarifying some aspects of the complex nature of current IR theory.Research limitations/implications – Philosophy has the potential to explore the conflicts and contradictions in IR and should not be used just as a means of synthesis and resolution. The use of the philosophy of meaning should include a broader understanding of the philosophical oppositions which lie behind the nature of meaning.Originality/value – This paper suggests a new perspective on the role of meaning in IR: the dialectical model.

The application of RFIDs in libraries: an assessment of technological, management and professional issues

This paper starts by outlining the technologies involved in RFIDs and reviews the issues raised by their general application. It then identifies their potential application areas within the library sector based on a generic process view of library activities. Finally it highlights the issues that are raised by their application in libraries and provides an assessment of which of these issues are likely to raise ethical concerns for library professionals. The purpose is to provide an overview of the technology within the context of the library process and to highlight issues which may raise ethical concerns for the profession. A second paper will focus specifically on these concerns within the context of the professional obligations of the librarian.

Changes in the digital scholarly environment and issues of trust

Digital transition had resulted in changes in researcher behaviour.It is now easier for scientists to discover and disseminate research.The way scientists exercise trust has not changed.Metrics are less important than experience and personal recommendation. The paper reports on some of the results of a research project into how changes in digital behaviour and services impacts on concepts of trust and authority held by researchers in the sciences and social sciences in the UK and the USA. Interviews were used in conjunction with a group of focus groups to establish the form and topic of questions put to a larger international sample in an online questionnaire. The results of these 87 interviews were analysed to determine whether or not attitudes have indeed changed in terms of sources of information used, citation behaviour in choosing references, and in dissemination practices. It was found that there was marked continuity in attitudes though an increased emphasis on personal judgement over established and new metrics. Journals (or books in some disciplines) were more highly respected than other sources and still the vehicle for formal scholarly communication. The interviews confirmed that though an open access model did not in most cases lead to mistrust of a journal, a substantial number of researchers were worried about the approaches from what are called predatory OA journals. Established researchers did not on the whole use social media in their professional lives but a question about outreach revealed that it was recognised as effective in reaching a wider audience. There was a remarkable similarity in practice across research attitudes in all the disciplines covered and in both the countries where interviews were held.

Do RFIDs (radio frequency identifier devices) provide new ethical dilemmas for librarians and information professionals

This paper provides an analysis of the current and potential ethical implications of RFID technology for the library and information professions. These issues are analysed as a series of ethical dilemmas, or hard-to-resolve competing ethical obligations, which the librarian has in relationship to information objects, library users and the wider social and political environment or state. A process model of the library is used as a framework for the discussion to illustrate the relationship between the different participants in the library system and it is argued that ethical analysis should involve the identification of future developments as well as current issues. The analysis shows that RFIDs do currently pose some dilemmas for librarians in terms of the conflicts between efficient service, privacy of users and an obligation to protect the safety of society as a whole, and that these are likely to become more problematic as the technology develops. This paper is part 2 of a series of papers on RFIDs and the library and information professions.

Meaning in philosophy and meaning in information retrieval (IR)

Purpose – The purpose of this paper is to explore the question of whether the differences between meaning in philosophy and meaning in information retrieval (IR) have implications for the use of philosophy in supporting research in IR.Design/methodology/approach – The approach takes the form of a conceptual analysis and literature review.Findings – There are some differences in the role of meaning in terms of purpose, content and use which should be clarified in order to assist a productive relationship between the philosophy of language and IR.Research limitations/implications – This provides some new theoretical insights into the philosophical context of IR. It suggests that further productive work on the central concepts within IR could be achieved through the use of a methodology which analyses how exactly these concepts are discussed in other disciplines and the implications of any differences in the way in which they may operate in IR.Originality/value – The paper suggests a new perspective on the r...

A bibliometric study of Video Retrieval Evaluation Benchmarking (TRECVid): A methodological analysis

This paper provides a discussion and analysis of methodological issues encountered during a scholarly impact and bibliometric study within the field of Computer Science (TRECVid Text Retrieval and Evaluation Conference, Video Retrieval Evaluation). The purpose of this paper is to provide a reflection and analysis of the methods used to provide useful information and guidance for those who may wish to undertake similar studies, and is of particular relevance for the academic disciplines which have publication and citation norms that may not perform well using traditional tools. Scopus and Google Scholar are discussed and a detailed comparison of the effects of different search methods and cleaning methods within and between these tools for subject and author analysis is provided. The additional database capabilities and usefulness of ‘Scopus More’ in addition to ‘Scopus General’ are discussed and evaluated. Scopus paper coverage is found to favourably compare with Google Scholar but Scholar consistently has superior performance at finding citations to those papers. These additional citations significantly increase the citation totals and also change the relative ranking of papers. Publish or Perish, a software wrapper for Google Scholar, is also examined and its limitations and some possible solutions are described. Data cleaning methods, including duplicate checks, expert domain checking of bibliographic data, and content checking of retrieved papers, are compared and their relative effects on paper and citation count discussed. Google Scholar and Scopus are also compared as tools for collecting bibliographic data for visualizations of developing trends and, owing to the comparative ease of collecting abstracts, Scopus is found far more effective.

How do libraries manage the ethical and privacy issues of RFID implementation? A qualitative investigation into the decision-making processes of ten libraries:

This paper explores how library managers go about implementing RFID (radio frequency identification) technology and particularly how associated privacy issues have been managed. The research methodology consisted of a literature review, theme identification, interview scheduling, interviews and interview analysis. The sample was 10 libraries or library networks and 18 participants. Findings covered the main drivers of RFID development, perceived benefits, tag data, data security, levels of ethical concern, public consultation, potential impact of technological developments on ethical issues, and managers’ sources of ethical decision making. Analysis of potential ethical issues was not found to be a central part of the process of implementing RFID technology in the libraries. The study sees RFID implementation as an informative example of current practice in the implementation of new technologies in libraries and suggests that we look at management structures and decision-making processes to clarify where responsibility for ethical considerations should lie.

Beyond codes of ethics

This paper reports on a research project that investigated how library and information (LIS) professionals experience ethical dilemmas, with particular reference to the impact of new technologies, sources used to assist ethical decision-making, and the contribution case studies can make to ethical understanding and decision-making. Data was collected through interviews in Britain, Ireland and Australia with LIS professionals, educators, and representatives of professional bodies. The findings identify the main types of dilemma raised and discuss cases indicative of each type. They suggest that new technologies do not appear to change ethical principles but, when experienced in the workplace, substantially change the factors the professional has to evaluate. They also suggest that relevant codes of ethics are satisfactory on traditional library issues of access and confidentiality, but do not address the ethical challenges of current and potential digital environments. Professional associations appear more familiar with codes of ethics than practitioners although practitioners show high levels of ethical awareness, suggesting associations need to communicate more with their members and provide tools that are more useful in the workplace. Case studies are seen as a good way to educate and engage practitioners because of the complexity, conflicts and dynamism they can present.

Business Innovation and Differentiation: Maturing the IT Capability

The IT Capability Maturity Framework (IT-CMF) is an action-oriented IT capability toolset that determines an organizations current and desired level of IT capability maturity, and supports planning for improvement. Through capability improvement initiatives, organizations can more easily realize sustainable advantages through IT-enabled business innovation and differentiation.