Eti Herman

Peer review: still king in the digital age

The article presents one of the main findings of an international study of 4,000 academic researchers that examined how trustworthiness is determined in the digital environment when it comes to scholarly reading, citing, and publishing. The study shows that peer review is still the most trustworthy characteristic of all. There is, though, a common perception that open access journals are not peer reviewed or do not have proper peer‐review systems. Researchers appear to have moved inexorably from a print‐based system to a digital system, but it has not significantly changed the way they decide what to trust. They do not trust social media. Only a minority – although significantly mostly young and early career researchers – thought that social media are anything other than more appropriate to personal interactions and peripheral to their professional/academic lives. There are other significant differences, according to the age of the researcher. Thus, in regard to choosing an outlet for publication of their work, young researchers are much less concerned with the fact that it is peer reviewed.

Trust and Authority in Scholarly Communications in the Light of the Digital Transition: setting the scene for a major study

The paper provides the results of the first phase of the research project Trust and Authority in Scholarly Communications in the Light of the Digital Transition. It provides for an examination of the behaviours and attitudes of academic researchers as producers and consumers of scholarly information resources in the digital era in respect to how they determine authority and trustworthiness in the sources they use, cite, and publish in. The first phase of the study utilized focus groups to formulate research questions for the project as a whole. It provided the direction for the literature review, interviews, and questionnaires studies that would follow. Fourteen focus groups were held in the UK and US in order to obtain this information. A total of 66 science and social science researchers participated. The main findings were: (a) researchers play down difficulties of establishing trustworthiness, not because there are none, but because they have well‐developed methods of establishing trust; (b) citation‐derived metrics are becoming more important in regard to where researchers publish; (c) social media are ancillary to research, but are used for promotion of research and idea generation; (d) researchers are suspicious and confused about open access, but less so if produced by a traditional publisher; (e) there was a uniformity of perceptions/behaviour of researchers irrespective of differences in subject, country, and age; (f) although some early career researchers behave the same as their more senior colleagues this is because of a fear of the system: they actually think differently.

Where and how early career researchers find scholarly information

This article presents findings from the first year of the Harbingers research project started in 2015. The project is a 3‐year longitudinal study of early career researchers (ECRs) to ascertain their current and changing habits with regard to information searching, use, sharing, and publication. The study recruited 116 researchers from seven countries (UK, USA, China, France, Malaysia, Poland, and Spain) and performed in‐depth interviews by telephone, Skype, or face‐to‐face to discover behaviours and opinions. This paper reports on findings regarding discovery and access to scholarly information. Findings confirm the universal popularity of Google/Google Scholar. Library platforms and web‐scale discovery services are largely unmentioned and unnoticed by this user community, although many ECRs pass through them unknowingly on the way to authenticated use of their other preferred sources, such as Web of Science. ECRs are conscious of the benefits of open access in delivering free access to papers. Social media are widely used as a source of discovering scholarly information. ResearchGate is popular and on the rise in all countries surveyed. Smartphones have become a regularly used platform on which to perform quick and occasional searches for scholarly information but are only rarely used for reading full text.

Trustworthiness and authority of scholarly information in a digital age: Results of an international questionnaire

An international survey of over 3,600 researchers examined how trustworthiness and quality are determined for making decisions on scholarly reading, citing, and publishing and how scholars perceive changes in trust with new forms of scholarly communication. Although differences in determining trustworthiness and authority of scholarly resources exist among age groups and fields of study, traditional methods and criteria remain important across the board. Peer review is considered the most important factor for determining the quality and trustworthiness of research. Researchers continue to read abstracts, check content for sound arguments and credible data, and rely on journal rankings when deciding whether to trust scholarly resources in reading, citing, or publishing. Social media outlets and open access publications are still often not trusted, although many researchers believe that open access has positive implications for research, especially if the open access journals are peer reviewed.

ResearchGate: Reputation uncovered

ResearchGate (RG) is a scholarly social network that possesses an impressive array of reputational metrics and has the potential to supplant publishers as the prime deliverer of scholarly reputation. It possesses 10 reputational mechanisms, and these are the subject of an evaluation employing desk research, expert evaluation, and an analysis of 400 RG members. The main conclusions are: RG (1) provides a rich, albeit confusing, amount of reputational data; (2) struggles with the deployment of alternative, engagement metrics, such as Q&A and follower data, which can lead to reputational anomalies; (3) employs usage data in an especially effective manner; and (4) leads the field in the way it engages with the scholar.

Changes in the digital scholarly environment and issues of trust

Digital transition had resulted in changes in researcher behaviour.It is now easier for scientists to discover and disseminate research.The way scientists exercise trust has not changed.Metrics are less important than experience and personal recommendation. The paper reports on some of the results of a research project into how changes in digital behaviour and services impacts on concepts of trust and authority held by researchers in the sciences and social sciences in the UK and the USA. Interviews were used in conjunction with a group of focus groups to establish the form and topic of questions put to a larger international sample in an online questionnaire. The results of these 87 interviews were analysed to determine whether or not attitudes have indeed changed in terms of sources of information used, citation behaviour in choosing references, and in dissemination practices. It was found that there was marked continuity in attitudes though an increased emphasis on personal judgement over established and new metrics. Journals (or books in some disciplines) were more highly respected than other sources and still the vehicle for formal scholarly communication. The interviews confirmed that though an open access model did not in most cases lead to mistrust of a journal, a substantial number of researchers were worried about the approaches from what are called predatory OA journals. Established researchers did not on the whole use social media in their professional lives but a question about outreach revealed that it was recognised as effective in reaching a wider audience. There was a remarkable similarity in practice across research attitudes in all the disciplines covered and in both the countries where interviews were held.

Early career researchers: Scholarly behaviour and the prospect of change

Early career researchers (ECRs) are of great interest because they are the new (and biggest) wave of researchers. They merit long and detailed investigation, and towards this end, this overarching paper provides a summary of the first‐year findings of a 3‐year, longitudinal study of 116 science and social science ECRs who have published nearly 1,200 papers and come from 7 countries and 81 universities. ECRs were interviewed in their own languages face‐to‐face, by Skype, or telephone. The study focused on the attitudes and behaviours of ECRs with respect to scholarly communications and the extent to which they are adopting new and disruptive technologies, such as social media, online communities, and Open Science. The main findings include: publishing in high‐impact factor journals is the only reputational game in town; online scholarly communities, and ResearchGate in particular, are gaining ground; social media are beginning to have an impact, especially in the dissemination arena; outreach activities have become more important; libraries are becoming increasingly invisible to ECRs; Open Science is not gaining traction; and more transformational ideas are being expressed, especially in the US and UK.

Early career researchers and their publishing and authorship practices

This study presents findings from the first year of the Harbingers research project, a 3‐year longitudinal study of early career researchers (ECRs), which sought to ascertain current and changing habits in scholarly communication. The study recruited 116 science and social science ECRs from seven countries who were subject to in‐depth interviews, and this paper reports on findings regarding publishing and authorship practices and attitudes. A major objective was to determine whether ECRs are taking the myriad opportunities proffered by new digital innovations, developing within the context of open science, open access, and social media, to publish their research. The main finding is that these opportunities are generally not taken because ECRs are constrained by convention and the precarious employment environment they inhabit and know what is best for them, which is to publish (in high impact factor journals) or perish.

Peer review: The experience and views of early career researchers

This paper presents selected findings from the first year of a 3‐year longitudinal study of early career researchers (ECRs), which sought to ascertain current and changing habits in scholarly communication. Specifically, the aims of the paper are to show: (1) how much experience and knowledge ECRs had of peer review – both as authors and as reviewers; (2) what they felt the benefits were and what suggestions they had for improvement; (3) what they thought of open peer review (OPR); and (4) who they felt should organize peer review. Data were obtained from 116 science and social science ECRs, most of whom had published and were subject to in‐depth interviews conducted face‐to‐face, via Skype, or over the telephone. An extensive literature review was also conducted to provide a context and supplementary data for the findings. The main findings were that: (1) most ECRS are well informed about peer review and generally like the experience, largely because of the learning experiences obtained; (2) they like blind double‐peer review, but would like some improvements, especially with regards to reviewer quality; (3) most are uncomfortable with the idea of OPR; and (4) most would like publishers to continue organizing peer review because of their perceived independence.

Do Younger Researchers Assess Trustworthiness Differently when Deciding what to Read and Cite and where to Publish

An international survey of over 3600 academic researchers examined how trustworthiness is determined when making decisions on scholarly reading, citing, and publishing in the digital age and whether social media and open access publications are having an impact on judgements. In general, the study found that traditional scholarly methods and criteria remain important across the board. However, there are significant differences between younger (age 30 & under) and older researchers (over 30). Thus younger researchers: a) expend less effort to obtain information and more likely to compromise on quality in their selections; b) view open access publishing much more positively as it offers them more choices and helps to establish their reputation more quickly; c) compensate for their lack of experience by relying more heavily on trust markers and proxies, such as impact factors; d) use all the outlets available in order to improve the chances of getting their work published and, in this respect, make the most use of the social media with which they are more familiar.