Alberto Baccini

Interlocking Editorship: A Network Analysis of the Links between Economic Journals

The exploratory analysis developed in this paper relies on the hypothesis that each editor possesses some power in the definition of the editorial policy of her journal. Consequently if the same scholar sits on the board of editors of two journals, those journals could have some common elements in their editorial policies. The proximity of the editorial policies of two scientific journals can be assessed by the number of common editors sitting on their boards. A database of all editors of ECONLIT journals is used. The structure of the network generated by interlocking editorship is explored by applying the instruments of network analysis. Evidence has been found of a compact network containing different components. This is interpreted as the result of a plurality of perspectives about the appropriate methods for the investigation of problems and the construction of theories within the domain of economics.

Statistical Analysis of the Hirsch Index

The Hirsch index (commonly referred to as h-index) is a bibliometric indicator which is widely recognized as effective for measuring the scientific production of a scholar since it summarizes size and impact of the research output. In a formal setting, the h-index is actually an empirical functional of the distribution of the citation counts received by the scholar. Under this approach, the asymptotic theory for the empirical h-index has been recently exploited when the citation counts follow a continuous distribution and, in particular, variance estimation has been considered for the Pareto-type and the Weibull-type distribution families. However, in bibliometric applications, citation counts display a distribution supported by the integers. Thus, we provide general properties for the empirical h-index under the small- and large-sample settings. In addition, we also introduce consistent nonparametric variance estimation, which allows for the implemention of large-sample set estimation for the theoretical h-index.

Handbook of Bibliometric Indicators: Quantitative Tools for Studying and Evaluating Research

Description: At last, the first systematic guide to the growing jungle of citation indices and other bibliometric indicators. Written with the aim of providing a complete and unbiased overview of all available statistical measures for scientific productivity, the core of this reference is an alphabetical dictionary of indices and other algorithms used to evaluate the importance and impact of researchers and their institutions. In 150 major articles, the authors describe all indices in strictly mathematical terms without passing judgement on their relative merit. From widely used measures, such as the journal impact factor or the h–index, to highly specialized indices, all indicators currently in use in the sciences and humanities are described, and their application explained. The introductory section and the appendix contain a wealth of valuable supporting information on data sources, tools and techniques for bibliometric and scientometric analysis – for individual researchers as well as their funders and publishers.

Parameter Estimation for the Discrete Stable Family

The discrete stable family constitutes an interesting two-parameter model of distributions on the non-negative integers with a Paretian tail. The practical use of the discrete stable distribution is inhibited by the lack of an explicit expression for its probability function. Moreover, the distribution does not possess moments of any order. Therefore, the usual tools—such as the maximum-likelihood method or even the moment method—are not feasible for parameter estimation. However, the probability generating function of the discrete stable distribution is available in a simple form. Hence, we initially explore the application of some existing estimation procedures based on the empirical probability generating function. Subsequently, we propose a new estimation method by minimizing a suitable weighted L 2-distance between the empirical and the theoretical probability generating functions. In addition, we provide a goodness-of-fit statistic based on the same distance.

F. Y. Edgeworth's Treatise on Probabilities

Probability theory has a central role in Edgeworth’s thought; this paper examines the philosophical foundation of the theory. Starting from a frequentist position, Edgeworth introduced some innovations on the definition of primitive probabilities. He distinguished between primitive probabilities based on experience of statistical evidence, and primitive a priori probabilities based on a more general and less precise kind of experience, inherited by the human race through evolution. Given primitive probabilities, no other devices than the rules of calculus are necessary to infer complex probabilities, as the ones defined by Bayes’s theorem –an enlargement of the frequentist tradition as defined by Venn. The notion of probability is objective; the passage from this objective sphere to the epistemic one requires rules external to the theory of probability. Edgeworth distinguishes between two notions: credibility which is the direct translation of probability into the epistemic sphere, and obeys the same rules of the latter; and belief having a weak relation with probability, based as it it not only on experiential knowledge, but also on “instinct and sentiment”. According to a Nineteenth century tradition, belief is the base of human action; Edgeworth concludes therefore that probability is not useful for the theory of decision. We propose to classify Edgeworth’s theory of probability as precursor of modern eclectic or pluralistic tradition on probability, and according to which probability has an irreducible dualistic nature.

Statistical inference on the h-index with an application to top-scientist performance

Despite the huge amount of literature concerning the h-index, few papers have been devoted to its statistical analysis when a probabilistic distribution is assumed for citation counts. The present contribution mainly aims to divulge the inferential techniques recently introduced by Pratelli et al. (2012), by explaining the details for proper point and set estimation of the theoretical h-index. Moreover, some new achievements on simultaneous inference – addressed to produce suitable scholar comparisons – are carried out. Finally, the analysis of the citation dataset for the Nobel Laureates (in the last five years) and for the Fields medallists (from 2002 onward) is considered in order to exemplify the theoretical issues.

Reply to the comment of Bertocchi et al.

The aim of this note is to reply to Bertocchi et al.’s comment to our paper “Do they agree? Bibliometric evaluation versus informed peer review in the Italian research assessment exercise”. Our paper analyzed results of the experiment conducted by the Italian governmental agency ANVUR during the research assessment exercise about the agreement between informed peer review (IR) and bibliometrics. We argued that according to available statistical guidelines, results of the experiment are indicative of a poor agreement in all research fields with only one exception, results reached in the so called Area 13 (economics and statistics). We argued that this difference was due to the changes introduced in Area 13 with respect to the protocol adopted in all the other areas. Bertocchi et al.’s comment dismiss our explanation and suggest that the difference was due to “differences in the evaluation processes between Area 13 and other areas”. In addition, they state that all our five claims about Area 13 experiment protocol “are either incorrect or not based on any evidence”. Based on textual evidence drawn from ANVUR official reports, we show that: (1) none of the four differences listed by Bertocchi et al. is peculiar of Area 13; (2) their five arguments contesting our claims about the experiment protocol are all contradicted by official records of the experiment itself.

Italian Economic Journals - A Network-Based Ranking and an Exploratory Analysis of Their Influence on Setting International Professional Standards

An exploratory analysis of the crossed presence (interlocking editorship) of the same scholars in the editorial boards of Italian and international economic journals is developed. The position and the degree of integration of Italian journals in the worldwide network of economic journals is studied with network analysis techniques and a ranking of Italian journals, based on a measure of centrality, is proposed. Then relatively compact groups of international journals are individuated, representing different specialized subfield or different methodological approaches to the study of economics. The analysis of the relative position of Italian journals in those groups suggests that Italian journals are not connected to the cores of the various schools operating at an international level, with the only exception of the history of economic thought.

Is Technological Change Really Skill Biased? Evidence from the Introduction of ICTs on the Textile Sector (1980-2000)

This paper investigates the effects of the introduction of information and communication technologies (ICTs) on the skills of a workforce. Using micro-data collected from workers in the textile sector, we analyse whether the introduction of ICTs has modified workers’ tasks, so that higher skills and longer training periods than before are necessary. Our survey has shown that ICTs i) have replaced unskilled labour in some cases and skilled labour in others; ii) have changed workers’ tasks in some cases but not in others; and finally, iii) have brought about an increase in skills for only a small number of occupations. This empirical evidence does not confirm the hypothesis that technological change, and in particular change introduced by ICTs, is necessarily skill biased

University ranking methodologies. An interview with Ben Sowter about the Quacquarelli Symonds World University Ranking

University rankings represent a controversial issue in the debate about higher education policy. One of the best known university ranking is the Quacquarelli Symonds World University Rankings (QS), published annually since 2004 by Quacquarelli Symonds ltd, a company founded in 1990 and headquartered in London. QS provides a ranking based on a score calculated by weighting six different indicators. The 2015 edition, published in October 2015, introduced major methodological innovations and, as a consequence, many universities worldwide underwent major changes of their scores and ranks. Ben Sowter, head of division of intelligence unit of Quacquarelli Symonds, responds to 15 questions about the new QS methodology.