Ants-Review: a Protocol for Incentivized Open Peer-Reviews on Ethereum
AA NTS -R EVIEW : A P ROTOCOL FOR I NCENTIVIZED O PEN P EER -R EVIEWS ON E THEREUM
A P
REPRINT
Bianca Trovò ∗ Sorbonne UniversityFaculty of Science and EngineeringParis, France [email protected]
Nazzareno Massari
MakerDAOCommunity DevelopmentLondon, United Kingdom [email protected]
January 26, 2021 A BSTRACT
Peer-review is a necessary and essential quality control step for scientific publications but lacks properincentives. Indeed, the process, which is very costly in terms of time and intellectual investment, notonly is not remunerated by the journals but is also not openly recognized by the academic communityas a relevant scientific output for a researcher. Therefore, scientific dissemination is affected intimeliness, quality and fairness. Here, to solve this issue, we propose a blockchain-based incentivesystem that rewards scientists for peer-reviewing other scientists’ work and that builds up trust andreputation. We designed a privacy-oriented protocol of smart contracts called Ants-Review thatallows authors to issue a bounty for open anonymous peer-reviews on Ethereum. If requirements aremet, peer reviews will be accepted and paid by the approver proportionally to their assessed quality.To promote ethical behaviour and inclusiveness the system implements a gamified mechanism thatallows the whole community to evaluate the peer-reviews and vote for the best ones. K eywords Blockchain · Ethereum · Peer-review · Incentivization
Since the birth of Bitcoin [1] in 2008 as a peer-to-peer electronic cash system, blockchain technologies have spreadfar beyond the sole cryptocurrency domain, in particular after the implementation of general purpose smart contractsintroduced by Ethereum [2]. Besides a growing number of applications ranging from De-Fi, healthcare, music industry,government, identity, to cite but a few, blockchain technology has recently started to catalyse the attention of the scientificcommunity as well [3, 4] with the promising potential of being a ‘game changer’ in outdated and broken scientificpractices and leading towards open science [5]. Indeed, scholars have pointed out how the intrinsic characteristics ofblockchain technology set the basis for a open science infrastructure [6] in which decisional processes are transparentand therefore more democratically accessible to all the stakeholders (researchers, reviewers, funders, taxpayers). Thoseare: the consensus algorithm [7], a deterministic computational trust that allows for decentralization , for which thereare no trusted third parties; the proof of existence (PoE) that via cryptographic hashing and timestamping creates adigital footprint able to keep a traceable chronological record of research objects that cannot be altered or retrieved (dueto its property of immutability or append-only ) [6]. In particular, a ‘blockchainified science’ [8] could ‘reduce waste’[9], by disclosing each step in the research cycle to ‘scientific self-correction’ way before the final publication step, andtherefore help fixing the current reproducibility crisis in science.A thorny issue in the academic system that can - and we think it should - be tackled by blockchain concerns the statusand accreditation of peer review, the core process of scientific validation currently facing a crisis [10]. In this paper we ∗ Atomic Energy and Alternative Energies Commission (CEA), Frédéric Joliot Institute for Life Sciences, NeuroSpin, CognitiveNeuroimaging Unit, Saclay, France. a r X i v : . [ c s . D L ] J a n PREPRINT - J
ANUARY
26, 2021propose a solution to the problem of reviewers recognition based on the principles of tokenomics [11] and in line withthe values of open science.
Peer review is still the only quality control mechanism devoted to evaluating scientific outcomes. The purpose of peerreview is, to cite [10]: “improving the quality of the published paper, determining the originality of the manuscript,determining the importance of the findings, detecting fraud, and detecting plagiarism.”. However, the system is ‘flawed’and outdated [12] and presents multifaceted issues [13], here reviewed.
The main issues affecting the effectiveness of peer review is the delay between paper submission and journal acceptancefor publication. The traditional peer review process is centralized around the journals’ editor(s). The author(s) submitthe manuscript to the journal where an editorial team assesses if the paper meets the scopes of the journal and noveltycriteria. If the editorial decision is to send the manuscript for review, the handling editor personally selects potentialreviewers. The authors’ identity is usually known to the reviewer but the reviewers’ identity is hidden to the authorsor among the other reviewers themselves ( single-blind review ). Reviewers independently conduct their reviews byexposing in their reports strengths and weaknesses of the manuscript and sometimes substantially improving the draft.Depending on if the decision is a major or minor revision, authors are invited to re-submit a corrected or improvedversion of the manuscript. The same reviewers might be contacted again to continue the same peer review process. Thisprocess can take multiple rounds and is a huge time investment both for authors and reviewers. An analysis of all paperspublished in
PubMed for a time period of 30 years claims that the median review time is around 100 days [14].
Peer reviewing is an invisible activity purely conducted on voluntary basis, neither paid by the journals or officiallycredited via standard scientific metrics (such as the ones that establish the Impact Factor of an author). Thus, it doesnot lead to advancements in career or help securing grants. Researchers are motivated to do peer-review by a sense ofbelonging and a desire to ‘give back’ to the community [15]. A major consequence of not promoting incentives for thequality (and quantity) of peer reviews is to either slow down publication of potentially good research which awaits forvalidation [16] or let bad science be published through sloppy and uncritical reviews.
Due to the ‘publish or perish culture’ pressures, unethical behaviour from reviewers has been occasionally reported,from abusive behaviour towards authors [12, 17] to identity fraud. Some studies have reported an improvement in thetransparency and civility of the review process when open reports are released according to the standards of open peerreview [18].
Given the fact that anonymity is usually asymmetrically applied only for reviewers, many power related dynamics caninfluence the reviewers decision [19], such as gender or cultural discrimination and social prestige of the institution.To solve this problem some journals have implemented double-blind review process (the identity of both authors andreviewers are masked) which seems to reduce the bias towards minorities.
There is high variability in the reliability and depth of reviews and a recurrent question is: “Who watches the watchers?”[19].
There is a disproportion between the progressive increase in journal publications and the number of experiencedreviewers selected for the task which demands an expansion of the reviewer’s pool including early career scientists[17, 15].Some mild attempts to credit peer review have been handled without much success by journals via attribution of virtual2
PREPRINT - J
ANUARY
26, 2021‘badges’, certificates of performance, citation in annual editorials [19] where performance, though, is assessed only interms of quantity of reviews but not quality [15].Partnering with publishers, the startup
Publons provides a free metric service for tracking, verification and recognitionof publications, peer reviews and journal editing in a single researcher identifier that showcases a record of scientificactivity and impact based on authors’ productivity. In this paper we propose Ants-Review, a new incentivisation mechanism built on Ethereum that issues open peer reviewsto validate scientific papers while preserving the anonymity of its contributors. We imagine a final paper originatingfrom the peer review process as a complex system that emerges from the interactions between the authors and thereviewers, a whole that is more than the sum of its parts. Therefore, the name evokes an ant colony as a self-organisingorganism in which all micro-contributions of the individuals emerge into complex behaviour. The original proposalbehind this paper can be found here [20]. Its design and implementation are exposed in the following section.
A popular incentive model for open source software (OSS) is represented by bounties. Bounties are prizes or monetaryrewards given for completing a task before a deadline [21]. Examples of such platforms that allow funders (bountybackers) to pay developers (bounty hunters) for open source contributions are
Gitcoin and The Bounties Network .Incentives can be represented by tokens, units of values registered on the blockchain. In the network of the scientificcommunity reviewers provide a service and those who consume it (authors, journals) should be able to contribute withtokens. The amount of tokens reflects material and symbolic recognition of the performed work that can be statisticallyquantified for author-level metrics measuring the productivity and impact of a researcher. Thus, the system acts also asa reputation builder. The peer review history, including reviewers’ recommendations and authors’ replies, should be openly and permanentlyaccessible to the community (in the form of ‘open reports’ of open peer reviews) even before articles’ publicationin order to make editorial decisions more democratic and prevent waste of knowledge. Following the example ofmodels offered by journals peer review consortia, such as the
Neuroscience Peer Review Consortium and independentcompanies like ResearchSquare and Peerage of Science , that provide a scientific peer review service, peer reviews inAnts-Review will be transferable across journals (like in ‘cascading’ or ‘portable peer reviews’). In order to counteract malicious behaviour (see 2.1) affecting the integrity of the reviews but also to correctly attributethe intellectual contributions making sure there are no conflicts of interest, it is important to be able to track back theidentities of the contributors to a peer-review report. This is possible if the platform acts like a version control systemwhere commits are permanent and their hashes timestamped. InterPlanetary File System (IPFS) [22] is a peer-to-peerhypermedia protocol for storing data in a distributed file system over the internet which guarantees data immutabilityand unique file identification via cryptographic hashes. IPFS’ hashes are then stored inside the smart contracts’ statethat is timestamped into the Ethereum blocks where the transactions take place; there, data remains unaltered andindelible. This notarization process is called proof of existence (PoE) and allows manual verification of the existence ofthe document.To prevent retaliation for negative peer-reviews and to promote the participation of early researchers who might feelintimidated to judge the scientific work of senior authors, the Ants-Review system maintains the privacy of bothauthors and reviewers in a double-blind approach via Ethereum’s externally owned accounts (EOA) addresses andzero-knowledge proof (ZKP), a cryptographic method where a party can prove to another party the possession of certaininformation, like a secret key, without revealing that information (see 3.2). Publons . https://publons.com Gitcoin . https://gitcoin.co The Bounties Network . https://bounties.network Neuroscience Peer Review Consortium . http://nprc.incf.org ResearchSquare . Peerage of Science . PREPRINT - J
ANUARY
26, 2021
As a final step we propose that all the community is involved in the process of peer reviewing by abolishing the editorialselection process through ‘open participation’ (or ‘open interaction’, ‘open platform’ [23, 24]). In this way, the poolof reviewers is enriched and allows younger researchers to get the appropriate training through interactive feedback.Moreover, peer reviews could be evaluated, commented, criticised by the other members of the scientific community,enabling a virtuous loop of verification. An interesting addition would be to introduce a rank of peer reviews resultingfrom the community feedback via a voting process (see 4.1). It is conceivable that the community members that engagein assessing the quality of peer reviews could be incentivized as well. This solution would create a self-reinforcingethical behaviour where the fair evaluation of peer reviews would be also in the interest of the agents at play.
The Ants-Review Protocol is divided into different modules responsible for the following functionalities, as shown inthe flow-chart (see Figure 1):
AntsReview , which manages access management and the core system (see Figure 1, ( a,b, f, h ));
Privacy , which maintains the anonymity of the system via AZTEC Protocol (see Figure 1, ( e )); Tokenomics ,which manages the incentive mechanism of the system (see Figure 1, ( c, d, e, h )).Agents in the platform are: issuers, peer reviewers, approvers and contributors (or Anters, members of the Ants-ReviewCommunity).Figure 1: Exagones represent the protocol’s smart contracts. Ellipse represents the smart contract inherited byAntsReview. Clouds represent integrations into the protocol. Rectangles represent the smart contracts’ libraries. a Corecontract of the protocol implementing a bounty system with the functions listed. b Module inherited by AntsReview: itmanages the access control of the protocol by adding and removing issuers and peer-reviewers. c Native token usedin the protocol. It is linked to ( a ), ( e ) and to ( d ). d Faucet to distribute
ANTS on Kovan Testnet for testing purposes. e Integration with Aztec Protocol to wrap ( c ) into zkANTS to implement private ANTS transactions on Ethereum. f Integration with IPFS to upload papers, requirements and peer reviews and store the hash as
PoE into AntsReview ( a ). g Integration with ERC20 tokens like
Dai , and De-Fi services like MakerDAO DSR to be used in the protocol. h Libraryused by the protocol for secure contract development with the modules listed.
AntsReview (see Figure 1 ( a )), the core of the smart contracts written in Solidity , a contract-oriented programminglanguage for writing smart contracts that run on the Ethereum Virtual Machine (EVM), is deployed on Ethereum KovanTestnet . AntsReview implements a bounty-like system (based on the StandardBounties contract ) where Alice (issuer) Solidity . https://solidity.readthedocs.io AntsReview . https://kovan.etherscan.io/address/0x85be8F04482cBB920550d5469E4dEdD6e1788121 StandardBounties.sol . https://github.com/Bounties-Network/StandardBounties PREPRINT - J
ANUARY
26, 2021can issue an AntReview with the function issueAntReview() .In order to create a transparent and openly accessible AntReview, Alice has to complete a series of required tasks:• upload of the files containing the requirements of the peer review and the paper to be reviewed into IPFS,whose hash is stored into the Ethereum blockchain as PoE;• specification of a deadline in the form of a UNIX timestamp after which the fulfillment will no longer beaccepted;• specification of the Issuers and an Approver to respectively modify the AntReview and approve the peerreviews sent by the peer-reviewers.Alice or the issuers can at any time update the AntReview details (issuers, paper, requirements, deadline) with thefunction changeAntReview() and add/remove the approver with the functions addApprover() and removeApprover() .Anters (contributors) can contribute to Alice’s AntReview with the function contribute() , by specifying the amount ofANTS they are willing to send. Bob (peer-reviewer) can download the files relative to Alice’s paper and the requirementsof the peer review by leveraging on the content-addressing feature of IPFS that allows anyone to find the documentusing an IPFS explorer; subsequently, Bob can submit a peer review before the deadline by fulfilling the AntReviewcreated by Alice, with the function fulfillAntReview() , by uploading the peer review on IPFS, whose hash is stored intoEthereum blockchain as PoE. He can update the peer review with the function updateReview() by uploading the newversion on IPFS. Ted (approver) can accept the peer review submitted by Bob with the function acceptAntReview() ,by specifying the amount of ANTS that will be transferred as reward from the contract to Bob. If Alice’s AntReviewdoes not receive any peer review and the deadline expires, Anters can get a refund with the function refund() for theircontributions. In order to avoid residual balance, Alice can withdraw ANTS from the AntReview’s balance, if thedeadline expires, with the function withdrawAntReview() , and the contract will transfer the amount specified to Aliceand update the balance.Access management of the Ants-Review protocol is defined and controlled by
AntsReviewRoles (see Figure 1 ( b )),implemented by leveraging on AccessControl.sol by OpenZeppelin Library that is used to define the Issuer and Peer-Reviewer Roles. AntsReviewRoles also integrates a circuit breaker design pattern via Pausable.sol by OpenZeppelin toallow the Pauser Role, granted by default to the owner of the smart contracts, to pause (or unpause) all the functions incase of a security emergency, such as an attack to the smart contracts.
The anonymity of an agent in the system is achieved in two ways: via pseudo-anonymity, granted through Ethereum’sEOAs that can pseudo-obscure the identity of the agent, and via private transactions allowed by AZTEC [25] Protocol’ssecurity layer.
Pseudo-anonymity.
EOAs in Ethereum are controlled via private keys. However, the privacy is limited by the factthat both the blockchain and its transactions are public. Therefore, the details of the transactions are visible to anyoneby browsing a block explorer (such as Etherscan ) and are subject to data mining that could extract value and identifyusers in the blockchain. Private transactions.
AZTEC Protocol was conceived to enable privacy on public blockchains. It uses zero-knowledge succinct non-interactive argument of knowledge (zk-SNARKs) [26] and homomorphic encryption [27] tovalidate encrypted transactions. zk-SNARKs are ZKP that require no interaction between prover and verifier; they areused inside the Ants-Review protocol via the zkANTS token to allow private transactions between the agents. Futuredevelopments will allow to leverage on permutations over Lagrange-bases for oecumenical noninteractive arguments ofknowledge (PLONK) [28], a universal zk-SNARK construction that reduces gas costs and improves scalability.
Ants-Review integrates a few
ERC20 tokens, each of whom plays an integral role in the functioning and anonymity ofthe decentralized protocol. ANTS (see Figure 1, ( c )) is the primary protocol token and can be staked into an AntReview.It is implemented by inheriting ERC20.sol from OpenZeppelin Library with name
Ants-Review and symbol
ANTS . AFaucet (see Figure 1, ( d )) is implemented to distribute ANTS token on Kovan Testnet for testing purposes. zkANTS(see Figure 1, ( e )) is a wrapper of ANTS that will be used inside the protocol to allow for private transactions among the OpenZeppelin Library .URL: https://openzeppelin.com Etherscan . https://etherscan.io/ EIP 20 . https://eips.ethereum.org/EIPS/eip-20 PREPRINT - J
ANUARY
26, 2021agents of the protocol, preserving their anonymity as well as the amount of the AntReview reward and the contributionsby the Anters. It will be implemented via AZTEC Protocol [25], that uses a cryptographic engine,
ACE.sol , a contractresponsible for validating the set of AZTEC ZKPs and performing any transfer instructions involving AZTEC notes,minted into a zkAsset, that can be converted into ERC20 tokens. In order to implement a zkAsset called zkANTS, zkAsset.sol , a contract implementation of a confidential token that follows the EIP-1724 standard will be used as atemplate to build an AZTEC-compatible asset.The current state of the art of Ants-Review is represented by version 0.2.0 (MVP) live on Ethereum Kovan Testnet (seeSupplementary Material). We have described how Ants-Review protocol can solve the limitations of the current peer review system (see 2.1). Inparticular, the lack of recognition, the lack of transparency, fraud and misconduct can be solved via the Ants-ReviewProtocol (see §AntsReview in 3.2); the social and cognitive biases can be counteracted via anonymity granted by AZTECProtocol (see §Privacy in 3.2); the slowness of the process, the need for evaluation of the peer reviews themselves andthe need for increasing the number of reviewers can be worked out through the creation of the community of Anters.
An interesting aspect of the protocol is the double function of an AntReview respectively as a bounty and as a poolto stake ERC20 tokens like Dai . Moreover, the duration of peer-reviews consents to connect the protocol to De-Fiservices with the possibility for the community to accrue interest over time via MakerDAO Dai Saving Rate (Pot )or Compound , to cite a few. Therefore, an ERC20 pool token would be automatically released by the protocol,representing the accrued interest on the Anters’ stake over time that can be traded, sold, or held as the Anter desires.A Decentralized Autonomous Organization (DAO) [29, 30] could be formed in the future to allow ANTS stakers toparticipate in the governance of important aspects of the protocol, from smart contracts upgrades to minor changes insettings across the protocol.Finally, a protocol upgrade inspired by Discover , a Web3 browser by Status and still under investigation wouldallow Anters to validate peer reviews via an upvote/downvote system that will consent the protocol to automatically payout the reward to the reviewers based on the votes associated with their peer reviews. As Tennant points out [19], a change is already happening in the publishing industry, especially with new bornpublishers opening up the review process (
BioMed Central , ELife , Frontiers , PeerJ , F1000 Research ). Recently,pre-print servers, such as arXiv and biorXiv , started integrating peer-review services into their platforms:
PREreview , PeerCommunityIn , Review Commons , PrePrint Review and the previously mentioned Peerage of Science . Thisdissociation of initial scientific dissemination and scientific validation will force the publishing industry to adapt inorder to keep up with the higher quality scientific process offered by those alternative peer review platforms and justifytheir added value [19]. In our proposal we also decoupled the peer review process from the publishers giving it backto the scientific community and applying incentives from tokenomics. We foresee that the future will evolve towardscommunity-driven peer reviews: peer reviews will be more and more independent from publishers [31], and researcherswill be the ones seeking the papers to review to build reputation within the community and not journals.Enlarging the pool of reviewers to potentially an entire scientific community and accelerating the whole process requiresa standard for peer reviews [32]: for example some aspects might be taken over by AI assistants (such as the
ArtificialIntelligence Review Assistant (AIRA) [33] leaving to the reviewers the sole task of evaluating the content of a paper.Building smart contracts for peer reviews might accelerate this novel process of standardization. We hope that soon thevalue of peer review as a public good will be recognized by research funders and hiring committees. EIP 1724 . https://github.com/ethereum/EIPs/issues/1724 Dai . https://docs.makerdao.com/smart-contract-modules/dai-module/dai-detailed-documentation Pot . https://docs.makerdao.com/smart-contract-modules/rates-module/pot-detailed-documentation . Compound . https://compound.finance Discover.sol . https://github.com/dap-ps/discover/blob/master/contracts/Discover.sol Status . https://status.im/ PREreview. PeerCommunityIn https://peercommunityin.org Review Commons. PrePrint Review. https://elifesci.org/preprint-review PREPRINT - J
ANUARY
26, 2021
In this paper we addressed a crucial problem within scholarly academic communication: the peer review process. We have shownhow blockchain technology could provide an efficient and viable solution to open up possible directions for a paradigm shift inscientific communication. We proposed an incentive mechanism that could solve the problems of lack of acknowledgment and trustduring peer reviews. We exposed the architecture of our project for which we adopted cutting-edge tools from the open sourceblockchain ecosystem.
Supplementary Material
Source code: ; DApp: https://ants-review.on.fleek.co . Declaration of Competing Interest
This work was mainly developed during the ETHTurin Hackathon 2020 and the Gitcoin Kernel Fellowship program 2020. Theseorganizations, as well as the authors’ affiliations, had no financial role in the design and implementation of the protocol.
Authors Contribution Statement
Bianca Trovò: Conceptualization (lead); Funding Acquisition (lead); Investigation (lead); Methodology (equal); Project Adminis-tration (equal); Supervision (equal); Validation (supporting); Visualization (supporting); Writing – original draft (lead); Writing –review and editing (equal). Nazzareno Massari: Investigation (supporting); Methodology (equal); Project Administration (equal);Resources (lead); Software (lead); Validation (lead); Supervision (equal); Visualization (lead); Writing – original draft (supporting);Writing – review and editing (equal).
Acknowledgements
We would like to thank Andy Tudhope, Mark Beylin, Matteo A. Tambussi, Evan C. Harris and the four external anonymous peerreviewers for useful comments and revisions; the FDAPP 2020 workshop chairs and speakers for questions and feedback; MitrasishMukherjee for contributions on the interface.
References [1] Satoshi Nakamoto. Bitcoin: A Peer-to-Peer Electronic Cash System.
Whitepaper , 2009.[2] Gavin Wood. Ethereum: a secure decentralised generalised transaction ledger.
Yellowpaper , 2017.[3] Andy Extance. Could Bitcoin technology help science?
Nature , 552(7685):301–302, 2017.[4] Dr. Joris van Rossum. Blockchain for Research - Perspectives on a New Paradigm for Scholarly Communication.
DigitalScience , 2017.[5] b8d5ad9d974a44e7e2882f986467f4d3. Towards Open Science: The Case for a Decentralized Autonomous AcademicEndorsement System.
Zenodo , 2016.[6] Stephan Leible, Steffen Schlager, Moritz Schubotz, and Bela Gipp. A Review on Blockchain Technology and BlockchainProjects Fostering Open Science.
Frontiers in Blockchain , 2:16, 2019.[7] Du Mingxiao, Ma Xiaofeng, Zhang Zhe, Wang Xiangwei, and Chen Qijun. A Review on Consensus Algorithm of Blockchain. , pages 2567–2572, 2017.[8] Sönke Bartling and & contributors to living document. Blockchain for Science and knowledge creation.
Zenodo , 2016.[9] Paul Glasziou, Douglas G Altman, Patrick Bossuyt, Isabelle Boutron, Mike Clarke, Steven Julious, Susan Michie, DavidMoher, and Elizabeth Wager. Reducing waste from incomplete or unusable reports of biomedical research.
The Lancet ,383(9913):267–276, 2014.[10] Robert E Gropp, Scott Glisson, Stephen Gallo, and Lisa Thompson. Peer Review: A System under Stress.
BioScience ,67(5):407–410, 2017.[11] Jei Young Lee. A decentralized token economy: How blockchain and cryptocurrency can revolutionize business.
BusinessHorizons , 62(6):773–784, 2019.[12] Richard Smith. Peer Review: A Flawed Process at the Heart of Science and Journals.
Journal of the Royal Society of Medicine ,99(4):178–182, 2006.[13] Richard Walker and Pascal Rocha da Silva. Emerging trends in peer reviewâC”a survey.
Frontiers in Neuroscience , 9:169,2015.[14] Kendall Powell. The waiting game.
Nature , 530:148–151, 2016. PREPRINT - J
ANUARY
26, 2021 [15] Verity Warne. Rewarding reviewers – sense or sensibility? A Wiley study explained.
Learned Publishing , 29(1):41–50, 2016.[16] Marc Hauser and Ernst Fehr. An Incentive Solution to the Peer Review Problem.
PLoS Biology , 5(4):e107, 2007.[17] Ulysses Paulino de Albuquerque. The tragedy of the common reviewers: the peer review process.
Revista Brasileira deFarmacognosia , 21(1):1–3, 2011.[18] Giangiacomo Bravo, Francisco Grimaldo, Emilia López-Iñesta, Bahar Mehmani, and Flaminio Squazzoni. The effect ofpublishing peer review reports on referee behavior in five scholarly journals.
Nature Communications , 10(1):322, 2019.[19] Jonathan P. Tennant, Jonathan M. Dugan, Daniel Graziotin, Damien C. Jacques, François Waldner, Daniel Mietchen, YehiaElkhatib, Lauren B. Collister, Christina K. Pikas, Tom Crick, Paola Masuzzo, Anthony Caravaggi, Devin R. Berg, Kyle E.Niemeyer, Tony Ross-Hellauer, Sara Mannheimer, Lillian Rigling, Daniel S. Katz, Bastian Greshake Tzovaras, Josmel Pacheco-Mendoza, Nazeefa Fatima, Marta Poblet, Marios Isaakidis, Dasapta Erwin Irawan, Sébastien Renaut, Christopher R. Madan,Lisa Matthias, Jesper Nørgaard Kjær, Daniel Paul O’Donnell, Cameron Neylon, Sarah Kearns, Manojkumar Selvaraju, andJulien Colomb. A multi-disciplinary perspective on emergent and future innovations in peer review.
F1000Research , 6:1151,2017.[20] Bianca Trovò and Nazzareno Massari. Ants-Review: a Bounty-like system for Open Anonymous Scientific Peer-Reviews.
Zenodo , 2020.[21] Jiayuan Zhou, Shaowei Wang, Cor-Paul Bezemer, Ying Zou, and Ahmed E Hassan. Bounties in Open Source Development onGitHub: A Case Study of Bountysource Bounties. arXiv , 2019.[22] Juan Benet. IPFS - Content Addressed, Versioned, P2P File System. arXiv , 2014.[23] Tony Ross-Hellauer. What is open peer review? A systematic review.
F1000Research , 6:588, 2017.[24] Tony Ross-Hellauer and Edit Görögh. Guidelines for open peer review implementation.
Research Integrity and Peer Review ,4(1):4, 2019.[25] Zachary J. Williamson. The AZTEC Protocol.
Whitepaper , 2018.[26] Christian Reitwießner. zkSNARKs in a Nutshell.
Ethereum blog , 2016.[27] Vitalik Buterin. Exploring Fully Homomorphic Encryption, 2020.[28] Ariel Gabizon, Zachary J. Williamson, and Oana Ciobotaru. PLONK: Permutations over Lagrange-bases for OecumenicalNoninteractive arguments of Knowledge.
Protocol Labs Research , 2019.[29] Shuai Wang, Wenwen Ding, Juanjuan Li, Yong Yuan, Liwei Ouyang, and Fei-Yue Wang. Decentralized AutonomousOrganizations: Concept, Model, and Applications.
IEEE Transactions on Computational Social Systems , 6(5):870–878, 2019.[30] Robbie Morrison, Natasha C. H. L. Mazey, and Stephen C. Wingreen. The DAO Controversy: The Case for a New Species ofCorporate Governance?
Frontiers in Blockchain , 3:25, 2020.[31] Jason Priem and Bradley M. Hemminger. Decoupling the scholarly journal.
Frontiers in Computational Neuroscience , 6:19,2012.[32] Matthew Krummel, Catherine Blish, Michael Kuhns, Ken Cadwell, Andrew Oberst, Ananda Goldrath, K. Mark Ansel, HongboChi, Ryan O’Connell, E. John Wherry, Marion Pepper, The Future Immunology Consortium, Igor Brodsky, John Chang,Joseph R. Arron, Nick Haining, Deepta Bhattacharya, Mark Anderson, Carla V. Rothlin, Susan Schwab, Yasmine Belkaid, AriMolofsky, Pete Savage, Daniel Mucida, Akiko Iwasaki, Gabriel Victora, K. Mark Ansel, Jessica Hamerman, David Masopust,Greg Barton, Susan Kaech, Prescott Woodruff, Daniel B. Stetson, Tiffany C. Scharschmidt, Ross Kedl, Elina Isabel Zúñiga,Alexander Hoffmann, Matt Williams, Katrin D. Mayer-Barber, Sunny Shin, Steven Bensinger, Li-Fan Lu, Mark Looney,June L. Round, Sebastian Amigorena, Jonathan Yewdell, Joseph Sun, and John T. Harty. Universal Principled Review: ACommunity-Driven Method to Improve Peer Review.
Cell , 179(7):1441–1445, 2019.[33] Frontiers. Artificial Intelligence to help meet global demand for high-quality, objective peer-review in publishing., 2020., 179(7):1441–1445, 2019.[33] Frontiers. Artificial Intelligence to help meet global demand for high-quality, objective peer-review in publishing., 2020.