
{"id":3126,"date":"2019-09-18T12:16:20","date_gmt":"2019-09-18T12:16:20","guid":{"rendered":"https:\/\/www.editage.com\/insights\/will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review\/"},"modified":"2025-01-15T06:32:50","modified_gmt":"2025-01-15T06:32:50","slug":"will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review","status":"publish","type":"post","link":"https:\/\/www.editage.com\/insights\/will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review","title":{"rendered":"Will robots ever truly be our &#8220;peers&#8221; when it comes to peer review?"},"content":{"rendered":"<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">I had a dream that bothered me. In this dream, I found out that the journal editor had rejected my paper based on an algorithm. In my dream, I was incensed. It made me so irate that I woke up.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Upon waking up, I couldn\u2019t shake the question \u2014 would this work? Does it matter? This lead me down the idea that machine learning will likely have an impact on our work, and it\u2019s probably already happening. Time to write something down, before a computer beats me to it.<\/span><\/span><\/span><\/p>\n<h4 style=\"margin: 0cm 0cm 8pt;\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\"><b>Peer review in brief<\/b><\/span><\/span><\/span><\/h4>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Peer review is a critical aspect of the scholarly process, as (in spirit) it ensures that authors submit quality work for wider dissemination and it proactively opens up ideas for criticism. There are many ways in which peer review could be improved, but that\u2019s a subject for another day.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">The act of peer review varies from journal to journal but, in general, authors submit their work, the manuscript (and associated documents) are handled by an editor, sent out for peer review, those reports are assessed by the editor, revisions may be sought, and ultimately the article may be published.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Each of those stages involves a human-human interaction, where judgements are made, experiences celebrated, and view-points are sought. The value of peer review is that we are asking our peers to evaluate our work and enable our communication to have more merit. It is far from perfect, it is open to abuse, and it will continually evolve.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">The whole endeavour of academic publishing can be a tedious, unrewarding, and time consuming adventure. In our current processes, only the authors are properly rewarded with their articles, which may have been \u2018improved\u2019 by the whole process, and are given the gold stamp of peer review. The anonymous peer reviewers are rarely credited. The hard work undertaken by a journal editor will not be rewarded with a Nobel Prize.<\/span><\/span><\/span><\/p>\n<h4 style=\"margin: 0cm 0cm 8pt;\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\"><b>Robots as reviewers<\/b><\/span><\/span><\/span><\/h4>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Robots are machines that carry out complex tasks automatically. In the realm of peer review, the most likely \u2018robots\u2019 will be machine learning algorithms. These algorithms enable difficult tasks to be learnt from vast data sets, and typically it involves derivation of a correlative model through training data. New data can be tested against the correlative model to see how similar (or different) it is to the training data. This testing can be \u2018predictive\u2019 in describing how the new data will perform through a process that was used to generate the model, and therefore it can be time consuming but effective in solving problems where a deterministic solution is not easily tractable.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Unfortunately, the nature of machine learning is such that the correlative model is created from the training data and the data reduction is not often human-readable. We are left with a useful, but non-intuitive model, that estimates the likelihood of similarity (or difference) of new information with respect to the pre-existing trained data set.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Machine learning continues to prove extremely useful; it is likely the first step in our march towards artificial intelligence. Machine learning has demonstrated itself with data sets where correlations between similar \u2018types\u2019 of information may be weak, such as the language used by junk-mail spammers, or for data sets where the \u2018structure\u2019 is not self-evident or obscured by other factors, such as the time of day affecting scene lighting.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">In machine learning, we follow an argument that if we train a model with a sufficient amount of input data, we can use this model in a pseudo-predictive manner. The pseudo-predictive nature of this model rests upon our asking of this machine learning system to interpolate correlations between the test data and the reduced model (derived from the training data set).<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">This interpolation aspect of the machine is a critical benefit and flaw as, for example, it can prove interesting (and uncertain) to ask for an extrapolation query outside of the domain of the training data.<\/span><\/span><\/span><\/p>\n<h4 style=\"margin: 0cm 0cm 8pt;\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\"><b>Where is the \u2018art\u2019 in artificial intelligence?<\/b><\/span><\/span><\/span><\/h4>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">While these machine learning algorithms may be called \u2018Artificial Intelligence,\u2019 they are only a simulacra of the scientific endeavour. At present, the best algorithms have limited training and experience, as compared to living and breathing scientists.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">As scientists, we can cherish our human experiences and training that fall outside the domain of the training set. We recognise the importance and extent of training in the academic context of undergraduate and graduate school, and that science is normally a learning (rather than solution) driven endeavour.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">A further complication arises if we consider academic breakthroughs as a stochastic field where \u2018bright ideas\u2019 and \u2018innovation\u2019 are sacrosanct to moving fields forward. In the realm of peer review, an exciting new paper is likely to be breaking new ground, where it will require extrapolation outside the training data set.<\/span><\/span><\/span><\/p>\n<h4 style=\"margin: 0cm 0cm 8pt;\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\"><b>Innovation and impact<\/b><\/span><\/span><\/span><\/h4>\n<p style=\"margin: 0cm 0cm 8pt;\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Prediction of innovation and impact is a culturally fashionable obsession within the politically inclined scientific class.<\/span><\/span><\/span><\/p>\n<p style=\"margin: 0cm 0cm 8pt;\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">To me, innovation is a written-down work that conjures the idea that we will change our practice or our lifestyles. Yet, for delivery of this innovation as \u2018impact\u2019 where it affects a class of people (scientists, engineers, policymakers, or the public) we have an uncertain timeline, and hindsight does not give us a view of the unknown unknowns.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Therefore, we concoct a series of proxy metrics which are reflective of our past victories, and view these as an opportunity to provide a crystal ball on the success of each of our next scholarly communications.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">These crystal ball approaches have created a few monsters amongst our midst, particularly through the derivation of broken proxy metrics and comparison tools, which are there to enable busy people to sift through complex evaluation processes. However, the utility and efficacy of these proxy metrics (for example the JIF or the associated quality of a \u2018name brand journal\u2019) is unfounded and currently subject to review (for example Imperial College has signed DORA).<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">We can generate a \u2018thin end of the wedge\u2019 argument, whereby we envisage machine learning as a path away from engagement in the humanity of good scholarship. Machine learning could promote cookie-cutter approaches to gaming of systems, rather than recognition of true trailblazers or amazing mentors. This would deride all pleasure out of the academic endeavour, limit our ability to inspire, and restrict our ability to solve difficult and unknown problems.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">I strongly feel that we must engineer our system of evaluation to have the space and flexibility to evolve; especially because we must steward and encourage good scholarship, reward articulate and effective communication, and provide space for people to evolve the academic landscape.<\/span><\/span><\/span><\/p>\n<h4 style=\"margin: 0cm 0cm 8pt;\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\"><b>Bias in training<\/b><\/span><\/span><\/span><\/h4>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">An algorithm is \u2018just\u2019 a fancy implementation of a process. These processes are written in such a way that they can be readily executed, typically using a computer; and in the evolution of computing we can recall that these calculations were first performed by humans.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">In writing down a due process, articulated through an algorithm, it is readily possible for us to eliminate subjective bias. We can generate a deterministic outcome from a desired set of inputs, and it can be possible to train out undesired results. This can promote fairness and equality, provided that the bias in establishing the algorithm is well-known.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">In the field of machine learning, we establish our algorithms through the use of training data sets and this leads to a standardisation of outcome. This outcome can be fair, in that it treats all the inputs equally. Yet, the reliance of a complex training data set is the method\u2019s strength and weakness. If the training data is not fair, then the model is not fair, and therefore the outputs are unfair. A high profile example of the bias in training systems has been observed when&nbsp;<a href=\"http:\/\/uk.businessinsider.com\/google-tags-black-people-as-gorillas-2015-7\" style=\"color:#0563c1; text-decoration:underline\">Google\u2019s image tagging algorithm equated black people and gorillas<\/a>.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">As humans, bias is always evident in our systems, whether this is unconscious or conscious. Bias can become embedded through training and systems, and in stochastic and poorly inspected domains these training errors may be more likely. The scientific publishing domain is not open, it is not transparent, and it is subject to the whims of a few very powerful actors.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">As a counter-point, we could ask ourselves how much more difficult is it for us to train a legion of peers to move beyond bias? Is it cheaper to build the machines to leap us past our current quagmire?<\/span><\/span><\/span><\/p>\n<h4 style=\"margin: 0cm 0cm 8pt;\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\"><b>Luddites and machine learning<\/b><\/span><\/span><\/span><\/h4>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">With all the buzz about big data and machine learning, it is evident that these tools will have an instrumental impact on our lives.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">We can already see this with the simplification of tasks, such as image searching, logistics management, and transportation. In academia, machine learning has a strong foundation in enabling us to reduce the burden of peer review, especially in the management of the formal systems such as in checking plagiarism and similarity.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Even in these limited applications, machine learning should be used to inform, and not make, decisions (i.e. in a supervised mode). Experienced users of plagiarism checkers know how fickle similarity checks may be.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">Finally, use of machine learning tools should be declared up front by the journals and their implementation more widely discussed, to ensure that authors can choose and discuss how they wish decisions on the dissemination of their work to be informed.<\/span><\/span><\/span><\/p>\n<p style=\"margin:0cm 0cm 8pt\"><span style=\"font-size:11pt\"><span style=\"line-height:107%\"><span style=\"font-family:Calibri,sans-serif\">It is with a slight irony that I sign off this article, knowing that machine learning algorithms will determine if this is of interest to a wider readership.<\/span><\/span><\/span><\/p>\n<hr \/>\n<p><i>Dr. Ben Britton is a Senior Lecturer and Royal Academy of Engineering Research Fellow at Imperial College in London. This article was originally published on&nbsp;Dr. Brittion&#8217;s <span class=\"MsoHyperlink\" style=\"color:#0563c1\"><span style=\"text-decoration:underline\"><a href=\"https:\/\/medium.com\/@BMatB\" style=\"color:#0563c1; text-decoration:underline\">Medium blog<\/a><\/span><\/span>&nbsp;(available&nbsp;<span class=\"MsoHyperlink\" style=\"color:#0563c1\"><span style=\"text-decoration:underline\"><a href=\"https:\/\/medium.com\/@BMatB\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0\" style=\"color:#0563c1; text-decoration:underline\" target=\"_blank\" rel=\"noopener\">here<\/a><\/span><\/span>) and has been republished here with his permission.<\/i><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I had a dream that bothered me. In this dream, I found out that the journal editor had rejected my paper based on an algorithm. In my dream, I was incensed. It made me so irate that I woke up. Upon waking up, I couldn\u2019t shake the question \u2014 would this work? Does it matter? [&hellip;]<\/p>\n","protected":false},"author":904,"featured_media":33313,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[2394],"tags":[1022,1760],"new_categories":[],"new_tags":[],"series":[],"class_list":["post-3126","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-basics-of-peer-review","tag-peer-review-system","tag-peer-review-week"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Will robots ever truly be our &quot;peers&quot; when it comes to peer review?<\/title>\n<meta name=\"description\" content=\"I had a dream that bothered me. In this dream, I found out that the journal editor had rejected my paper based on an algorithm. It made me so irate that I woke up.\u00a0Upon waking up, I asked myself\u00a0whether this would work.\u00a0Does it matter? Is machine learning already impacting our work?\u00a0I decided that it &#039;s time to write something down, before a computer beats me to it.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Will robots ever truly be our &quot;peers&quot; when it comes to peer review?\" \/>\n<meta property=\"og:description\" content=\"I had a dream that bothered me. In this dream, I found out that the journal editor had rejected my paper based on an algorithm. It made me so irate that I woke up.\u00a0Upon waking up, I asked myself\u00a0whether this would work.\u00a0Does it matter? Is machine learning already impacting our work?\u00a0I decided that it &#039;s time to write something down, before a computer beats me to it.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0\" \/>\n<meta property=\"og:site_name\" content=\"Editage Insights\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Editage\" \/>\n<meta property=\"article:published_time\" content=\"2019-09-18T12:16:20+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-01-15T06:32:50+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2019\/09\/Will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review-Resized.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"656\" \/>\n\t<meta property=\"og:image:height\" content=\"394\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Ben Britton\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Editage\" \/>\n<meta name=\"twitter:site\" content=\"@Editage\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ben Britton\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.editage.com\/insights\/will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review\"},\"author\":{\"name\":\"Ben Britton\",\"@id\":\"https:\/\/www.editage.com\/insights\/#\/schema\/person\/8cb4b2d184c12b7f09ff7c3636048ca8\"},\"headline\":\"Will robots ever truly be our &#8220;peers&#8221; when it comes to peer review?\",\"datePublished\":\"2019-09-18T12:16:20+00:00\",\"dateModified\":\"2025-01-15T06:32:50+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.editage.com\/insights\/will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review\"},\"wordCount\":1637,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.editage.com\/insights\/#organization\"},\"image\":{\"@id\":\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2025\/02\/editage-insights-generic-banner_298.webp\",\"keywords\":[\"peer review system\",\"peer review week\"],\"articleSection\":[\"Basics of Peer Review\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.editage.com\/insights\/will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review\",\"url\":\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0\",\"name\":\"Will robots ever truly be our \\\"peers\\\" when it comes to peer review?\",\"isPartOf\":{\"@id\":\"https:\/\/www.editage.com\/insights\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#primaryimage\"},\"image\":{\"@id\":\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2025\/02\/editage-insights-generic-banner_298.webp\",\"datePublished\":\"2019-09-18T12:16:20+00:00\",\"dateModified\":\"2025-01-15T06:32:50+00:00\",\"description\":\"I had a dream that bothered me. In this dream, I found out that the journal editor had rejected my paper based on an algorithm. It made me so irate that I woke up.\u00a0Upon waking up, I asked myself\u00a0whether this would work.\u00a0Does it matter? Is machine learning already impacting our work?\u00a0I decided that it 's time to write something down, before a computer beats me to it.\",\"breadcrumb\":{\"@id\":\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#primaryimage\",\"url\":\"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2025\/02\/editage-insights-generic-banner_298.webp\",\"contentUrl\":\"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2025\/02\/editage-insights-generic-banner_298.webp\",\"width\":656,\"height\":336},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.editage.com\/insights\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Will robots ever truly be our &#8220;peers&#8221; when it comes to peer review?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.editage.com\/insights\/#website\",\"url\":\"https:\/\/www.editage.com\/insights\/\",\"name\":\"Editage Insights\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.editage.com\/insights\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.editage.com\/insights\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.editage.com\/insights\/#organization\",\"name\":\"Editage Insights\",\"url\":\"https:\/\/www.editage.com\/insights\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.editage.com\/insights\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2024\/09\/editage-insights-logo-1-scaled.webp\",\"contentUrl\":\"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2024\/09\/editage-insights-logo-1-scaled.webp\",\"width\":2560,\"height\":324,\"caption\":\"Editage Insights\"},\"image\":{\"@id\":\"https:\/\/www.editage.com\/insights\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/Editage\",\"https:\/\/x.com\/Editage\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.editage.com\/insights\/#\/schema\/person\/8cb4b2d184c12b7f09ff7c3636048ca8\",\"name\":\"Ben Britton\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.editage.com\/insights\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/826284e364614ef1c2c370e94c60f17dbb59578223252ab3c2f361a496bc605e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/826284e364614ef1c2c370e94c60f17dbb59578223252ab3c2f361a496bc605e?s=96&d=mm&r=g\",\"caption\":\"Ben Britton\"},\"url\":\"https:\/\/www.editage.com\/insights\/ben-britton\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Will robots ever truly be our \"peers\" when it comes to peer review?","description":"I had a dream that bothered me. In this dream, I found out that the journal editor had rejected my paper based on an algorithm. It made me so irate that I woke up.\u00a0Upon waking up, I asked myself\u00a0whether this would work.\u00a0Does it matter? Is machine learning already impacting our work?\u00a0I decided that it 's time to write something down, before a computer beats me to it.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0","og_locale":"en_US","og_type":"article","og_title":"Will robots ever truly be our \"peers\" when it comes to peer review?","og_description":"I had a dream that bothered me. In this dream, I found out that the journal editor had rejected my paper based on an algorithm. It made me so irate that I woke up.\u00a0Upon waking up, I asked myself\u00a0whether this would work.\u00a0Does it matter? Is machine learning already impacting our work?\u00a0I decided that it 's time to write something down, before a computer beats me to it.","og_url":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0","og_site_name":"Editage Insights","article_publisher":"https:\/\/www.facebook.com\/Editage","article_published_time":"2019-09-18T12:16:20+00:00","article_modified_time":"2025-01-15T06:32:50+00:00","og_image":[{"width":656,"height":394,"url":"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2019\/09\/Will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review-Resized.jpg","type":"image\/jpeg"}],"author":"Ben Britton","twitter_card":"summary_large_image","twitter_creator":"@Editage","twitter_site":"@Editage","twitter_misc":{"Written by":"Ben Britton","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#article","isPartOf":{"@id":"https:\/\/www.editage.com\/insights\/will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review"},"author":{"name":"Ben Britton","@id":"https:\/\/www.editage.com\/insights\/#\/schema\/person\/8cb4b2d184c12b7f09ff7c3636048ca8"},"headline":"Will robots ever truly be our &#8220;peers&#8221; when it comes to peer review?","datePublished":"2019-09-18T12:16:20+00:00","dateModified":"2025-01-15T06:32:50+00:00","mainEntityOfPage":{"@id":"https:\/\/www.editage.com\/insights\/will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review"},"wordCount":1637,"commentCount":0,"publisher":{"@id":"https:\/\/www.editage.com\/insights\/#organization"},"image":{"@id":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#primaryimage"},"thumbnailUrl":"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2025\/02\/editage-insights-generic-banner_298.webp","keywords":["peer review system","peer review week"],"articleSection":["Basics of Peer Review"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.editage.com\/insights\/will-robots-ever-truly-be-our-peers-when-it-comes-to-peer-review","url":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0","name":"Will robots ever truly be our \"peers\" when it comes to peer review?","isPartOf":{"@id":"https:\/\/www.editage.com\/insights\/#website"},"primaryImageOfPage":{"@id":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#primaryimage"},"image":{"@id":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#primaryimage"},"thumbnailUrl":"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2025\/02\/editage-insights-generic-banner_298.webp","datePublished":"2019-09-18T12:16:20+00:00","dateModified":"2025-01-15T06:32:50+00:00","description":"I had a dream that bothered me. In this dream, I found out that the journal editor had rejected my paper based on an algorithm. It made me so irate that I woke up.\u00a0Upon waking up, I asked myself\u00a0whether this would work.\u00a0Does it matter? Is machine learning already impacting our work?\u00a0I decided that it 's time to write something down, before a computer beats me to it.","breadcrumb":{"@id":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#primaryimage","url":"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2025\/02\/editage-insights-generic-banner_298.webp","contentUrl":"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2025\/02\/editage-insights-generic-banner_298.webp","width":656,"height":336},{"@type":"BreadcrumbList","@id":"https:\/\/bmatb.medium.com\/academic-publishing-will-robots-ever-be-our-peers-e035a63244c0#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.editage.com\/insights\/"},{"@type":"ListItem","position":2,"name":"Will robots ever truly be our &#8220;peers&#8221; when it comes to peer review?"}]},{"@type":"WebSite","@id":"https:\/\/www.editage.com\/insights\/#website","url":"https:\/\/www.editage.com\/insights\/","name":"Editage Insights","description":"","publisher":{"@id":"https:\/\/www.editage.com\/insights\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.editage.com\/insights\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.editage.com\/insights\/#organization","name":"Editage Insights","url":"https:\/\/www.editage.com\/insights\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.editage.com\/insights\/#\/schema\/logo\/image\/","url":"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2024\/09\/editage-insights-logo-1-scaled.webp","contentUrl":"https:\/\/www.editage.com\/insights\/wp-content\/uploads\/2024\/09\/editage-insights-logo-1-scaled.webp","width":2560,"height":324,"caption":"Editage Insights"},"image":{"@id":"https:\/\/www.editage.com\/insights\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Editage","https:\/\/x.com\/Editage"]},{"@type":"Person","@id":"https:\/\/www.editage.com\/insights\/#\/schema\/person\/8cb4b2d184c12b7f09ff7c3636048ca8","name":"Ben Britton","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.editage.com\/insights\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/826284e364614ef1c2c370e94c60f17dbb59578223252ab3c2f361a496bc605e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/826284e364614ef1c2c370e94c60f17dbb59578223252ab3c2f361a496bc605e?s=96&d=mm&r=g","caption":"Ben Britton"},"url":"https:\/\/www.editage.com\/insights\/ben-britton"}]}},"_links":{"self":[{"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/posts\/3126","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/users\/904"}],"replies":[{"embeddable":true,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/comments?post=3126"}],"version-history":[{"count":0,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/posts\/3126\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/media\/33313"}],"wp:attachment":[{"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/media?parent=3126"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/categories?post=3126"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/tags?post=3126"},{"taxonomy":"new_categories","embeddable":true,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/new_categories?post=3126"},{"taxonomy":"new_tags","embeddable":true,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/new_tags?post=3126"},{"taxonomy":"series","embeddable":true,"href":"https:\/\/www.editage.com\/insights\/wp-json\/wp\/v2\/series?post=3126"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}