The use of generative AI (GenAI) in academic texts is not always easy to detect. Unlike plagiarism detectors, AI text detectors are not always accurate, with frequent false positives and scores varying across tools. Moreover, one has to deal with the distinction between human-written, AI-assisted, or AI-generated work. This might because most students today are using GenA) at four stages:<\/p>\n\n\n\n
Stage 1: Planning (brainstorming, literature search)<\/p>\n\n\n\n
Stage 2: Writing (outlining, text generation, language checks)<\/p>\n\n\n\n
Stage 3: Analysis (inputting confidential, unpublished data)<\/p>\n\n\n\n
Stage 4: Dissemination (communicating research outputs)<\/p>\n\n\n\n
Using AI at each of these stages has different strengths and weaknesses, as well as risks. Finding out that your student is using AI is not necessarily a cause for alarm; not all AI use signals misconduct. Rather than outright forbidding AI use in your lab, it would be prudent to understand how your students are using AI and guide them to do so responsibly.<\/p>\n\n\n\n
Here is a checklist for identifying if and how your student used AI in their writing.<\/p>\n\n\n\n
STAGE 1: AI USE AT THE PLANNING<\/strong> STAGE<\/strong> (for brainstorming, searching the literature)<\/p>\n\n\n\n Risks:<\/em><\/strong> An overreliance on GenAI at this stage could lead to the inclusion of fake references and false claims in the text. The student might not understand their own hypothesis fully and\/or diminish their own ability to critically analyze the literature.<\/em><\/p>\n\n\n\n Questions to ask<\/em><\/strong><\/p>\n\n\n\n [ ] Ask the student for the search strategy used. Which databases, search terms, and if applicable, prompts, were used?<\/p>\n\n\n\n [ ] Spot-check the references: choose five to ten. Are they real? Do the authors, year, DOI, and journal match? Does the paper say what the sentence claims? Specifically check for:<\/p>\n\n\n\n – Nonexistent papers<\/p>\n\n\n\n – Inaccurately cited papers: irrelevant to the claim, misquoted, or misrepresented<\/p>\n\n\n\n – Missing landmark papers.<\/p>\n\n\n\n [ ] Check the student\u2019s reading. Ask to see annotated PDFs. A student might have collected papers, but did the student read them?<\/p>\n\n\n\n [ ] Ask \u201cWhat did the tool suggest, and what did you choose?\u201d Brainstorming with AI is fine, but the student should be able to defend their hypothesis.<\/p>\n\n\n\n STAGE 2: AI USE AT THE WRITING STAGE<\/strong> (outlining, text generation, language checks)<\/p>\n\n\n\n Risks: Using AI for grammar and language checks of one\u2019s own text is widely accepted. Using AI for outlining is low to moderate risk. But generating substantive text is where verification matters most, as a student may not understand the draft themselves. Finally, a journal might flag heavy AI use and reject the manuscript.<\/em><\/p>\n\n\n\n [ ] Check that numbers trace back to a table, figure, or source file. Do sample sizes, percentages, p-values, confidence intervals, and units agree across abstract, results, and tables?<\/p>\n\n\n\n [ ] Do the methods describe what was done in your<\/em> lab\/clinic: instruments, catalog numbers, software versions, ethics approval number, consent process? Generic-looking methods could point to AI generation.<\/p>\n\n\n\n [ ] Does the Discussion match with your data, or summarize the field a bit too smoothly and then claim more than you found?<\/p>\n\n\n\n [ ] Compared to the student\u2019s prior writing samples (drafts, lab-notebook entries, email history), do you see sudden changes in the following?<\/p>\n\n\n\n – That student\u2019s vocabulary or sentence complexity<\/p>\n\n\n\n – Their tone or spelling<\/p>\n\n\n\n – Their ability to explain the argument orally<\/p>\n\n\n\n [ ] Search for or fingerprints, which signal copy-pasting of GenAI output:<\/p>\n\n\n\n [ ] Check version history: did the text build over days or arrive suddenly in large blocks?<\/p>\n\n\n\n [ ] Before asking for the polished manuscript, always ask for an outline to see the thinking process in action. Then ask for completed sections, at various stages of preparation.<\/p>\n\n\n\n [ ] Ask which tool and version was used for language polishing. You could also ask for a demonstration.<\/p>\n\n\n\n * Treat these indicators as reasons to ask further questions, not as proof of AI use.<\/em><\/p>\n\n\n\n STAGE 3: AI USE AT THE ANALYSIS STAGE <\/strong>(entering confidential, unpublished data)<\/p>\n\n\n\n Risk:<\/em><\/strong> Data that has gone into a third-party tool cannot be \u201cunsent\u201d! Further, generating fake data or unethically modifying it is strictly forbidden.<\/em><\/p>\n\n\n\n Questions to ask<\/em><\/strong><\/p>\n\n\n\n <\/em>[ ] Ask your student if any of the following were entered into a public tool and which tool it was:<\/p>\n\n\n\n [ ] Ask if data were de-identified and how.<\/p>\n\n\n\n [ ] Ask if any data, clinical content, images, code, participant descriptions, or statistical results were fabricated or altered improperly.<\/p>\n\n\n\n STAGE 4: AI USE AT THE DISSEMINATION STAGE <\/strong>(communicating research outputs: posters, slides, plain-language summaries, press releases, social media posts)<\/p>\n\n\n\n Risks<\/em><\/strong>: AI can add unnecessary spin or make the findings a tad exaggerated. AI-generated figures might be misrepresentative.<\/em><\/p>\n\n\n\n Questions to ask<\/em><\/strong><\/p>\n\n\n\n [ ] Does the plain-language summary or press release say more than the paper? Watch for \u201cbreakthrough,\u201d \u201cproves,\u201d and \u201ccures.\u201d<\/p>\n\n\n\n [ ] Do the numbers in the abstract, poster, slides, and posts match the paper?<\/p>\n\n\n\n [ ] Verify that AI-generated or AI-modified images do not misrepresent experimental results. Check such images for anatomical inconsistencies, gibberish text, melting letters, unreadable background logos, or texture blending.<\/p>\n\n\n\n THE MOST RELIABLE TEST: A ROUTINE CONVERSATION<\/strong><\/p>\n\n\n\n [ ] Ask the student to explain the central research question in their own words.<\/p>\n\n\n\n [ ] Ask why a particular method was chosen and what alternatives were considered.<\/p>\n\n\n\n [ ] Ask them to interpret a key result and explain its clinical or biological significance.<\/p>\n\n\n\n [ ] Ask them to identify the study\u2019s main limitation and how it affects the conclusions.<\/p>\n\n\n\n [ ] Ask them to walk through one citation and explain how it supports the relevant statement.<\/p>\n\n\n\n If the student cannot answer these satisfactorily, GenAI might have been used for more than just writing assistance. They did not engage sufficiently with the science. In fact, you may ask these questions to all the students in your lab routinely, in the tone you\u2019d use for any<\/em> general query.<\/p>\n\n\n\n ONE LAST CHECK: HOLDING THE MIRROR<\/strong><\/p>\n\n\n\n [ ] Did you read the student\u2019s entire draft, or only the abstract and the figures?<\/p>\n\n\n\n [ ] Did you use an AI tool to summarize the student\u2019s draft?<\/p>\n\n\n\n As a lab head\/PI, your role is to ensure that every manuscript remains accurate, original, and fully attributable to the researchers who take responsibility for it. Once you use this checklist, you will understand the pattern of AI use in your lab. Going a step further, you can take the following measures to establish your own lab policy on acceptable AI use. You can build on the following sample. Remember to update the policy as needed; tools and their capabilities keep changing!<\/p>\n\n\n\n Policy on Acceptable AI Use: Lab XYZ<\/strong><\/p>\n\n\n\n The use of generative AI (GenAI) in academic texts is not always easy to detect. Unlike plagiarism detectors, AI text detectors are not always accurate, with frequent false positives and scores varying across tools. Moreover, one has to deal with the distinction between human-written, AI-assisted, or AI-generated work. This might because most students today are […]<\/p>\n","protected":false},"author":481,"featured_media":49325,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[2934,6542],"tags":[6638,210,79],"new_categories":[],"new_tags":[6639,6437],"series":[],"class_list":["post-49323","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-digital-transformation","category-human-validation","tag-ai-in-manuscript-writing","tag-manuscript-writing","tag-research-integrity","new_tags-ai-in-writing","new_tags-research-integrity"],"acf":[],"yoast_head":"\n\n
\n
\n