1.From setting to vetting: using artificial intelligence for Single Best Answer questions review
Olivia NG ; Siew Ping HAN ; Magdalene Hui Min LEE ; Dong Haur PHUA
Korean Journal of Medical Education 2026;38(1):10-14
Purpose:
Maintaining the quality of Single Best Answer (SBA) questions remains a challenge in medical education, especially as artificial intelligence (AI)-generated items become more common. While considerable attention has been paid to AI question generation, the vetting process is under-explored and difficult to scale.
Methods:
This study investigates the feasibility and reliability of using a large language model to support the vetting of SBA questions. An AI-based reviewer, QA-bot, was developed using custom GPT and embedded with 25 criteria aligned with Bloom’s taxonomy (Levels 1–3). QA-bot and two experienced educators independently evaluated 32 AI-generated SBA questions using the shared evaluation rubric.
Results:
The rubric showed high internal consistency (Cronbach’s alpha=0.878), and strong inter-rater reliability between human reviewers (intraclass correlation coefficient [ICC]=0.893). QA-bot demonstrated good alignment with human raters (ICC=0.861 and 0.840). While the AI performed well on objective, rule-based criteria, it was less consistent in detecting irrelevant complexity and accurately judging difficulty.
Conclusion
These findings suggest that AI can function as an efficient first-pass reviewer, improving consistency and reducing workload, with human oversight remaining essential for educational and clinical relevance.
2.Exploring Clinical Subgroups of Participants with Major Depressive Disorder that may Benefit from Adjunctive Minocycline Treatment
Gerard ANMELLA ; Alcy MEEHAN ; Melanie ASHTON ; Mohammadreza MOHEBBI ; Giovanna FICO ; Chee H. NG ; Michael MAES ; Lesley BERK ; Michele De PRISCO ; Ajeet B. SINGH ; Gin S. MALHI ; Michael BERK ; Seetal DODD ; Diego HIDALGO-MAZZEI ; Iria GRANDE ; Isabella PACCHIAROTTI ; Andrea MURRU ; Eduard VIETA ; Olivia M. DEAN
Clinical Psychopharmacology and Neuroscience 2024;22(1):33-44
Objective:
To explore illness-related factors in patients with major depressive disorder (MDD) recipients of adjunctive minocycline (200 mg/day) treatment. The analysis included participants experiencing MDD from a 12-week, double blind, placebo-controlled, randomized clinical trial (RCT).
Methods:
This is a sub-analysis of a RCT of all 71 participants who took part in the trial. The impact of illness chronicity (illness duration and number of depressive episodes), systemic illness (endocrine, cardiovascular and obesity), adverse effects and minocycline were evaluated as change from baseline to endpoint (12-week) using ANCOVA.
Results:
There was a consistent but statistically non-significant trend on all outcomes in favour of the use of adjunctive minocycline for participants without systemic illness, less illness chronicity, and fewer adverse effects.
Conclusion
Understanding the relationship between MDD and illness chronicity, comorbid systemic illness, and adverse effects, can potentially better characterise those individuals who are more likely to respond to adjunctive anti-inflammatory medications.
3.Does Post-traumatic Stress Disorder Impact Treatment Outcomes within a Randomised Controlled Trial of Mitochondrial Agents for Bipolar Depression?
Samantha E. RUSSELL ; Anna L. WROBEL ; Melanie M. ASHTON ; Alyna TURNER ; Mohammadreza MOHEBBI ; Michael BERK ; Sue COTTON ; Seetal DODD ; Chee H. NG ; Gin S. MALHI ; Olivia M. DEAN
Clinical Psychopharmacology and Neuroscience 2023;21(3):457-465
Objective:
Bipolar disorder often co-occurs with post-traumatic stress disorder, yet few studies have investigated the impact of post-traumatic stress disorder in bipolar disorder on treatment outcomes. The aim of this sub-analysis was to explore symptoms and functioning outcomes between those with bipolar disorder alone and those with comorbid bipolar disorder and post-traumatic stress disorder.
Methods:
Participants (n = 148) with bipolar depression were randomised to: (i) N-acetylcysteine alone; (ii) a combination of nutraceuticals; (iii) or placebo (in addition to treatment as usual) for 16 weeks (+4 weeks discontinuation).Differences between bipolar disorder and comorbid bipolar disorder and post-traumatic stress disorder on symptoms and functioning at five timepoints, as well as on the rate of change from baseline to week 16 and baseline to week 20, were examined.
Results:
There were no baseline differences between bipolar disorder alone and comorbid bipolar disorder and post-traumatic stress disorder apart from the bipolar disorder alone group being significantly more likely to be married (p = 0.01). There were also no significant differences between bipolar disorder alone and comorbid bipolar disorder and post-traumatic stress disorder on symptoms and functioning.
Conclusion
There were no differences in clinical outcomes over time within the context of an adjunctive randomised controlled trial between those with bipolar disorder alone compared to those with comorbid bipolar disorder and post-traumatic stress disorder. However, differences in psychosocial factors may provide targets for areas of specific support for people with comorbid bipolar disorder and post-traumatic stress disorder.
4.Mixed Methods Thematic Analysis of a Randomised Controlled Trial of Adjunctive Mitochondrial Agents for Bipolar Depression
Samantha E. RUSSELL ; Anna L. WROBEL ; Olivia M. DEAN ; Michael BERK ; Seetal DODD ; Chee H. NG ; Gin S. MALHI ; Susan M. COTTON ; Jerome SARRIS ; Alyna TURNER
Clinical Psychopharmacology and Neuroscience 2022;20(2):300-310
Objective:
There is often a shortfall in recovery following treatment for an episode of bipolar disorder (BD). Exploration of participant’s experience provides vital information to enhance statistical outcomes for novel therapy trials. This study used mixed-methods to explore participants’ experience of a trial testing N -acetyl cysteine (NAC) and mitochondrially active nutraceuticals for BD depression.
Methods:
Case report forms from a randomised controlled trial (RCT) of BD depression (n = 148) were analysed using a pragmatic adaption of grounded theory and thematic analysis.
Results:
Thematic analysis of 148 study participants indicated numerous changes in participant experience over time. For example, perceived environmental stressors reported by participants decreased over the trial in both treatment groups. Quantitative analysis of the themes revealed more positive theme reports in the combination treatment arm compared to the placebo arm and there were more negative themes identified in the placebo arm, compared to the NAC arm.
Conclusion
This approach revealed additional results not elucidated in the primary quantitative analysis. This emphasises the value of mixed-methods research in capturing participants’ experiences in RCTs and detecting possible latent benefits and risks. Such methods can detect latent target signals in novel therapy trials conducted in BD and generate novel hypotheses.
5.N-Acetyl Cysteine in the Treatment of Obsessive Compulsive and Related Disorders: A Systematic Review.
Georgina OLIVER ; Olivia DEAN ; David CAMFIELD ; Scott BLAIR-WEST ; Chee NG ; Michael BERK ; Jerome SARRIS
Clinical Psychopharmacology and Neuroscience 2015;13(1):12-24
OBJECTIVE: Obsessive compulsive and related disorders are a collection of debilitating psychiatric disorders in which the role of glutamate dysfunction in the underpinning neurobiology is becoming well established. N-acetyl cysteine (NAC) is a glutamate modulator with promising therapeutic effect. This paper presents a systematic review of clinical trials and case reports exploring the use of NAC for these disorders. A further objective was to detail the methodology of current clinical trials being conducted in the area. METHODS: PubMed, Web of Science and Cochrane Library Database were searched for human clinical trials or case reports investigating NAC in the treatment of obsessive compulsive disorder (OCD) or obsessive compulsive related disorders. Researchers with known involvement in NAC studies were contacted for any unpublished data. RESULTS: Four clinical trials and five case reports/series were identified. Study durations were commonly 12-weeks, using 2,400-3,000 mg/day of NAC. Overall, NAC demonstrates activity in reducing the severity of symptoms, with a good tolerability profile and minimal adverse effects. Currently there are three ongoing randomized controlled trials using NAC for OCD (two adults and one pediatric), and one for excoriation. CONCLUSION: Encouraging results have been demonstrated from the few pilot studies that have been conducted. These results are detailed, in addition to a discussion of future potential research.
Adult
;
Cysteine*
;
Glutamic Acid
;
Humans
;
Neurobiology
;
Obsessive-Compulsive Disorder
6.Protocol and Rationale-The Efficacy of Minocycline as an Adjunctive Treatment for Major Depressive Disorder: A Double Blind, Randomised, Placebo Controlled Trial.
Olivia May DEAN ; Michael MAES ; Melanie ASHTON ; Lesley BERK ; Buranee KANCHANATAWAN ; Atapol SUGHONDHABIROM ; Sookjareon TANGWONGCHAI ; Chee NG ; Nathan DOWLING ; Gin S MALHI ; Michael BERK
Clinical Psychopharmacology and Neuroscience 2014;12(3):180-188
While current pharmacotherapies are efficacious, there remain a clear shortfall between symptom remission and functional recovery. With the explosion in our understanding of the biology of these disorders, the time is ripe for the investigation of novel therapies. Recently depression is conceptualized as an immune-inflammatory and nitro-oxidative stress related disorder. Minocycline is a tetracycline antibiotic that has anti-inflammatory, pro-oxidant, glutamatergic, neurotrophic and neuroprotective properties that make it a viable target to explore as a new therapy. This double blind, randomised, placebo controlled adjunctive trial will investigate the benefits of 200 mg/day of minocycline treatment, in addition to any usual treatment, as an adjunctive treatment for moderate-severe major depressive disorder. Sixty adults are being randomised to 12 weeks of treatment (with a 4 week follow-up post-discontinuation). The primary outcome measure for the study is mean change on the Montgomery-Asberg Depression Rating Scale (MADRS), with secondary outcomes including the Social and Occupational Functioning Assessment Scale (SOFAS), Clinical Global Impressions (CGI), Hamilton Rating Scale for Anxiety (HAM-A), Patient Global Impression (PGI), Quality of Life Enjoyment and Satisfaction Questionnaire (Q-LES-Q) and Range of Impaired Functioning Tool (LIFE-RIFT). Biomarker analyses will also be conducted at baseline and week 12. The study has the potential to provide new treatment targets, both by showing efficacy with a new class of 'antidepressant' but also through the analysis of biomarkers that may further inform our understanding of the pathophysiology of unipolar depression.
Adult
;
Anxiety
;
Biomarkers
;
Biology
;
Clinical Protocols
;
Depression
;
Depressive Disorder
;
Depressive Disorder, Major*
;
Drug Therapy
;
Explosions
;
Follow-Up Studies
;
Humans
;
Inflammation
;
Minocycline*
;
Outcome Assessment (Health Care)
;
Oxidative Stress
;
Quality of Life
;
Tetracycline
;
Surveys and Questionnaires

Result Analysis
Print
Save
E-mail