Researchers find serious flaws in trials with adult ADHD patients

Originally developed for children, the diagnosis of ADHD is often difficult to make in adults. This is partly because the diagnostic criteria are based on behaviour in children. When diagnosing adults, however, these criteria are often based on adults’ subjective experiences, e.g., of having difficulty concentrating or being very impulsive.

“The rising number of adults diagnosed with ADHD raises important questions about diagnostic validity—especially since many were never identified in childhood and are now seeking help, sometimes prompted by ADHD content on social media. That made us curious: how have randomized controlled trials on ADHD dealt with this diagnostic challenge?” Dr. Igor Studart explains.

Moreover, ADHD shares its symptoms with a number of other mental disorders such as depression, schizophrenia, and bipolar disorder, making it crucial to exclude these disorders when diagnosing ADHD. This requires a thorough diagnostic assessment by an experienced psychologist or psychiatrist.

But it is not always the case that such a thorough assessment is made. A new study from the University of Copenhagen and the University of Sao Paulo in Brazil now shows that even psychiatric research into ADHD often neglects this fundamental work.

“We have examined how 292 of the most credible studies in evidence-based medicine - the so-called randomised controlled trials - diagnosed their adult subjects,” says Professor of Psychiatry and Consultant Psychiatrist Julie Nordgaard, who conducted the study together with Associate Professor and Senior Researcher Mads Gram Henriksen and Dr. Igor Studart.

She continues:

“We conclude that half of the studies did not ensure a broad and thorough diagnostic assessment of the patients before the trial to rule out other disorders. This means that they can't actually know, if their subjects have other mental disorders such as depression or schizophrenia. And that's not all. More than half of the studies included subjects, who have also been diagnosed with other mental disorders, making the diagnosis even more difficult to allocate”, Julie Nordgaard explains.

According to the researchers, these methodological shortcomings are problematic, because they imply that it is impossible to know which disorders and symptoms the treatment investigated in these trials potentially had an effect on.

“This makes the research results from many of these clinical trials difficult to utilise. Yet, the results of randomised controlled trials are considered particularly trustworthy, and they may inform the guidelines we use to treat adult ADHD patients, even though the results from many of these trials should be assessed very carefully," says Mads Gram Henriksen.

A need for consistent and robust diagnoses

According to the researchers, one of the problems with the diagnostic assessment in many of the clinical trials is that it seems to have been carried out by people who are not trained to do so. And often with methods that are not thorough enough.

“In 61% of the studies, they do not state who diagnosed the subjects. In only 35% of the studies, it is stated that a psychiatrist or psychologist made the diagnosis. But diagnostic assessment should always be performed by an experienced professional with the necessary training to ensure that the diagnosis is made correctly, and this should be stated in the studies’ method section,” explains Mads Gram Henriksen.

In some cases, the assessment and thus the diagnosis was made by the subject themselves, and in one particularly egregious case, it was done with the help of a computer, the researchers explain.

“In psychiatry, we really need that all diagnoses, not just ADHD, are made with the same uniform criteria and by trained professionals. Otherwise, we cannot rely on the results or compare them across studies," says Julie Nordgaard and concludes:

“Especially in a situation where a diagnosis such as ADHD in adults is increasing, we need to be very thorough and have a solid foundation. Otherwise, we risk too many people getting a wrong diagnosis and not being able to give them the most effective treatment. Or they risk receiving unnecessary treatment that causes side-effects.”

Read the study Diagnosing ADHD in adults in randomised controlled studies: A scoping review in the journal European Psychiatry.