Conceptio › Archive › NCBI PubMed Central
NCBI PubMed Central open access

Digitally Delivered Cognitive Behavioral Interventions for Alcohol and Other Drug Use: Meta-Analysis Across Consumption and Psychosocial Outcomes.

Kiluk BD et al. · ncbi_pmc
NCBI PubMed Central · Papers
Open Source ↗Direct PDF ↓
cognitive-psychology
Conceptio Open Archive

Analyze & explore related research in Conceptio

Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.

Digitally Delivered Cognitive Behavioral Interventions for Alcohol and Other Drug Use: Meta-Analysis Across Consumption and Psychosocial Outcomes - PMC Skip to main content An official website of the United States government Here's how you know Here's how you know Search Log in Primary site navigation Search Log in Search PMC Full-Text Archive Search in PMC Journal List User Guide As a library, NLM provides access to scientific literature. Inclusion in an NLM database does not imply endorsement of, or agreement with, the contents by NLM or the National Institutes of Health. Learn more: PMC Disclaimer | PMC Copyright Notice JMIR Ment Health . 2026 May 19;13:e82370. doi: 10.2196/82370 Digitally Delivered Cognitive Behavioral Interventions for Alcohol and Other Drug Use: Meta-Analysis Across Consumption and Psychosocial Outcomes Brian D Kiluk 1, ✉ , Lara A Ray 2 , Omeed Tartak 3 , Lovisa Werner 3 , Thomas A Trikalinos 3 , Molly Magill 3 Editor: John Torous Reviewed by: Virgil Gregory , Akhil Anand Author information Article notes Copyright and License information 1 Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States 2 Department of Psychology, University of California at Los Angeles, Los Angeles, CA, United States 3 Center for Alcohol and Addiction Studies, Brown University, Providence, RI, United States ✉ Corresponding Author: Brian D Kiluk brian.kiluk@yale.edu ✉ Corresponding author. Received 2025 Aug 13; Revision requested 2025 Oct 17; Revised 2026 Jan 28; Accepted 2026 Jan 30; Collection date 2026. ©Brian D Kiluk, Lara A Ray, Omeed Tartak, Lovisa Werner, Thomas A Trikalinos, Molly Magill. Originally published in JMIR Mental Health (https://mental.jmir.org), 19.05.2026. This is an open-access article distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/4.0/ ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/ , as well as this copyright and license information must be included. PMC Copyright notice PMCID: PMC13231115  PMID: 41842924 Abstract Background Cognitive behaviorally based interventions have broad appeal and potential for impact when treating adult alcohol and other drug use. Digitally delivered cognitive behaviorally based interventions (dCBIs) may offer this impact with the benefit of increased accessibility. Although prior reviews have indicated the benefits of dCBIs on substance use outcomes, the extension to psychosocial functioning outcomes is unknown. Objective This meta-analysis provides an overview of dCBI effects across a range of functional end points. Methods A literature search was conducted through October 2024. All primary and secondary reports of clinical trials of dCBI were obtained, and all available study end points were eligible for meta-analysis. Descriptive data were extracted and categorized into 1 of 13 different outcome types (eg, abstinence, quantity, cognitive, and quality of life) and into 2 broader outcome classes (ie, consumption and psychosocial). Robust variance estimation was used to conduct hypothesis tests on random effects pooled estimates with outcome class and comparison type as the primary subgroup variables of interest. Results The study sample included 65 randomized trials ( K =110 publications; 753 effect sizes) of dCBI for adult alcohol and other drug use. With respect to efficacy, dCBI as a stand-alone treatment in contrast to a minimal treatment control showed positive and statistically significant effects for consumption ( g =0.27; P< .001; I 2 =85.1%; k =31; k es =134) and psychosocial ( g =0.16; P =.008; I 2 =75.2%; k =16; k es =60) outcomes. As an addition to usual care, efficacy was demonstrated for consumption ( g =0.23; P< .001; I 2 =9.8%; k =20; k es =65), but not psychosocial functioning. Efficacy compared to another digital or in-person intervention or cognitive behaviorally based intervention delivered by a therapist was not observed. Within the dCBI condition, large effect sizes were observed for both outcome classes (ie, 60%-80% of participants showed improvement relative to baseline), and effect size magnitude and statistical heterogeneity varied by the type of outcome examined. Conclusions These results show a benefit for dCBI as a stand-alone therapy and an addition to usual care. Importantly, stand-alone effects were observed for both consumption and some psychosocial outcomes. This study is the first to offer a comprehensive look at dCBI intervention effects across a range of functional end points. Keywords: alcohol treatment, substance use disorders, cognitive behavioral therapy, digital therapeutics, technology-based treatment, meta-analysis Introduction Background Alcohol and other drug use (AOD) disorders are associated with a significant public health burden, including mortality, economic burden, and adverse social- and individual-level consequences [ 1 , 2 ]. They are highly comorbid with other mental health disorders [ 3 ] and can have profound negative effects on psychosocial functioning, including overall mental health and quality of life [ 4 ]. Although vastly underused, there are a number of effective treatments available for AOD. Among them, cognitive behaviorally based interventions (CBIs) are the most widely researched and clinically practiced interventions for AOD. CBIs (ie, cognitive behavioral therapies or cognitive behavioral therapies with elements of other evidence-based modalities such as motivational interviewing) consist of a broad range of behavioral interventions, including those targeting operant learning processes, cognitive and motivational strategies, and skills training targeting interpersonal, emotion regulation, and organizational or problem-solving deficits [ 5 ]. Multiple meta-analyses have provided evidence supporting CBI efficacy in treating AOD [ 6 ], including when combined with pharmacotherapy [ 7 ], and for co-occurring disorders [ 8 ]. Despite its demonstrated efficacy, barriers such as limited access to trained providers, costs of training, geographic limitations, and stigma impede the widespread delivery and uptake of CBIs in traditional settings [ 9 , 10 ]. To overcome these challenges, digital platforms (ie, computer-delivered, web-based, or mobile platforms) have emerged as a promising modality for expanding access to evidence-based care. Given its structured, problem-focused, and time-limited format, CBIs are among the most common therapeutic approaches in digital mental health interventions [ 11 ]. These digitally delivered cognitive behaviorally based interventions (dCBIs) aim to replicate the core components of CBIs in a highly scalable and often self-guided format. A body of research has emerged over the past 2 decades indicating support for dCBIs (also referred to as internet-based cognitive behavioral therapy [CBT] and technology-delivered CBT) in treating AOD. Systematic reviews and meta-analyses indicate a small, significant effect of dCBIs on reducing substance use compared to control conditions [ 12 - 14 ]. However, the impact of these interventions on outcomes beyond substance use is relatively unknown. Of particular interest are indicators of cognitive, behavioral, psychological, and lifestyle changes that are targeted by dCBIs that may promote recovery from AOD [ 15 ]. Evidence of a positive effect on psychosocial outcomes (eg, mental health, emotional well-being, coping strategies, daily functioning, and quality of life) would enhance the clinical significance of changes in substance use. Meta-Analysis Purpose and Aims The aim of this meta-analysis is to evaluate dCBI effects across 2 broad classes of outcomes for AOD: substance use consumption and psychosocial functioning. These outcome classes were the primary subgroup variable in this study. Because the experimental comparator is a common predictor of effect size variability in meta-analyses [ 16 ], the comparator type was the second primary subgroup variable of interest. As a follow-up and in cases of significant statistical heterogeneity within subgroups, regression-based moderator analyses were undertaken. Additional sensitivity analyses were conducted (eg, risk of bias assessment and publication bias assessment) and are reported following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Methods Primary Study Literature Search A librarian-supported literature search was conducted through October 2022 (with an updated search to October 2024) to identify studies for a meta-analysis project on CBIs for AOD. Specifically, a title, abstract, and keyword search by treatment (eg, “cognitive behavioral therapy”), outcome (eg, “alcohol”), and methodological (eg, “randomized clinical trial”) terms was conducted in the PubMed database (sample search strategy can be found in Multimedia Appendix 1 ). Other databases that were searched included Cochrane CENTRAL and EBSCO (ie, CINAHL, APA PsycINFO, and SocINDEX). Abstract screening occurred in Covidence and was conducted by 4 raters, with 2 raters (OT and LW) for each study, and consensus decisions were made by the lead study investigator (MM). Because varying modes of CBI delivery (eg, delivered via technology, delivered in-person, and combined with other behavioral modalities) were of interest to the larger project, the literature search yielded 1387 primary and secondary clinical trial reports that were downloaded and reviewed for eligibility in 1 or more meta-analyses. Additional steps included a bibliographic review of relevant review papers [ 17 - 30 ] and a clinical trial number search to derive all available publications on a given primary study sample. Primary Study Inclusion Study inclusion criteria were as follows: (1) English language publication, (2) peer-reviewed publication, (3) publication date between 1970 and 2024, (4) randomized controlled trial, (5) adult patient population (median age ≥18 years), (6) patient population meeting criteria for an alcohol or other substance use disorder (ie, Diagnostic and Statistical Manual [DSM] III-R through 5 [ 31 - 34 ]) or at-risk use based on an established criterion (eg, Alcohol Use Disorder Identification Test score >8 [ 35 ]), and (7) a cognitive behavioral or combined cognitive behavioral (ie, combined with elements of other evidence-based AOD treatments) intervention delivered in a digital and/or mobile health format (ie, via a computer software program, an internet site, or a mobile phone–based app; see Multimedia Appendix 2 [ 36 - 100 ] for details on dCBI interventions). Primary Study Characteristic Variables There were several study descriptors or moderator variables of interest to this meta-analysis. Because the type of comparator is often a primary driver of effect size magnitude [ 6 , 16 ], effect sizes were pooled overall and by the following 4 between- and 1 within-condition comparator type, respectively: (1) dCBI at follow-up compared to assessment only or minimal treatment (eg, a pamphlet or a noninteractive website with AOD information) at follow-up, (2) dCBI at follow-up compared to another treatment modality (eg, other online intervention and a control treatment) or treatment as usual at follow-up, (3) dCBI added to treatment as usual at follow-up compared to treatment as usual at follow-up, (4) dCBI at follow-up compared to CBI delivered by a counselor at follow-up, and (5) dCBI at follow-up compared to dCBI at baseline. Study characteristic variables were organized by demographic, clinical, treatment, and study method factors. Demographic variables included mean age of participants, percentage of female participants, percentage of participants belonging to 1 or more racial groups (eg, Asian, Black, and White), percentage of participants belonging to the Latine ethnic group, percentage of participants identifying a sexual orientation other than heterosexual, percentage of participants identifying as transgender or other non-cisgender identities, percentage of participants with some college education, and percentage of participants who are full- or part-time employed. Clinical variables included the primary drug targeted (ie, alcohol, cannabis, opioid, polydrug, stimulant), substance use severity (ie, inclusion of individuals with use disorder vs at-risk consumption), and 1 or more co-occurring conditions (eg, depression and pain) as a sample inclusion criterion (ie, yes vs no). Treatment variables were dCBI format (ie, CBI only vs CBI combined with other evidence-based treatment elements), dCBI combined with pharmacotherapy (ie, yes vs no), clinically supported dCBI (ie, yes vs no), and treatment length (ie, number of content modules). Study methodological factors included study sample size, publication year, context (ie, community sample, specialty substance use or mental health clinic, other setting; eg, primary care clinic and college campus), publication country (ie, United States and other countries), and study-level risk-of-bias score [ 101 ]. Data extraction guidelines were detailed in a study codebook available, upon request, from the last author (MM). Data were extracted using consensus methods between the third and fourth authors (OT and LW; agreement rate 79.9%). The last author resolved disagreements, with input from members of the full study team as needed. Effect Size Calculation and Outcomes of Interest Hedges g is a standardized mean difference with a correction for a slight upward bias in the estimated effect size when samples are small [ 102 ]. where i indexes a trial, t and c are experimental and control arms, s is SDs, M is outcome means, df is degrees of freedom, and n is sample sizes. The project literature search sought all publications related to a given primary study sample. The purpose of this was to extract all available outcome data points and thus inform a comprehensive picture of dCBI efficacy, effects, and recovery. During the data extraction phase, all available outcomes and their exact measures were identified and grouped into 1 of 13 outcome classes (ie, abstinence, use frequency, heavy use frequency, peak consumption, quantity, dependence severity, other drug use, consequences, cognitive outcomes, coping outcomes, mental health symptoms, general health, and quality of life; see Multimedia Appendix 3 for the full list of study measures and harmonization procedures by outcome class). As a result of this procedure, each primary study could contribute multiple effect sizes, including by comparison type, outcome class, and follow-up time point (ie, the latest data point within 3 ranges: 0-3 months, 4-6 months, and 7 months or later). Effect sizes were reverse-scored as needed (eg, number of days drank) such that a positive effect size indicated a positive treatment outcome for dCBI. Finally, when data from publications were insufficient for effect size calculation (ie, missing variance estimates and statement of “no significant difference between conditions”), raw data were sought from authors (response rate 60%, with 1 study removed due to nonresponse to data request [ 103 ]). Effect Size Pooling and Sensitivity Analysis Effect sizes were pooled using inverse variance weighting and a random effects model. Inverse variance weighting allows larger sample studies more weight in the overall pooled effect estimate [ 104 ]. A random effects model assumes a distribution, rather than a single population effect size [ 105 ]. For hypothesis testing, sources of dependency from multiple study-level effect sizes (ie, multiple study comparators, outcomes, and/or time points) were handled via robust SEs. Specifically, an approximated covariance matrix is derived from the product of within-study residuals and used to calculate cluster-robust SEs and CIs under a t -distribution [ 106 ]. The within-study correlation between dependent effects was assumed to be constant (ie, default ρ of 0.8), and sensitivity analyses were conducted that varied the correlation value. Cluster-robust SEs also gain accuracy as the sample of primary studies increases, but a small-sample correction allows for stable estimates in samples as small as 10 primary studies [ 107 ]. Meta-analysis was performed in the robumeta package for R (R Foundation for Statistical Computing) [ 106 ]. The random effects and pooled effect sizes in this study were calculated for 2 outcome classes: consumption (ie, abstinence, use frequency, heavy use frequency, peak consumption, quantity, dependence severity, and other drug use) and psychosocial functioning (ie, consequences, cognitive outcomes, coping outcomes, mental health symptoms, general health, and quality of life). These outcome classes as well as comparator type were the primary subgroup moderators of interest. However, in cases of significant residual study heterogeneity (ie, ≥50% [ 105 ] of between-study variance relative to sampling variance measured via the I 2 estimate and k ≥10 [ 108 ]), regression-based moderator analyses by time point (ie, posttreatment to 3 months vs 4 months or later) and primary drug targeted (ie, alcohol, polydrug, and other) were undertaken in attempt to explain additional systematic variation between studies. Prediction intervals were additionally calculated in the case of statistical heterogeneity to obtain a range of potential future effect sizes that incorporate the systematic variability in the data [ 109 ]. We considered these sensitivity analyses as a method for examining the validity of our a priori subgroups. Additional sensitivity analysis included effect size pooling for each of the 13 outcome types, analysis of influential studies (ie, studies that, if removed, would change the substantive interpretation of the effect size), and analyses using traditional meta-analytic methods (ie, average dependent effect sizes to the study level and then calculate random effects pooled effect sizes and corresponding hypothesis test statistics). To test for potential publication bias, the relationship between the inverse of the SE and effect size was examined with graphical plots and a rank-order correlation [ 110 ]. In this analysis, asymmetry within the plot (ie, the majority of studies located at the bottom right quadrant) and a negative correlation would suggest publication bias. Finally, the risk of bias results is summarized for the sample of primary studies. Results Primary Study Inclusion Results PRISMA guidelines were followed ( Multimedia Appendix 4 ), and the study inclusion flow for this study is summarized in Figure 1 . The final meta-analytic sample included K =65 studies ( k =45 related reports; N=24,145 individuals) of dCBIs for AOD. Figure 1. Open in a new tab PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flowchart. Primary Study Descriptive Characteristics All sample-level study characteristics are summarized in Table 1 , while characteristics at the individual study level are in Table 2 . The sample included 65 randomized trials ( K =110 publications; 753 effect sizes [consumption: 475; psychosocial: 278]) of dCBI for adult AOD published between 1997 and 2024 [ 36 - 44 , 46 - 100 , 111 - 150 ]. The mean sample size was 371.46 (SD 997.65) participants with a minimum of 20 [ 36 ] and a maximum of 7935 [ 37 ]. For participant characteristics, the samples’ mean age was 37.69 (SD 8.88) years, and samples were 45.63% female (SD 19.89%; 100% for 2 studies [ 38 , 39 ]) on average. Among studies that reported racial and ethnic data, the mean samples were 21.77% Asian or Pacific Islander (SD 38.92%; 100% Asian in Liang et al [ 111 ]), 34.24% (SD 24.11%) Black, 15.49% (SD 28.67%) Native American or Indigenous person, 59.62% (SD 24.43%) White, and 6.99% (SD 5.84%) multiracial. The mean samples were 20.25% (SD 22.79%; 100% in Paris et al [ 40 ]) of Latine ethnicity. Additional sample characteristics included sexual orientation, sex identity, education, and employment status. While reporting on these factors was relatively infrequent across studies, these descriptive data are summarized in Table 1 . Table 1. Meta-analysis sample study characteristics. Variable K a (%) Mean (SD) Studies (n=65), n (%) Study 65 (100) 371.46 (997.65) — b Study date 65 (100) 2016.58 (4.86) — Age (years) 63 (97) 37.69 (8.88) — Sex — Female 65 (100) 45.63 (19.89) Transgender 4 (6) 3.93 (3.35) Not heterosexual 3 (5) 26.93 (11.90) Race and ethnicity — Asian or Pacific Islander 6 (9) 21.77 (38.92) Black 20 (31) 34.24 (24.11) Hispanic or Latine 22 (34) 20.25 (22.79) Indigenous 7 (11) 15.49 (28.67) White 25 (38) 59.62 (24.43) Multiracial 8 (12) 6.99 (5.84) Education Some college 23 (35) 45.81 (23.69) — Employment status Employed 38 (58) 50.81 (22.17) — Drug targeted — — Alcohol 35 (53.85) Cannabis 7 (10.77) Opioid 5 (7.69) Polydrug 13 (20) Stimulant 5 (7.69) Use disorder — — No 25 (38.46) Yes 40 (61.54) Co-occurring condition — — No 55 (84.62) Yes 10 (15.38) Combined therapy — — MI c alone 27 (41.54) Other 12 (18.46) Not applicable 26 (40) Plus pharmacotherapy — — No 52 (80) Yes 13 (20) Clinician supported — — No 41 (63.08) Yes 24 (36.92) Number of modules 54 12.20 (15.17) — Context — — College setting 4 (6.15) Community sample 30 (46.15) Medical setting 2 (3.08) Other or multiple settings 12 (18.46) Specialty setting 17 (26.15) Publication country — — United States 26 (40) Non–United States 39 (60) Overall risk of bias — — High risk 53 (81.54) Low risk 1 (1.54) Unclear 11 (16.94) Open in a new tab a K=number of studies. b Not applicable. c MI: motivational interviewing. Table 2. Digitally delivered cognitive behaviorally based intervention (dCBI) primary study characteristics at the study level a . Author (year) Values, n Treatment and comparison conditions Drug targeted Time point Outcomes dCBI compared to assessment only or minimal treatment Andersson (2015) [ 47 ] 1678 Internet intervention versus no treatment Alcohol 6 weeks Use frequency, peak consumption, quantity, dependence severity Baumgartner et al (2021) [ 49 ] 689 Adherence-focused guidance enhancement for alcohol and depression versus internet as usual Alcohol 3, 6 months Abstinence, use frequency, quantity, dependence severity, mental health symptoms Baumgartner et al (2021) [ 50 ] 575 CANreduce 2 versus internet as usual Cannabis 3 months Use frequency, dependence severity, mental health symptoms Blankers et al (2011) [ 52 ], arm 1 205 Self-help alcohol online versus waitlist Alcohol 3, 6 months Quantity, dependence severity, quality of life Bonar et al (2022) [ 53 ] 149 Social media intervention versus attention-matched Facebook group Cannabis 3, 6 months Use frequency, quantity Brendryen et al (2014) [ 54 ] 244 Balance versus screening with feedback plus online booklet Alcohol 2, 6 months Quantity Brief et al (2013) [ 41 ] 600 VetChange versus delayed intervention group Alcohol 0 weeks Heavy use frequency, quantity, mental health symptoms Chander et al (2021) [ 38 ] 439 Computer-delivered brief alcohol intervention versus oral health intervention Alcohol 3, 6, 12 months Use frequency, heavy use frequency, quantity Cunningham (2012) [ 43 ] 170 The alcohol help center versus Check Your Drinking screener Alcohol Posttreatment, 6 months Peak, quantity, dependence severity Daros et al (2024) [ 62 ] 72 Pocket Skills 2.0 versus delayed treatment Polydrug 4, 12 weeks Severity, coping outcomes, mental health symptoms, quality of life Deady et al (2016) [ 42 ] 104 DEAL Project versus HealthWatch attention-matched control Alcohol 3, 6 months Use frequency, quantity, mental health symptoms Gajecki et al (2017) [ 64 ] 186 TeleCoach versus waitlist Alcohol 12 weeks Quantity Guillemont et al (2017) [ 68 ] 1147 Alcoometre versus brief feedback with diary Alcohol 0 weeks Quantity, dependence severity Hester and Delaney (1997) [ 36 ] 40 Behavioral Self-Control Program for Windows versus waitlist Alcohol 0 weeks Use frequency, peak consumption, quantity Johansson et al (2021) [ 72 ] 1169 Self-help internet-based CBT b versus information on changing alcohol habits Alcohol 3, 6 months Abstinence, peak consumption, quantity, dependence severity, mental health symptoms, quality of life Kramer et al (2009) [ 78 ] 181 Drinking Less TV self-help course versus waitlist Alcohol 0 weeks Quantity, dependence severity, consequences Leeman et al (2016) [ 79 ] 208 Tertiary Health Research Intervention via Email versus Electronic brochure Alcohol 1, 6 months Use frequency, heavy use frequency, peak consumption, quantity, consequences, coping outcomes Liang et al (2018) [ 111 ] 75 S-Health versus psychoeducational text messages alone Opioids 4 weeks Abstinence, use frequency Mujcic et al (2022) [ 81 ] 103 MyCourse versus digital brochure Alcohol 2, 5, 11 months Abstinence, quantity, dependence severity Riper et al (2008) [ 84 ] 261 Drinking Less versus psychoeducational brochure Alcohol 6 months Quantity, dependence severity Schaub et al (2015) [ 87 ] 308 CANreduce versus waitlist Cannabis 3 months Use frequency, quantity, dependence severity, other drug use, mental health symptoms Schaub et al (2019) [ 86 ] 311 Snow control versus waitlist Stimulant Posttreatment, 6 months Use frequency, quantity, dependence severity, other drug use, mental health symptoms Sinadinovic et al (2014) [ 91 ], arm 1 633 Alkoholhjalpen versus waitlist Alcohol 3, 6, 12 months Quantity Sinadinovic et al (2020) [ 90 ] 303 A way out of fog versus waitlist Cannabis 6 weeks Abstinence, quantity, dependence severity, other drug use, mental health symptoms, quality of life Stapinski et al (2021) [ 92 ] 123 Inroads anxiety and alcohol use intervention versus assessment plus alcohol information Alcohol 3 weeks, 5 months Peak, quantity, dependence severity, consequences, mental health symptoms, quality of life Sunami et al (2021) [ 93 ] 100 Sensible and Natural Alcoholism Prevention Program for You: Diary On Computer versus assessment only Alcohol 8 weeks Abstinence, quantity, dependence severity Sundström et al (2020) [ 94 ] 166 Low-intensity internet intervention versus waitlist Alcohol 0 weeks Heavy use frequency, quantity, dependence severity, cognitive outcomes, mental health symptoms, quality of life Tait et al (2014) [ 95 ] 160 breakingtheice versus waitlist Stimulant 6 months Abstinence, consequences, other drug use, cognitive outcomes, mental health symptoms, quality of life Wallace et al (2011) [ 37 ] 7935 Down Your Drink versus text-based information about alcohol harms Alcohol 3, 12 months Use frequency, peak consumption Wilks et al (2018) [ 99 ] 59 Internet-delivered DBT c skills training intervention versus Waitlist Alcohol 2 months Quantity, dependence severity, mental health symptoms Zill et al (2019) [ 100 ] 608 Vorvida versus waitlist Alcohol 0 weeks Peak, consequences, quantity dCBI compared to another treatment or TAU d Augsburger et al (2022) [ 48 ] 589 Online self-help intervention versus self-test including personalized feedback Alcohol 6 months Abstinence, quantity, dependence severity, cognitive outcomes, mental health symptoms Berman et al (2020) [ 51 ] 89 TeleCoach versus control app Alcohol 6 weeks Use frequency, peak consumption, quantity, cognitive outcomes Blankers et al (2011) [ 52 ], arm 2 205 Self-help alcohol online versus therapy alcohol online Alcohol 3, 6 months Quantity, dependence severity, quality of life Budney et al (2015) [ 55 ], arm 1 75 Computer-delivered MET e /CBT/CM f (COMPUTER) versus brief MET intervention+incentive program Cannabis Posttreatment, 9 months Abstinence Gonzalez and Dulin (2015) [ 66 ] 60 Location-based monitoring and intervention for alcohol use disorders versus Drinker’s Check-up plus bibliotherapy Alcohol 0 weeks Abstinence, heavy use frequency Kay-Lambkin et al (2009) [ 75 ], arm 1 97 Computer-delivered Self-Help for Alcohol and other drug use and Depression versus brief intervention alone Polydrug 3, 9 months Heavy use frequency, mental health symptoms Kay-Lambkin et al (2011) [ 74 ], arm 1 274 Clinician-assisted computerized treatment versus person-centered therapy Polydrug Posttreatment, 1, 4, 10 months Severity, mental health symptoms, other Kiluk et al (2018) [ 77 ], arm 1 137 CBT4CBT g versus Outpatient TAU Polydrug Posttreatment, 3, 6 months Abstinence, dependence severity, frequency, consequences O’Donnell et al (2019) [ 82 ] 45 Minimize versus control app with self-monitoring only Alcohol 0 weeks Peak, coping outcomes, general health, quality of life Olthof et al (2023) [ 83 ] 378 ICan versus online educational modules Cannabis 3, 6 months Use frequency, quantity, dependence severity, cognitive outcomes, coping outcomes Rooke et al (2013) [ 85 ] 225 Reduce Your Use versus control information Cannabis 3 months Abstinence, use frequency, quantity, dependence severity, consequences Schaub et al (2012) [ 88 ] 196 Snow control versus psychoeducational modules Stimulant Posttreatment, 20 weeks Abstinence, quantity, dependence severity, other drug use, cognitive outcomes, mental health symptoms Sinadinovic et al (2014) [ 91 ], arm 2 633 Alkoholhjalpen versus eScreen.se Alcohol 3, 6, 12 months Quantity dCBI plus TAU compared to TAU only Acosta et al (2017) [ 46 ] 162 Thinking Forward+TAU versus primary care TAU Polydrug 3 months Use frequency, heavy use frequency, other drug use, mental health symptoms, quality of life Campbell et al (2014) [ 56 ] 507 TES h +TAU versus TAU Polydrug 0 weeks Abstinence Campbell et al (2023) [ 57 ] 53 TES-Native version+TAU versus TAU Polydrug 0, 12 weeks Abstinence, consequences, coping outcomes, quality of life Carroll et al (2008) [ 58 ] 73 CBT4CBT+TAU versus TAU Polydrug Posttreatment, 3, 6 months Abstinence, coping outcomes Carroll et al (2014) [ 59 ] 101 CBT4CBT+TAU versus TAU (MMT i ) Stimulant Posttreatment, 6 months Abstinence, consequences, coping outcomes Carroll et al (2018) [ 60 ] 120 CBT4CBT+TAU versus TAU (MMT) Stimulant Posttreatment, 3 months Abstinence, quantity Christensen et al (2014) [ 61 ] 170 CRA j +CM online versus buprenorphine+CM Opioids 0 weeks Abstinence Farren et al (2015) [ 63 ] 55 Cognitive relapse prevention-based computerized therapy+TAU versus attention-matched arithmetic exercises+TAU Alcohol 3 months Abstinence, use frequency, quantity, cognitive outcomes, mental health symptoms Glasner et al (2020) [ 65 ] 35 CBT intervention (ALC k -TXT l -CBT)+TAU versus informational pamphlet and HIV TAU Alcohol 0 weeks Use frequency, heavy use frequency, general health Guarino et al (2018) [ 67 ] 110 Take Charge of Pain+TAU versus pain practice care TAU Opioids 3 months Consequences, general health, coping outcomes, mental health symptoms, quality of life Hester et al (2011) [ 69 ] 84 ModerateDrinking+Moderation Management versus Moderation Management alone Alcohol 3, 6, 12 months Consequences, quantity Hester et al (2013) [ 70 ] 189 Overcoming Addictions +Smart Recovery meetings versus Smart Recovery meetings Alcohol 3, 6 months Abstinence, quantity, consequences Hyland et al (2023) [ 71 ] 264 iCBT m +TAU versus TAU Alcohol 3, 12 months Abstinence, heavy use frequency, quantity, dependence severity, mental health symptoms, quality of life Kelpin et al (2022) [ 39 ] 63 CBT4CBT+TAU versus residential TAU Polydrug 12 weeks Abstinence, use frequency Kiluk et al (2016) [ 76 ] 68 CBT4CBT+TAU versus outpatient TAU Alcohol Posttreatment, 3, 6 months Abstinence, heavy use frequency Marsch et al (2014) [ 80 ] 160 TES+MMT versus MMT Opioids 12 months Abstinence Paris et al (2018) [ 40 ] 92 CBT4CBT-Spanish+TAU versus outpatient TAU Polydrug Posttreatment, 3, 6 months Abstinence Schouten et al (2024) [ 44 ] 163 Beating the Booze+TAU versus TAU Alcohol 3, 6 months Quantity, dependence severity, mental health symptoms Shi et al (2019) [ 89 ] 20 CBT4CBT+buprenophine+TAU versus buprenorphine maintenance+TAU Opioids 0 weeks Abstinence Takano et al (2020) [ 112 ] 48 e-Learning Serigaya Methamphetamine Relapse Prevention Program+outpatient treatment versus self-monitoring+outpatient treatment Polydrug Posttreatment, 3, 6 months Abstinence, cognitive outcomes Tetrault et al (2020) [ 97 ] 58 CBT4CBT+standard care versus primary care standard care Polydrug 0 weeks Abstinence, use frequency dCBI compared to CBI with a therapist Budney et al (2015) [ 55 ], arm 2 75 Computer-delivered MET/CBT/CM (COMPUTER) versus CBT+CM Cannabis Posttreatment, 9 months Abstinence Johansson et al (2020) [ 73 ] 301 Internet‐delivered CBT versus module content via therapy sessions Alcohol 3, 6 months Quantity, abstinence, peak consumption, dependence severity, mental health symptoms, quality of life Kay-Lambkin et al (2009) [ 75 ], arm 2 97 Computer-delivered Self-Help for Alcohol and other drug use and Depression intensive therapy versus in-person CBT or MI n Polydrug 3, 9 months Heavy use frequency, mental health symptoms Kay-Lambkin et al (2011) [ 74 ], arm 2 274 Clinician-assisted computerized treatment versus in-person CBT or MI Polydrug Posttreatment, 1, 4, 10 months Severity, mental health symptoms, other Kiluk et al (2018) [ 133 ], arm 2 137 CBT4CBT versus CBT in-person Polydrug Posttreatment, 6 months Abstinence, dependence severity, frequency, consequences Tiburcio et al (2018) [ 98 ], arm 1 83 Programa de Ayuda para Abuso de Drogas y Depresión versus CBT in-person Polydrug Posttreatment, 1 month Use frequency, dependence severity, mental health symptoms Tiburcio et al (2018) [ 98 ], arm 2 83 Programa de Ayuda para Abuso de Drogas y Depresión versus treatment center TAU with self-help guide Polydrug Posttreatment, 1 month Use frequency, dependence severity, mental health symptoms Open in a new tab a K =65 with 71 study arms. b CBT: cognitive behavioral therapy. c DBT: dialectical behavioral therapy. d TAU: treatment as usual. e MET: motivational enhancement therapy. f CM: contingency management. g CBT4CBT: computer-based training for cognitive behavioral therapy. h TES: therapeutic enhancement system. i MMT: methadone maintenance treatment. j CRA: community reinforcement approach. k ALC: alcohol (use). l TXT: text messaging. m iCBT: internet-based cognitive behavioral therapy. n MI: motivational interviewing. The primary substance targets were alcohol use (35/65, 53.85%), followed by polydrug use (13/65, 20%), with a majority of samples meeting criteria for an alcohol or substance use disorder (40/65, 61.54%). Further, 15.38% (10/65) of studies targeted a co-occurring condition, such as posttraumatic stress disorder [ 41 ] or depression [ 42 ]. While full details on study interventions can be found in Multimedia Appendix 2 , the mean length of treatment was 12.20 (SD 15.17) modules or exercises, 36.92% (24/65) included some form of clinical support, such as online support [ 43 ] or feedback on homework [ 112 ], and over half of the interventions included elements of other evidence-based treatments (eg, motivational interviewing). For study context, participants were mostly recruited from the community via online advertising (30/65, 46.15%), followed by specialty mental health or addictions treatment facilities (17/65, 26.15%). A majority of studies took place outside of the United States (39/65, 60%). Finally, study-level risk of bias results showed that most studies had at least 1 high risk designation (which we then designated as high risk overall), and these were typically due to a lack of participant or personal blinding or incomplete outcome data ( Multimedia Appendix 5 ). dCBI Effect Size by Outcome Class and Comparison Type Overview Primary study effect sizes were pooled by outcome class and comparison type. When effect sizes were pooled across all 4 between-condition comparisons, the overall pooled effect for consumption outcomes was small, positive, statistically significant, and heterogeneous ( g =0.22, 95% CI 0.14-0.30; P< .001; τ=0 . 08; I 2 =76.7%; k =63; k es =274). Psychosocial outcomes showed a similar pattern of results ( g =0.15, 95% CI 0.06-0.23; P =.001; τ 2 =0 . 06; I 2 =70.1%; k =39; k es =147). These findings were consistent across correlation values and similar to findings based on traditional meta-analytic methods ( Multimedia Appendix 6 ). The following sections consider pooled effect sizes by each between-condition comparison, followed by within-condition comparisons. dCBI Compared to Minimal Treatment Studies of dCBI compared to assessment only or minimal treatment showed a small, positive, and significant effect for consumption ( g =0.27, 95% CI 0.15-0.39; P< .001; τ 2 =0 . 10; I 2 =85.1%; k =31; k es =134) and psychosocial outcomes ( g =0.16, 95% CI 0.05-0.27; P =.008; τ 2 =0 . 04; I 2 =75.2%; k =16; k es =60) over follow-up. Heterogeneity data showed systematic, relative to random variability, suggesting the utility of further moderation analyses. The 95% prediction interval suggested that future studies of dCBI for AOD with minimal treatment comparators may observe consumption effect sizes ranging from –0.39 to 0.93 and psychosocial effect sizes ranging from –0.29 to 0.61. Findings were consistent across correlation values and like those based on traditional meta-analytic methods ( Multimedia Appendix 6 ). For assessment of bias due to publication status in studies contrasting dCBI with a minimal control, Figures S1 and S2 in Multimedia Appendix 7 show symmetry in the distribution of effect sizes by magnitude and SE. This does not suggest publication bias. dCBI Compared to Another Treatment Studies of dCBI compared to a control treatment or treatment as usual showed a nonsignificant effect for consumption outcomes over follow-up ( g =0.08, 95% CI –0.23 to 0.39; P =.59; τ 2 =0 . 12; I 2 =80.0%; k =12; k es =53). Psychosocial outcomes were also nonsignificant ( g =0.19, 95% CI –0.17 to 0.54; P =.26; τ 2 =0 . 15; I 2 =84.6%; k =10; k es =33). Heterogeneity data showed values above our threshold, but only the consumption pooled effect size met our sample size criterion. The 95% prediction interval suggested that future studies of dCBI for AOD compared to another treatment may observe consumption effect sizes ranging from –0.77 to 0.93 and psychosocial effect sizes ranging from –0.79 to 1.17. Findings were consistent across correlation values and like those based on traditional meta-analytic methods ( Multimedia Appendix 6 ). For assessment of bias due to publication status in studies contrasting dCBI with another treatment, Figures S3 and S4 in Multimedia Appendix 7 do not suggest an association between SE and effect size. dCBI as an Addition to Treatment as Usual Studies of dCBI as an addition to treatment as usual, compared to treatment as usual alone, showed a small, positive, and significant effect for consumption outcomes over follow-up ( g =0.23, 95% CI 0.14-0.31; P<. 001; τ 2 <. 01; I 2 =9.8%; k =20; k es =65), while psychosocial outcomes were nonsignificant ( g =0.15, 95% CI –0.04 to 0.33; P =.11; τ 2 =0 . 06; I 2 =56.6%; k =12; k es =41). However, for psychosocial outcomes, Schouten et al [ 44 ] was an influential study, such that when removed, the effect size was statistically significant ( g =0.15, 95% CI 0.02-0.29). Heterogeneity data for psychosocial outcomes were slightly above our threshold, and the 95% prediction interval was –0.43 to 0.73. Findings were consistent across correlation values and like those based on traditional meta-analytic methods ( Multimedia Appendix 6 ). For assessment of bias due to publication status in studies testing dCBI as an addition to usual care, Figures S5 and S6 in Multimedia Appendix 7 do not suggest an association between SE and effect size. dCBI Compared to CBI Delivered by a Therapist A small number of studies in this review examined dCBI in comparison to CBI delivered by a therapist. These studies showed a nonsignificant effect for consumption ( g =0.18, 95% CI –0.23 to 0.59; P =.27; τ 2 =0 . 11; I 2 =42.41%; k =5; k es =21) and psychosocial outcomes ( g< 0.01, 95% CI –0.24 to 0.24; P =.99; τ 2 =0 . 01; I 2 =25.2%; k =5; k es =15) over follow-up. Heterogeneity data did not suggest the need for further moderator analysis or calculation of prediction intervals. Findings were consistent across correlation weights and like those based on traditional meta-analytic methods ( Multimedia Appendix 6 ). For assessment of bias due to publication status in studies testing dCBI compared to CBI delivered by a therapist, Figures S7 and S8 in Multimedia Appendix 7 do not suggest an association between SE and effect size. dCBI Change From Baseline While between-group effect sizes offer a measure of intervention effect compared to some form of control, within-group effect sizes provide information on the extent of change after receiving the intervention. For consumption outcomes over follow-up, the effect was large, positive, and statistically significant ( g =0.71, 95% CI 0.62-0.80; P< .001; τ 2 =0 . 12; I 2 =92.6%; k =45; k es =201). Psychosocial outcomes were slightly smaller in magnitude, but the pattern of results was similar ( g =0.52, 95% CI 0.39-0.66; P< .001; τ 2 =0 . 18; I 2 =94.4%; k =36; k es =131). Heterogeneity data suggested the utility of further moderation analyses. The 95% prediction interval suggests that future studies of dCBI for AOD may observe within-group consumption effect sizes ranging from 0.01 to 1.41 and psychosocial effect sizes ranging from –0.35 to 1.39. Findings were consistent across correlation weights and like those based on traditional meta-analytic methods ( Multimedia Appendix 6 ). Moderation of Heterogeneous Effect Sizes This study considered outcome class and comparison type as subgroup moderators to derive pooled effect sizes describing dCBI for AOD. However, significant residual heterogeneity was observed when dCBI was compared to minimal treatment (consumption and psychosocial outcomes), another treatment (consumption outcomes), when CBI was added to usual care and compared to usual care alone (psychosocial outcomes), and when within-dCBI effect sizes were estimated (consumption and psychosocial outcomes). In these sensitivity analyses, outcome time point (ie, posttreatment to 3 months vs 4 months or later) and primary drug targeted (ie, alcohol, polydrug, and other) were selected as study-level moderators in multivariate, correlated effects meta-regression models. For dCBI consumption outcomes in contrast to a minimal control, early follow-up studies were associated with smaller effect sizes than later follow-up studies, and polydrug studies showed smaller effects than alcohol studies. For dCBI psychosocial outcomes in contrast to a minimal control, polydrug studies also showed smaller effects than alcohol studies. The remaining pooled effect estimates, time point, and primary drug targeted were not significantly associated with effect size magnitude (see Table 3 for details). Table 3. Moderation of heterogeneous pooled effect sizes. Comparison Consumption Psychosocial b (SE) df P value b (SE) df P value dCBI a compared to assessment only or minimal treatment b Estimate 0.35 (0.08) c 18.81 <.001 0.21 (0.06) 8.63 .01 Time point – 0.18 (0.09) 20.27 .048 0.02 (0.13) 7.86 .91 Polydrug – 0.57 (0.08) 18.81 <.001 – 0.21 (0.06) 8.63 .01 Other –0.05 (0.13) 9.17 .72 –0.11 (0.12) 6.94 .38 dCBI compared to another treatment or treatment as usual d — e — — Estimate –0.29 (0.28) 5.63 f .34 Time point 0.27 (0.24) 8.10 f .30 Polydrug 0.85 (0.28) 1.66 f .12 Other 0.40 (0.29) 5.93 f .21 dCBI as an addition to treatment as usual g Estimate 0.22 (0.14) 5.66 f .17 Time point –0.25 (0.12) 6.11 f .08 Polydrug 0.05 (0.20) 6.49 f .80 Other –0.15 (0.22) 1.74 f .58 dCBI change from baseline h Estimate 0.77 (0.06) 28.8 <.001 0.56 (0.11) 19.70 <.001 Time point –0.06 (0.07) 33.4 .43 –0.02 (0.10) 25.90 .86 Polydrug — — — 0.15 (0.18) 10.30 .44 Other –0.12 (0.11) 24.2 .27 –0.21 (0.14) 18.50 .15 Open in a new tab a dCBI: digitally delivered cognitive behaviorally based intervention. b Consumption: I 2 =84.24, τ 2 =0.09; psychosocial: I 2 =70.34, τ 2 =0.05. c Values in italics format indicate estimates significant at P <.05. d Consumption: I 2 =78.70, τ 2 =0.13. e Not applicable. f Estimates <4 df unstable. g Psychosocial: I 2 =60.36, τ 2 =0.08. h Consumption: I 2 =92.49, τ 2 =0.12; psychosocial: I 2 =94.31, τ 2 =0.18. Pooled Effect Sizes for Each Outcome Type In this meta-analysis, 13 outcomes reported across 65 clinical trials of dCBI for AOD were aggregated into consumption and psychosocial outcome classes. In this final sensitivity analysis, we examined each outcome type individually to report pooled effect direction, magnitude, significance, and relative heterogeneity. The results of these analyses are separated by between- and within-group effect size types and are shown in Figures 2 and 3 , respectively. Figure 2 shows between-group effects, where all pooled effect sizes were positive and mostly small in magnitude. Statistically significant pooled estimates were observed for abstinence, frequency, quantity, use severity, consequences, other drug use, and mental health, but not heavy frequency, peak consumption, cognitive outcomes, coping outcomes, general health, and quality of life. Estimates of between-study variance, relative to sampling error, showed that heterogeneity was still above moderate in most of these estimates. Figure 3 shows within-group effects, where most pooled effect sizes were positive and large in magnitude. Statistically significant pooled estimates were observed for frequency, heavy frequency, peak consumption, quantity, use severity, consequences, other drug use, mental health, and quality of life, but not abstinence, cognitive outcomes, coping outcomes, and general health. Estimates of heterogeneity were above moderate for most subgroup effect sizes. Figure 2. Open in a new tab Between-group effect sizes (with SE) by outcome type. P values are marked to indicate statistical significance: *<.05, **<.01. Figure 3. Open in a new tab Within-group effect sizes (with SE) by outcome type. P values are marked to indicate statistical significance: *<.05, **<.01. Discussion Overview This is the first meta-analysis to evaluate the effect of dCBIs for AOD that included measures of psychosocial functioning as well as substance use consumption. The results generated here from 110 publications, involving 65 randomized controlled trials with over 24,000 combined participants, support the efficacy of dCBI at improving substance use and psychosocial outcomes with pooled findings suggesting a small relative benefit. However, more nuanced findings for between-group effects were apparent when studies were separated according to the type of comparison condition, with dCBI showing limited efficacy when compared to another treatment, in-person CBI, and when added to usual care (ie, nonsignificant efficacy in relation to psychosocial outcomes only). In total, 6 of 8 pooled between-group effect sizes showed statistical heterogeneity that was not fully accounted for by the time point of follow-up or the primary drug targeted within the clinical trial. Here, prediction intervals contained a wide range of consumption and psychosocial effect sizes that could be observed for dCBI for AOD in reference to minimal treatment, another treatment, or when added to usual care. Together, these sensitivity analyses suggest that there are unknown methodological or patient population factors driving variability in effects that were not identified by this study. Finally, within-condition effects that provide a nonexperimental estimate of change from baseline indicated significant, heterogeneous, and moderate to large effects for dCBI on consumption and psychosocial outcomes. These effects suggest that, on average, 60% to 80% of individuals who received dCBI showed improvement from baseline across various measures of substance use and functioning. As is often the case for meta-analyses of behavioral therapies for substance use disorders [ 151 ], including CBT [ 6 ], there is little evidence of superior efficacy of dCBI when directly compared with another therapy. Significant and small between-group effects of dCBI were observed for both consumption and psychosocial outcomes when compared to assessment only or minimal treatment, with evidence suggesting larger effects in alcohol studies and for consumption outcomes, at earlier follow-up time points. Yet, dCBIs were not efficacious when compared to another treatment such as treatment as usual or CBI delivered by a therapist. This pattern is consistent with findings of digital mental health interventions more broadly [ 45 , 152 ], such that they appear generally effective at improving symptoms of psychological conditions but are not necessarily more effective than in-person psychotherapeutic interventions. In terms of comparative treatment benefit (ie, between-group effects), when dCBI was provided as an adjunct to treatment as usual, there were significant and small effects on consumption outcomes when compared to treatment as usual alone. However, this significant effect did not extend to psychosocial outcomes. It may be that the beneficial effects of adding dCBI to standard care are most relevant for improving AOD and not general life functioning. It should be noted that fewer studies in this between-group comparison reported psychosocial outcomes compared to consumption outcomes, and the magnitude of the effect size for this between-group comparison was similar to the effect size when all comparisons were combined, which was significant. Thus, sample size may have impacted the statistical inference on psychosocial outcomes for studies evaluating dCBIs as an adjunct to standard care. Furthermore, when one influential study [ 112 ] was removed from this analysis, the between-group effect reached statistical significance. The findings with respect to substance use consumption outcomes are largely consistent with other meta-analytic examinations of dCBI (or related terminologies) for AOD. For instance, our prior meta-analysis of 15 published clinical trials of technology-delivered CBT for alcohol use found a significant and small effect as a stand-alone treatment in contrast to minimal treatment ( g =0.20), but the effect was nonsignificant when compared to a more active control [ 14 ]. Most recently, Gregory et al [ 13 ] reported a small, statistically significant effect ( g =–0.23) that favored dCBI in reducing substance use (alcohol, drugs, or alcohol or drugs combined) relative to controls in a meta-analysis of 18 published studies. Of note, the current meta-analysis is more comprehensive than existing reports both in terms of the number of studies included and the type and number of outcomes reported. This is the first report of the pooled effect of dCBI on various psychosocial outcomes, including consequences of AOD, mental health symptoms, general health, quality of life, cognitive outcomes, and coping outcomes. This provides a more robust evaluation of dCBI efficacy and effects in terms of expanded definitions of recovery beyond alcohol or drug abstinence [ 15 , 153 , 154 ]. Although significant between-group effects demonstrating the efficacy of dCBI on psychosocial outcomes were more limited in scope as compared to consumption outcomes, it is notable that pooled between-group effect sizes for consequences and mental health outcomes were significant, as problems in these areas are often among the reasons for seeking treatment for AOD [ 155 ]. The within-group findings (ie, not compared to a control condition), while statistically heterogeneous, suggest that dCBI is effective at reducing other drug use and consequences from AOD, as well as improving mental health and quality of life. Thus, dCBI as an intervention can have a beneficial effect on some psychosocial outcomes, but the benefit across multiple domains may not be superior to that achieved through another established treatment for AOD. Strengths, Limitations, and Conclusions This meta-analysis provides the most comprehensive view of dCBI outcomes to date. Therefore, a key strength of this work was the capacity to extract all available data from primary study reports and to report on 2 broad outcome classes—consumption and psychosocial—as well as 13 different outcome types. The extent of clinical effect data provided is substantial. However, there are some limitations to consider. For example, we prioritized published clinical trials to facilitate consistency in methodology, but it is unknown whether the inclusion of gray literature such as dissertations and conference abstracts would have changed our study findings. While our sample of studies is relatively large for a meta-analysis and certainly larger than dCBI reviews to date, sample size still may have impacted our capacity to observe statistical significance for some pooled effect estimates. Study reporting, however, is transparent as to the number of studies and effect sizes that each pooled effect represents. Reporting of demographic characteristics, especially race or ethnicity, was incomplete across studies, which restricts conclusions regarding generalizability. Limitations in sample sizes for certain outcomes also led to the grouping of measures such as motivation, craving, and self-efficacy into a single outcome type (ie, cognitive outcomes) when there are important conceptual differences between these measures. This limitation underscores the importance of future studies not only reporting all outcome data in descriptive format but also reporting all primary and secondary outcomes. As a result, more stable and informative pooled effect sizes would be possible in the future. It is also the case that some pooled estimates contained significant residual heterogeneity, which suggests that effect estimates were variable within groupings beyond what could be attributed to sampling error. While the primary drug targeted and the time point of follow-up were drivers in some studies, undiscovered moderators are possible. For instance, the varied characteristics of dCBIs included here (eg, range of dose and duration and integration with other evidence-based approaches) may have contributed to effect heterogeneity. The question of what defines CBT for AOD has become more challenging due to its evolution and diffusion over the years, resulting in new forms of CBT that may not fit traditional definitions but that have shared theoretical underpinnings, processes of change, and techniques [ 156 ]. Finally, the impact of user engagement on outcomes remains an unanswered question. Low engagement, or the lack of uptake and/or poor adherence, is one of the most widely cited challenges and is considered the greatest barrier to progress in digital mental health [ 157 , 158 ]. The lack of consistent reporting of rates of engagement with the dCBIs in the studies included here precluded an empirical investigation of this issue. With these limitations in mind, the results of this meta-analysis show a modest benefit for dCBI as a stand-alone therapy and as an addition to usual care. Importantly, stand-alone effects were observed for consumption outcomes as well as measures of psychosocial functioning. Moreover, the comprehensive approach to outcome extraction resulted in effect estimates for a range of functional end points and suggests that across comparison conditions and length of follow-up, small effects can be observed on various consumption measures, including abstinence and use severity, and on psychosocial measures, such as consequences and mental health symptoms. When change from baseline is examined, the effects are moderate to large and statistically significant for all outcomes except for abstinence, cognitive and coping outcomes, as well as general health. Overall, the results of this meta-analysis provide further evidence supporting the beneficial effect, albeit small, of dCBIs in reducing substance use and suggest that the benefits may extend to some psychosocial outcomes. This is critical because recovery from AOD is not confined to substance use outcomes and should be considered holistically. Acknowledgments The authors would like to thank the primary study authors who collected the original data and responded to requests for data. Abbreviations AOD alcohol and other drug use CBI cognitive behaviorally based intervention CBT cognitive behavioral therapy dCBI digitally delivered cognitive behaviorally based intervention DSM Diagnostic and Statistical Manual PRISMA Preferred Reporting Items for Systematic Reviews and Meta-Analyses Multimedia Appendix 1 Sample search strategy. mental_v13i1e82370_app1.docx (18.9KB, docx) Multimedia Appendix 2 Digitally delivered cognitive behaviorally based intervention and comparator descriptions. mental_v13i1e82370_app2.docx (97KB, docx) Multimedia Appendix 3 Measures and outcome scoring. mental_v13i1e82370_app3.docx (55.9KB, docx) Multimedia Appendix 4 PRISMA checklist. mental_v13i1e82370_app4.docx (35KB, docx) Multimedia Appendix 5 Sample-level risk of bias assessment. mental_v13i1e82370_app5.docx (57.2KB, docx) Multimedia Appendix 6 Meta-analysis with study effect sizes averaged to the study level. mental_v13i1e82370_app6.docx (23.4KB, docx) Multimedia Appendix 7 Plot of assessment of publication bias. mental_v13i1e82370_app7.docx (246.9KB, docx) Data Availability The datasets generated or analyzed during this study are available from the corresponding author on reasonable request. Funding This research is supported by the National Institute on Alcohol Abuse and Alcoholism (grant R01 AA029703; to MM). Footnotes Conflicts of Interest: BDK receives consulting fees from CBT4CBT LLC outside the submitted work. This conflict is managed by Yale University. References 1. GBD 2016 Alcohol and Drug Use Collaborators The global burden of disease attributable to alcohol and drug use in 195 countries and territories, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Psychiatry. 2018 Dec;5(12):987–1012. doi: 10.1016/S2215-0366(18)30337-7. https://linkinghub.elsevier.com/retrieve/pii/S2215-0366(18)30337-7 .S2215-0366(18)30337-7 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 2. Connery HS, McHugh RK, Reilly M, Shin S, Greenfield SF. Substance use disorders in global mental health delivery: epidemiology, treatment gap, and implementation of evidence-based treatments. Harv Rev Psychiatry. 2020;28(5):316–327. doi: 10.1097/HRP.0000000000000271. https://europepmc.org/abstract/MED/32925514 .00023727-202009000-00004 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 3. Grant BF, Goldstein RB, Saha TD, Chou SP, Jung J, Zhang H, Pickering RP, Ruan WJ, Smith SM, Huang B, Hasin DS. Epidemiology of DSM-5 alcohol use disorder: results from the National Epidemiologic Survey on Alcohol and Related Conditions III. JAMA Psychiatry. 2015;72(8):757–766. doi: 10.1001/jamapsychiatry.2015.0584. https://europepmc.org/abstract/MED/26039070 .2300494 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 4. Laudet AB. The case for considering quality of life in addiction research and clinical practice. Addict Sci Clin Pract. 2011;6(1):44–55. https://europepmc.org/abstract/MED/22003421 . [ PMC free article ] [ PubMed ] [ Google Scholar ] 5. McHugh RK, Hearon BA, Otto MW. Cognitive behavioral therapy for substance use disorders. Psychiatr Clin North Am. 2010;33(3):511–525. doi: 10.1016/j.psc.2010.04.012. https://europepmc.org/abstract/MED/20599130 .S0193-953X(10)00054-7 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 6. Magill M, Ray L, Kiluk B, Hoadley A, Bernstein M, Tonigan JS, Carroll K. A meta-analysis of cognitive-behavioral therapy for alcohol or other drug use disorders: treatment efficacy by contrast condition. J Consult Clin Psychol. 2019;87(12):1093–1105. doi: 10.1037/ccp0000447. https://europepmc.org/abstract/MED/31599606 .2019-60860-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 7. Ray LA, Meredith LR, Kiluk BD, Walthers J, Carroll KM, Magill M. Combined pharmacotherapy and cognitive behavioral therapy for adults with alcohol or substance use disorders: a systematic review and meta-analysis. JAMA Netw Open. 2020;3(6):e208279. doi: 10.1001/jamanetworkopen.2020.8279. https://europepmc.org/abstract/MED/32558914 .2767358 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 8. Magill M, Helminen EC, Lynch-Gadaleta B, Allen K, Kiluk BD, Ray LA. Cognitive-behavioral interventions for co-occurring substance use and mental health disorders. Drug Alcohol Depend. 2025;274:112756. doi: 10.1016/j.drugalcdep.2025.112756.S0376-8716(25)00209-1 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 9. Harvey AG, Gumport NB. Evidence-based psychological treatments for mental disorders: modifiable barriers to access and possible solutions. Behav Res Ther. 2015;68:1–12. doi: 10.1016/j.brat.2015.02.004. https://europepmc.org/abstract/MED/25768982 .S0005-7967(15)00028-5 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 10. Carroll KM, Kiluk BD. Cognitive behavioral interventions for alcohol and drug use disorders: through the stage model and back again. Psychol Addict Behav. 2017;31(8):847–861. doi: 10.1037/adb0000311. https://europepmc.org/abstract/MED/28857574 .2017-37799-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 11. Lattie EG, Stiles-Shields C, Graham AK. An overview of and recommendations for more accessible digital mental health services. Nat Rev Psychol. 2022;1(2):87–100. doi: 10.1038/s44159-021-00003-1. https://europepmc.org/abstract/MED/38515434 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 12. Gushken F, Costa GPA, de Paula Souza A, Heringer D, Anand A. Internet-based cognitive behavioral therapy for alcohol use disorder: a systematic review of evidence and future potential. J Subst Use Addict Treat. 2025;171:209627. doi: 10.1016/j.josat.2025.209627.S2949-8759(25)00006-2 [ DOI ] [ PubMed ] [ Google Scholar ] 13. Gregory VL, Wilkerson DA, Wolfe-Taylor SN, Miller BL, Lipsey AD. Digital cognitive-behavioral therapy for substance use: systematic review and meta-analysis of randomized controlled trials. Am J Drug Alcohol Abuse. 2024;50(6):771–785. doi: 10.1080/00952990.2024.2400934. [ DOI ] [ PubMed ] [ Google Scholar ] 14. Kiluk BD, Ray LA, Walthers J, Bernstein M, Tonigan JS, Magill M. Technology-delivered cognitive-behavioral interventions for alcohol use: a meta-analysis. Alcohol Clin Exp Res. 2019;43(11):2285–2295. doi: 10.1111/acer.14189. https://europepmc.org/abstract/MED/31566787 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 15. Hagman BT, Falk D, Litten R, Koob GF. Defining recovery from alcohol use disorder: development of an NIAAA Research Definition. Am J Psychiatry. 2022;179(11):807–813. doi: 10.1176/appi.ajp.21090963. [ DOI ] [ PubMed ] [ Google Scholar ] 16. Karlsson P, Bergmark A. Compared with what? An analysis of control-group types in Cochrane and Campbell reviews of psychosocial treatment efficacy with substance use disorders. Addiction. 2015;110(3):420–428. doi: 10.1111/add.12799. https://europepmc.org/abstract/MED/25393504 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 17. Black N, Mullan B, Sharpe L. Computer-delivered interventions for reducing alcohol consumption: meta-analysis and meta-regression using behaviour change techniques and theory. Health Psychol Rev. 2016;10(3):341–357. doi: 10.1080/17437199.2016.1168268. [ DOI ] [ PubMed ] [ Google Scholar ] 18. Carey KB, Scott-Sheldon LAJ, Elliott JC, Garey L, Carey MP. Face-to-face versus computer-delivered alcohol interventions for college drinkers: a meta-analytic review, 1998 to 2010. Clin Psychol Rev. 2012;32(8):690–703. doi: 10.1016/j.cpr.2012.08.001. https://europepmc.org/abstract/MED/23022767 .S0272-7358(12)00114-6 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 19. Dedert EA, McDuffie JR, Stein R, McNiel JM, Kosinski AS, Freiermuth CE, Hemminger A, Williams JW. Electronic interventions for alcohol misuse and alcohol use disorders: a systematic review. Ann Intern Med. 2015;163(3):205–214. doi: 10.7326/M15-0285. https://europepmc.org/abstract/MED/26237752 .2411833 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 20. Garnett C, Crane D, Brown J, Kaner E, Beyer F, Muirhead C, Hickman M, Redmore J, de Vocht F, Beard E, Michie S. Reported theory use by digital interventions for hazardous and harmful alcohol consumption, and association with effectiveness: meta-regression. J Med Internet Res. 2018;20(2):e69. doi: 10.2196/jmir.8807. https://www.jmir.org/2018/2/e69/ v20i2e69 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 21. Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res. 2012;12(6):745–764. doi: 10.1586/erp.12.67. [ DOI ] [ PubMed ] [ Google Scholar ] 22. Hoch E, Preuss UW, Ferri M, Simon R. Digital interventions for problematic cannabis users in non-clinical settings: findings from a systematic review and meta-analysis. Eur Addict Res. 2016;22(5):233–242. doi: 10.1159/000445716.000445716 [ DOI ] [ PubMed ] [ Google Scholar ] 23. Kaner EF, Beyer FR, Garnett C, Crane D, Brown J, Muirhead C, Redmore J, O'Donnell A, Newham JJ, de Vocht F, Hickman M, Brown H, Maniatopoulos G, Michie S. Personalised digital interventions for reducing hazardous and harmful alcohol consumption in community-dwelling populations. Cochrane Database Syst Rev. 2017;9(9):CD011479. doi: 10.1002/14651858.CD011479.pub2. https://europepmc.org/abstract/MED/28944453 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 24. Magwood O, Saad A, Ranger D, Volpini K, Rukikamirera F, Haridas R, Sayfi S, Alexander J, Tan Y, Pottie K. Mobile apps to reduce depressive symptoms and alcohol use in youth: a systematic review and meta‐analysis. Campbell Syst Rev. 2024;20(2):e1398. doi: 10.1002/cl2.1398. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 25. Moon WH, Lee M, Kim SK, Go Y. Effectiveness of mobile apps and text message to manage alcohol consumptionsystematic review and meta-analysis. Obstet Gynecol Forum. 2024;34(3s):8–20. doi: 10.10520/ejc-medog_v34_n3_a8. [ DOI ] [ Google Scholar ] 26. Olmos A, Tirado-Muñoz J, Farré M, Torrens M. The efficacy of computerized interventions to reduce cannabis use: a systematic review and meta-analysis. Addict Behav. 2018;79:52–60. doi: 10.1016/j.addbeh.2017.11.045.S0306-4603(17)30453-7 [ DOI ] [ PubMed ] [ Google Scholar ] 27. Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, Ebert D, Cuijpers P. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One. 2014;9(6):e99912. doi: 10.1371/journal.pone.0099912. https://dx.plos.org/10.1371/journal.pone.0099912 .PONE-D-14-12620 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 28. Rooke S, Thorsteinsson E, Karpin A, Copeland J, Allsop D. Computer-delivered interventions for alcohol and tobacco use: a meta-analysis. Addiction. 2010;105(8):1381–1390. doi: 10.1111/j.1360-0443.2010.02975.x.ADD2975 [ DOI ] [ PubMed ] [ Google Scholar ] 29. Uhl S, Bloschichak A, Moran A, McShea K, Nunemaker MS, McKay JR, D’Anci KE. Telehealth for substance use disorders: a rapid review for the 2021 U.S. Department of Veterans Affairs and U.S. Department of Defense Guidelines for Management of Substance Use Disorders. Ann Intern Med. 2022;175(5):691–700. doi: 10.7326/m21-3931. [ DOI ] [ PubMed ] [ Google Scholar ] 30. White A, Kavanagh D, Stallman H, Klein B, Kay-Lambkin F, Proudfoot J, Drennan J, Connor J, Baker A, Hines E, Young R. Online alcohol interventions: a systematic review. J Med Internet Res. 2010;12(5):e62. doi: 10.2196/jmir.1479. https://www.jmir.org/2010/5/e62/ v12i5e62 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 31. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. 3rd Edition, Test Rev. Washington, DC: American Psychiatric Association; 1987. [ Google Scholar ] 32. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. 4th Edition. Washington, DC: American Psychiatric Association; 1994. [ Google Scholar ] 33. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. 4th Edition, Text Revision. Washington, DC: American Psychiatric Association; 2000. [ Google Scholar ] 34. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. 5th Edition. Washington, DC: American Psychiatric Association; 2013. [ Google Scholar ] 35. Saunders JB, Aasland OG, Babor TF, de la Fuente J R, Grant M. Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption—II. Addiction. 1993;88(6):791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x. [ DOI ] [ PubMed ] [ Google Scholar ] 36. Hester RK, Delaney HD. Behavioral self-control program for windows: results of a controlled clinical trial. J Consult Clin Psychol. 1997;65(4):686–693. doi: 10.1037//0022-006x.65.4.686. [ DOI ] [ PubMed ] [ Google Scholar ] 37. Wallace P, Murray E, McCambridge J, Khadjesari Z, White IR, Thompson SG, Kalaitzaki E, Godfrey C, Linke S. On-line randomized controlled trial of an internet based psychologically enhanced intervention for people with hazardous alcohol consumption. PLoS One. 2011;6(3):e14740. doi: 10.1371/journal.pone.0014740. https://dx.plos.org/10.1371/journal.pone.0014740 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 38. Chander G, Hutton HE, Xu X, Canan CE, Gaver J, Finkelstein J, Lesko CR, McCaul ME, Lau B. Computer delivered intervention for alcohol and sexual risk reduction among women attending an urban sexually transmitted infection clinic: a randomized controlled trial. Addict Behav Rep. 2021;14:100367. doi: 10.1016/j.abrep.2021.100367. https://linkinghub.elsevier.com/retrieve/pii/S2352-8532(21)00030-4 .S2352-8532(21)00030-4 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 39. Kelpin SS, Parlier-Ahmad AB, Jallo N, Carroll K, Svikis DS. A pilot randomized trial of CBT4CBT for women in residential treatment for substance use disorders. J Subst Abuse Treat. 2022;132:108622. doi: 10.1016/j.jsat.2021.108622.S0740-5472(21)00348-2 [ DOI ] [ PubMed ] [ Google Scholar ] 40. Paris M, Silva M, Añez-Nava L, Jaramillo Y, Kiluk BD, Gordon MA, Nich C, Frankforter T, Devore K, Ball SA, Carroll KM. Culturally adapted, web-based cognitive behavioral therapy for Spanish-speaking individuals with substance use disorders: a randomized clinical trial. Am J Public Health. 2018;108(11):1535–1542. doi: 10.2105/AJPH.2018.304571. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 41. Brief DJ, Rubin A, Keane TM, Enggasser JL, Roy M, Helmuth E, Hermos J, Lachowicz M, Rybin D, Rosenbloom D. Web intervention for OEF/OIF veterans with problem drinking and PTSD symptoms: a randomized clinical trial. J Consult Clin Psychol. 2013;81(5):890–900. doi: 10.1037/a0033697. https://europepmc.org/abstract/MED/23875821 .2013-25767-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 42. Deady M, Mills KL, Teesson M, Kay-Lambkin F. An online intervention for co-occurring depression and problematic alcohol use in young people: primary outcomes from a randomized controlled trial. J Med Internet Res. 2016;18(3):e71. doi: 10.2196/jmir.5178. https://www.jmir.org/2016/3/e71/ v18i3e71 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 43. Cunningham JA. Comparison of two internet-based interventions for problem drinkers: randomized controlled trial. J Med Internet Res. 2012;14(4):e107. doi: 10.2196/jmir.2090. https://www.jmir.org/2012/4/e107/ v14i4e107 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 44. Schouten MJE, Goudriaan AE, Schaub MP, Dekker JJM, Blankers M. Effectiveness of a digital alcohol intervention as an add-on to depression treatment for young adults: results of a pragmatic randomized controlled trial. Psychol Med. 2024;54(11):2887–2898. doi: 10.1017/S0033291724000953.S0033291724000953 [ DOI ] [ PubMed ] [ Google Scholar ] 45. Davies EB, Morriss R, Glazebrook C. Computer-delivered and web-based interventions to improve depression, anxiety, and psychological well-being of university students: a systematic review and meta-analysis. J Med Internet Res. 2014;16(5):e130. doi: 10.2196/jmir.3142. https://www.jmir.org/2014/5/e130/ v16i5e130 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 46. Acosta MC, Possemato K, Maisto SA, Marsch LA, Barrie K, Lantinga L, Fong C, Xie H, Grabinski M, Rosenblum A. Web-delivered CBT reduces heavy drinking in OEF-OIF veterans in primary care with symptomatic substance use and PTSD. Behavior Therapy. 2017;48(2):262–276. doi: 10.1016/j.beth.2016.09.001. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 47. Andersson C. Comparison of WEB and interactive voice response (IVR) methods for delivering brief alcohol interventions to hazardous-drinking university students: a randomized controlled trial. Eur Addict Res. 2015;21(5):240–252. doi: 10.1159/000381017.000381017 [ DOI ] [ PubMed ] [ Google Scholar ] 48. Augsburger M, Kaal E, Ülesoo T, Wenger A, Blankers M, Haug S, Ebert DD, Riper H, Keough M, Noormets H, Schaub MP, Kilp K. Effects of a minimal-guided on-line intervention for alcohol misuse in Estonia: a randomized controlled trial. Addiction. 2022;117(1):108–117. doi: 10.1111/add.15633. https://europepmc.org/abstract/MED/34184795 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 49. Baumgartner C, Schaub MP, Wenger A, Malischnig D, Augsburger M, Lehr D, Blankers M, Ebert DD, Haug S. "Take Care of You"—efficacy of integrated, minimal-guidance, internet-based self-help for reducing co-occurring alcohol misuse and depression symptoms in adults: results of a three-arm randomized controlled trial. Drug Alcohol Depend. 2021;225:108806. doi: 10.1016/j.drugalcdep.2021.108806. https://linkinghub.elsevier.com/retrieve/pii/S0376-8716(21)00301-X .S0376-8716(21)00301-X [ DOI ] [ PubMed ] [ Google Scholar ] 50. Baumgartner C, Schaub MP, Wenger A, Malischnig D, Augsburger M, Walter M, Berger T, Stark L, Ebert DD, Keough MT, Haug S. CANreduce 2.0 adherence-focused guidance for internet self-help among cannabis users: three-arm randomized controlled trial. J Med Internet Res. 2021;23(4):e27463. doi: 10.2196/27463. https://boris-portal.unibe.ch/handle/20.500.12422/66473 .v23i4e27463 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 51. Berman AH, Molander O, Tahir M, Törnblom P, Gajecki M, Sinadinovic K, Andersson C. Reducing risky alcohol use smartphone app skills training among adult internet help-seekers: a randomized pilot trial. Front Psychiatry. 2020;11:434. doi: 10.3389/fpsyt.2020.00434. https://europepmc.org/abstract/MED/32536880 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 52. Blankers M, Koeter MWJ, Schippers GM. Internet therapy versus internet self-help versus no treatment for problematic alcohol use: a randomized controlled trial. J Consult Clin Psychol. 2011;79(3):330–341. doi: 10.1037/a0023498.2011-08725-001 [ DOI ] [ PubMed ] [ Google Scholar ] 53. Bonar EE, Goldstick JE, Chapman L, Bauermeister JA, Young SD, McAfee J, Walton MA. A social media intervention for cannabis use among emerging adults: randomized controlled trial. Drug Alcohol Depend. 2022;232:109345. doi: 10.1016/j.drugalcdep.2022.109345. https://europepmc.org/abstract/MED/35144238 .S0376-8716(22)00082-5 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 54. Brendryen H, Lund IO, Johansen AB, Riksheim M, Nesvåg S, Duckert F. Balance—a pragmatic randomized controlled trial of an online intensive self-help alcohol intervention. Addiction. 2014 Feb;109(2):218–26. doi: 10.1111/add.12383. [ DOI ] [ PubMed ] [ Google Scholar ] 55. Budney AJ, Stanger C, Tilford JM, Scherer EB, Brown PC, Li Z, Li Z, Walker DD. Computer-assisted behavioral therapy and contingency management for cannabis use disorder. Psychol Addict Behav. 2015;29(3):501–511. doi: 10.1037/adb0000078. https://europepmc.org/abstract/MED/25938629 .2015-18943-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 56. Campbell ANC, Nunes EV, Matthews AG, Stitzer M, Miele GM, Polsky D, Turrigiano E, Walters S, McClure EA, Kyle TL, Wahle A, Van Veldhuisen P, Goldman B, Babcock D, Stabile PQ, Winhusen T, Ghitza UE. Internet-delivered treatment for substance abuse: a multisite randomized controlled trial. Am J Psychiatry. 2014;171(6):683–690. doi: 10.1176/appi.ajp.2014.13081055. https://europepmc.org/abstract/MED/24700332 .1859474 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 57. Campbell ANC, Rieckmann T, Pavlicova M, Choo T-H, Molina K, McDonell M, West AE, Daw R, Marsch LA, Venner KL. Culturally tailored digital therapeutic for substance use disorders with urban Indigenous people in the United States: a randomized controlled study. J Subst Use Addict Treat. 2023;155:209159. doi: 10.1016/j.josat.2023.209159.S2949-8759(23)00210-2 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 58. Carroll KM, Ball SA, Martino S, Nich C, Babuscio TA, Nuro KF, Gordon MA, Portnoy GA, Rounsaville BJ. Computer-assisted delivery of cognitive-behavioral therapy for addiction: a randomized trial of CBT4CBT. Am J Psychiatry. 2008;165(7):881–888. doi: 10.1176/appi.ajp.2008.07111835. https://europepmc.org/abstract/MED/18450927 .appi.ajp.2008.07111835 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 59. Carroll KM, Kiluk BD, Nich C, Gordon MA, Portnoy GA, Marino DR, Ball SA. Computer-assisted delivery of cognitive-behavioral therapy: efficacy and durability of CBT4CBT among cocaine-dependent individuals maintained on methadone. Am J Psychiatry. 2014;171(4):436–444. doi: 10.1176/appi.ajp.2013.13070987. https://europepmc.org/abstract/MED/24577287 .1838528 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 60. Carroll KM, Nich C, DeVito EE, Shi JM, Sofuoglu M. Galantamine and computerized cognitive behavioral therapy for cocaine dependence: a randomized clinical trial. J Clin Psychiatry. 2018;79(1):17m11669. doi: 10.4088/JCP.17m11669. https://europepmc.org/abstract/MED/29286595 .17m11669 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 61. Christensen DR, Landes RD, Jackson L, Marsch LA, Mancino MJ, Chopra MP, Bickel WK. Adding an internet-delivered treatment to an efficacious treatment package for opioid dependence. J Consult Clin Psychol. 2014;82(6):964–972. doi: 10.1037/a0037496. https://europepmc.org/abstract/MED/25090043 .2014-31346-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 62. Daros AR, Guimond TH, Yager C, Palermo EH, Wilks CR, Quilty LC. Feasibility, acceptability, and potential efficacy of a self-guided internet-delivered dialectical behavior therapy intervention for substance use disorders: randomized controlled trial. JMIR Ment Health. 2024;11:e50399. doi: 10.2196/50399. https://mental.jmir.org/2024//e50399/ v11i1e50399 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 63. Farren CK, Milnes J, Lambe K, Ahern S. Computerised cognitive behavioural therapy for alcohol use disorder: a pilot randomised control trial. Ir J Psychol Med. 2015;32(3):237–246. doi: 10.1017/ipm.2014.64.S0790966714000640 [ DOI ] [ PubMed ] [ Google Scholar ] 64. Gajecki M, Andersson C, Rosendahl I, Sinadinovic K, Fredriksson M, Berman AH. Skills training via smartphone app for university students with excessive alcohol consumption: a randomized controlled trial. Int J Behav Med. 2017;24(5):778–788. doi: 10.1007/s12529-016-9629-9. https://europepmc.org/abstract/MED/28224445 .10.1007/s12529-016-9629-9 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 65. Glasner S, Chokron Garneau H, Ang A, Ray L, Venegas A, Rawson R, Kalichman S. Preliminary efficacy of a cognitive behavioral therapy text messaging intervention targeting alcohol use and antiretroviral therapy adherence: a randomized clinical trial. PLoS One. 2020;15(3):e0229557. doi: 10.1371/journal.pone.0229557. https://dx.plos.org/10.1371/journal.pone.0229557 .PONE-D-19-19528 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 66. Gonzalez VM, Dulin PL. Comparison of a smartphone app for alcohol use disorders with an Internet-based intervention plus bibliotherapy: a pilot study. J Consult Clin Psychol. 2015;83(2):335–345. doi: 10.1037/a0038620. https://europepmc.org/abstract/MED/25622202 .2015-02676-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 67. Guarino H, Fong C, Marsch LA, Acosta MC, Syckes C, Moore SK, Cruciani RA, Portenoy RK, Turk DC, Rosenblum A. Web-based cognitive behavior therapy for chronic pain patients with aberrant drug-related behavior: outcomes from a randomized controlled trial. Pain Med. 2018;19(12):2423–2437. doi: 10.1093/pm/pnx334. https://europepmc.org/abstract/MED/29346579 .4807510 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 68. Guillemont J, Cogordan C, Nalpas B, Nguyen-Thanh V, Richard JB, Arwidson P. Effectiveness of a web-based intervention to reduce alcohol consumption among French hazardous drinkers: a randomized controlled trial. Health Educ Res. 2017;32(4):332–342. doi: 10.1093/her/cyx052.3953909 [ DOI ] [ PubMed ] [ Google Scholar ] 69. Hester RK, Delaney HD, Campbell W. ModerateDrinking.Com and moderation management: outcomes of a randomized clinical trial with non-dependent problem drinkers. J Consult Clin Psychol. 2011;79(2):215–224. doi: 10.1037/a0022487. https://europepmc.org/abstract/MED/21319896 .2011-03047-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 70. Hester RK, Lenberg KL, Campbell W, Delaney HD. Overcoming addictions, a web-based application, and SMART Recovery, an online and in-person mutual help group for problem drinkers, part 1: three-month outcomes of a randomized controlled trial. J Med Internet Res. 2013;15(7):e134. doi: 10.2196/jmir.2565. https://www.jmir.org/2013/7/e134/ v15i7e134 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 71. Hyland K, Hammarberg A, Hedman-Lagerlöf E, Johansson M, Lindner P, Andreasson S. The efficacy of an internet-based cognitive behavioral program added to treatment-as-usual for alcohol-dependent patients in primary care: a randomized controlled trial. Addiction. 2023;118(7):1232–1243. doi: 10.1111/add.16157. [ DOI ] [ PubMed ] [ Google Scholar ] 72. Johansson M, Berman AH, Sinadinovic K, Lindner P, Hermansson U, Andréasson S. Effects of internet-based cognitive behavioral therapy for harmful alcohol use and alcohol dependence as self-help or with therapist guidance: three-armed randomized trial. J Med Internet Res. 2021;23(11):e29666. doi: 10.2196/29666. https://www.jmir.org/2021/11/e29666/ v23i11e29666 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 73. Johansson M, Sinadinovic K, Gajecki M, Lindner P, Berman AH, Hermansson U, Andréasson S. Internet-based therapy versus face-to-face therapy for alcohol use disorder, a randomized controlled non-inferiority trial. Addiction. 2021;116(5):1088–1100. doi: 10.1111/add.15270. https://europepmc.org/abstract/MED/32969541 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 74. Kay-Lambkin FJ, Baker AL, Kelly B, Lewin TJ. Clinician-assisted computerised versus therapist-delivered treatment for depressive and addictive disorders: a randomised controlled trial. Med J Aust. 2011;195(S3):S44–S50. doi: 10.5694/j.1326-5377.2011.tb03265.x.kay10941_fm [ DOI ] [ PubMed ] [ Google Scholar ] 75. Kay-Lambkin FJ, Baker AL, Lewin TJ, Carr VJ. Computer-based psychological treatment for comorbid depression and problematic alcohol and/or cannabis use: a randomized controlled trial of clinical efficacy. Addiction. 2009;104(3):378–388. doi: 10.1111/j.1360-0443.2008.02444.x.ADD2444 [ DOI ] [ PubMed ] [ Google Scholar ] 76. Kiluk BD, Devore KA, Buck MB, Nich C, Frankforter TL, LaPaglia DM, Yates BT, Gordon MA, Carroll KM. Randomized trial of computerized cognitive behavioral therapy for alcohol use disorders: efficacy as a virtual stand-alone and treatment add-on compared with standard outpatient treatment. Alcohol Clin Exp Res. 2016;40(9):1991–2000. doi: 10.1111/acer.13162. https://europepmc.org/abstract/MED/27488212 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 77. Kiluk BD, Nich C, Buck MB, Devore KA, Frankforter TL, LaPaglia DM, Muvvala SB, Carroll KM. Randomized clinical trial of computerized and clinician-delivered CBT in comparison with standard outpatient treatment for substance use disorders: primary within-treatment and follow-up outcomes. Am J Psychiatry. 2018;175(9):853–863. doi: 10.1176/appi.ajp.2018.17090978. https://europepmc.org/abstract/MED/29792052 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 78. Kramer J, Riper H, Lemmers L, Conijn B, van Straten A, Smit F. Television-supported self-help for problem drinkers: a randomized pragmatic trial. Addict Behav. 2009;34(5):451–457. doi: 10.1016/j.addbeh.2008.12.015.S0306-4603(09)00008-2 [ DOI ] [ PubMed ] [ Google Scholar ] 79. Leeman RF, DeMartini KS, Gueorguieva R, Nogueira C, Corbin WR, Neighbors C, O'Malley SS. Randomized controlled trial of a very brief, multicomponent web-based alcohol intervention for undergraduates with a focus on protective behavioral strategies. J Consult Clin Psychol. 2016;84(11):1008–1015. doi: 10.1037/ccp0000132. https://europepmc.org/abstract/MED/27599223 .2016-42720-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 80. Marsch LA, Guarino H, Acosta M, Aponte-Melendez Y, Cleland C, Grabinski M, Brady R, Edwards J. Web-based behavioral treatment for substance use disorders as a partial replacement of standard methadone maintenance treatment. J Subst Abuse Treat. 2014;46(1):43–51. doi: 10.1016/j.jsat.2013.08.012. https://europepmc.org/abstract/MED/24060350 .S0740-5472(13)00200-6 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 81. Mujcic A, Blankers M, Boon B, Berman AH, Riper H, van Laar M, Engels R. Effectiveness, cost-effectiveness, and cost-utility of a digital alcohol moderation intervention for cancer survivors: health economic evaluation and outcomes of a pragmatic randomized controlled trial. J Med Internet Res. 2022;24(2):e30095. doi: 10.2196/30095. https://www.jmir.org/2022/2/e30095/ v24i2e30095 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 82. O'Donnell R, Richardson B, Fuller-Tyszkiewicz M, Staiger PK. Delivering personalized protective behavioral drinking strategies via a smartphone intervention: a pilot study. Int J Behav Med. 2019;26(4):401–414. doi: 10.1007/s12529-019-09789-0.10.1007/s12529-019-09789-0 [ DOI ] [ PubMed ] [ Google Scholar ] 83. Olthof MIA, Goudriaan AE, van Laar MW, Blankers M. A guided digital intervention to reduce cannabis use: the ICan randomized controlled trial. Addiction. 2023;118(9):1775–1786. doi: 10.1111/add.16217. [ DOI ] [ PubMed ] [ Google Scholar ] 84. Riper H, Kramer J, Smit F, Conijn B, Schippers G, Cuijpers P. Web-based self-help for problem drinkers: a pragmatic randomized trial. Addiction. 2008;103(2):218–227. doi: 10.1111/j.1360-0443.2007.02063.x.ADD2063 [ DOI ] [ PubMed ] [ Google Scholar ] 85. Rooke S, Copeland J, Norberg M, Hine D, McCambridge J. Effectiveness of a self-guided web-based cannabis treatment program: randomized controlled trial. J Med Internet Res. 2013;15(2):e26. doi: 10.2196/jmir.2256. https://www.jmir.org/2013/2/e26/ v15i2e26 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 86. Schaub MP, Castro RP, Wenger A, Baumgartner C, Stark L, Ebert DD, Quednow BB, Haug S. Web-based self-help with and without chat counseling to reduce cocaine use in cocaine misusers: results of a three-arm randomized controlled trial. Internet Interv. 2019;17:100251. doi: 10.1016/j.invent.2019.100251. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(18)30066-6 .S2214-7829(18)30066-6 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 87. Schaub MP, Wenger A, Berg O, Beck T, Stark L, Buehler E, Haug S. A web-based self-help intervention with and without chat counseling to reduce cannabis use in problematic cannabis users: three-arm randomized controlled trial. J Med Internet Res. 2015;17(10):e232. doi: 10.2196/jmir.4860. https://www.jmir.org/2015/10/e232/ v17i10e232 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 88. Schaub M, Sullivan R, Haug S, Stark L. Web-based cognitive behavioral self-help intervention to reduce cocaine consumption in problematic cocaine users: randomized controlled trial. J Med Internet Res. 2012;14(6):e166. doi: 10.2196/jmir.2244. https://www.jmir.org/2012/6/e166/ v14i6e166 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 89. Shi JM, Henry SP, Dwy SL, Orazietti SA, Carroll KM. Randomized pilot trial of Web-based cognitive-behavioral therapy adapted for use in office-based buprenorphine maintenance. Subst Abus. 2019;40(2):132–135. doi: 10.1080/08897077.2019.1569192. https://europepmc.org/abstract/MED/30714880 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 90. Sinadinovic K, Johansson M, Johansson AS, Lundqvist T, Lindner P, Hermansson U. Guided web-based treatment program for reducing cannabis use: a randomized controlled trial. Addict Sci Clin Pract. 2020;15(1):9. doi: 10.1186/s13722-020-00185-8. https://ascpjournal.biomedcentral.com/articles/10.1186/s13722-020-00185-8 .10.1186/s13722-020-00185-8 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 91. Sinadinovic K, Wennberg P, Johansson M, Berman AH. Targeting individuals with problematic alcohol use via Web-based cognitive-behavioral self-help modules, personalized screening feedback or assessment only: a randomized controlled trial. Eur Addict Res. 2014;20(6):305–318. doi: 10.1159/000362406. https://doi.org/10.1159/000362406 .000362406 [ DOI ] [ PubMed ] [ Google Scholar ] 92. Stapinski LA, Prior K, Newton NC, Biswas RK, Kelly E, Deady M, Lees B, Teesson M, Baillie AJ. Are we making Inroads? A randomized controlled trial of a psychologist-supported, web-based, cognitive behavioral therapy intervention to reduce anxiety and hazardous alcohol use among emerging adults. EClinicalMedicine. 2021;39:101048. doi: 10.1016/j.eclinm.2021.101048. https://linkinghub.elsevier.com/retrieve/pii/S2589-5370(21)00328-X .S2589-5370(21)00328-X [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 93. Sunami T, So R, Ishii H, Sadashima E, Ueno T, Yuzuriha T, Monji A. A randomized controlled trial of the web-based drinking diary program for problem drinking in multi workplace settings. J Occup Health. 2022;64(1):e12312. doi: 10.1002/1348-9585.12312. https://europepmc.org/abstract/MED/35026038 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 94. Sundström C, Eék N, Kraepelien M, Fahlke C, Gajecki M, Jakobson M, Beckman M, Kaldo V, Berman AH. High- versus low-intensity internet interventions for alcohol use disorders: results of a three-armed randomized controlled superiority trial. Addiction. 2020;115(5):863–874. doi: 10.1111/add.14871. https://europepmc.org/abstract/MED/31691413 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 95. Tait RJ, McKetin R, Kay-Lambkin F, Carron-Arthur B, Bennett A, Bennett K, Christensen H, Griffiths KM. A web-based intervention for users of amphetamine-type stimulants: 3-month outcomes of a randomized controlled trial. JMIR Ment Health. 2014;1(1):e1. doi: 10.2196/mental.3278. https://mental.jmir.org/2014/1/e1/ v1i1e1 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 96. Takano A, Miyamoto Y, Shinozaki T, Matsumoto T, Kawakami N. Effects of a web-based relapse prevention program on abstinence: secondary subgroup analysis of a pilot randomized controlled trial. Neuropsychopharmacol Rep. 2022;42(3):362–367. doi: 10.1002/npr2.12272. https://europepmc.org/abstract/MED/35689457 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 97. Tetrault JM, Holt SR, Cavallo DA, O'Connor PG, Gordon MA, Corvino JK, Nich C, Carroll KM. Computerized cognitive behavioral therapy for substance use disorders in a specialized primary care practice: a randomized feasibility trial to address the RT component of SBIRT. J Addict Med. 2020;14(6):e303–e309. doi: 10.1097/ADM.0000000000000663.01271255-202012000-00019 [ DOI ] [ PubMed ] [ Google Scholar ] 98. Tiburcio M, Lara MA, Martínez N, Fernández M, Aguilar A. Web-based intervention to reduce substance abuse and depression: a three arm randomized trial in mexico. Subst Use Misuse. 2018;53(13):2220–2231. doi: 10.1080/10826084.2018.1467452. [ DOI ] [ PubMed ] [ Google Scholar ] 99. Wilks CR, Lungu A, Ang SY, Matsumiya B, Yin Q, Linehan MM. A randomized controlled trial of an Internet delivered dialectical behavior therapy skills training for suicidal and heavy episodic drinkers. J Affect Disord. 2018;232:219–228. doi: 10.1016/j.jad.2018.02.053. https://europepmc.org/abstract/MED/29499504 .S0165-0327(17)32078-5 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 100. Zill JM, Christalle E, Meyer B, Härter M, Dirmaier J. The effectiveness of an internet intervention aimed at reducing alcohol consumption in adults. Dtsch Arztebl Int. 2019;116(8):127–133. doi: 10.3238/arztebl.2019.0127. https://europepmc.org/abstract/MED/30940341 .arztebl.2019.0127 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 101. Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JAC. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. doi: 10.1136/bmj.d5928. https://boris-portal.unibe.ch/handle/20.500.12422/77811 .bmj.d5928 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 102. Hedges LV. Statistical considerations. In: Cooper H, Hedges LV, editors. The Handbook of Research Synthesis. New York, NY: Russell Sage Foundation; 1994. pp. 29–38. [ Google Scholar ] 103. Frohlich JR, Rapinda KK, Schaub MP, Wenger A, Baumgartner C, Johnson EA, O'Connor RM, Vincent N, Blankers M, Ebert DD, Hadjistavropoulos HD, Mackenzie CS, Wardell JD, Augsburger M, Goldberg JO, Keough MT. Efficacy of a minimally guided internet treatment for alcohol misuse and emotional problems in young adults: results of a randomized controlled trial. Addict Behav Rep. 2021;14:100390. doi: 10.1016/j.abrep.2021.100390. https://linkinghub.elsevier.com/retrieve/pii/S2352-8532(21)00053-5 .S2352-8532(21)00053-5 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 104. Hedges LV, Olkin I. Statistical Methods for Meta-Analysis. San Diego, CA: Academic Press; 1985. [ Google Scholar ] 105. Hedges LV, Vevea JL. Fixed- and random-effects models in meta-analysis. Psychol Methods. 1998;3(4):486–504. doi: 10.1037/1082-989x.3.4.486. [ DOI ] [ Google Scholar ] 106. Fisher Z, Tipton E, Zhipeng H. robumeta: robust variance meta-regression. Github. 2017. [2026-03-19]. https://github.com/zackfisher/robumeta . 107. Tipton E. Small sample adjustments for robust variance estimation with meta-regression. Psychol Methods. 2015;20(3):375–393. doi: 10.1037/met0000011.2014-14616-001 [ DOI ] [ PubMed ] [ Google Scholar ] 108. Fisher Z, Tipton E. robumeta: an R-package for robust variance estimation in meta-analysis. Github. 2015. [2026-03-19]. https://arxiv.org/abs/1503.02220 . 109. Borenstein M. Research note: In a meta-analysis, the I2 index does not tell us how much the effect size varies across studies. J Physiother. 2020;66(2):135–139. doi: 10.1016/j.jphys.2020.02.011. https://linkinghub.elsevier.com/retrieve/pii/S1836-9553(20)30016-3 .S1836-9553(20)30016-3 [ DOI ] [ PubMed ] [ Google Scholar ] 110. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–634. doi: 10.1136/bmj.315.7109.629. https://europepmc.org/abstract/MED/9310563 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 111. Liang D, Han H, Du J, Zhao M, Hser YI. A pilot study of a smartphone application supporting recovery from drug addiction. J Subst Abuse Treat. 2018;88:51–58. doi: 10.1016/j.jsat.2018.02.006. https://europepmc.org/abstract/MED/29606226 .S0740-5472(17)30459-2 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 112. Takano A, Miyamoto Y, Shinozaki T, Matsumoto T, Kawakami N. Effect of a web-based relapse prevention program on abstinence among Japanese drug users: a pilot randomized controlled trial. J Subst Abuse Treat. 2020;111:37–46. doi: 10.1016/j.jsat.2019.12.001.S0740-5472(19)30291-0 [ DOI ] [ PubMed ] [ Google Scholar ] 113. Acosta MC, Marsch LA, Xie H, Guarino H, Aponte-Melendez Y. A web-based behavior therapy program influences the association between cognitive functioning and retention and abstinence in clients receiving methadone maintenance treatment. J Dual Diagn. 2012;8(4):283–293. doi: 10.1080/15504263.2012.723317. https://europepmc.org/abstract/MED/23671409 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 114. Ahlers J, Baumgartner C, Augsburger M, Wenger A, Malischnig D, Boumparis N, Berger T, Stark L, Ebert DD, Haug S, Schaub MP. Cannabis use in adults who screen positive for attention deficit/hyperactivity disorder: CANreduce 2.0 randomized controlled trial subgroup analysis. J Med Internet Res. 2022;24(4):e30138. doi: 10.2196/30138. https://boris-portal.unibe.ch/handle/20.500.12422/70282 .v24i4e30138 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 115. Benitez B, Frankforter T, Nich C, Kiluk BD. The rise and fall of substance use during treatment: applying recency and expectancy principles to daily substance use patterns. Psychol Addict Behav. 2023;37(2):235–246. doi: 10.1037/adb0000824. https://europepmc.org/abstract/MED/35201805 .2022-34986-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 116. Buckheit KA, Nolan J, Possemato K, Maisto S, Rosenblum A, Acosta M, Marsch LA. Insomnia predicts treatment engagement and symptom change: a secondary analysis of a web-based CBT intervention for veterans with PTSD symptoms and hazardous alcohol use. Transl Behav Med. 2022;12(1):ibab118. doi: 10.1093/tbm/ibab118. https://europepmc.org/abstract/MED/34463344 .6360365 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 117. Campbell ANC, Nunes EV, Pavlicova M, Hatch-Maillette M, Hu M-C, Bailey GL, Sugarman DE, Miele GM, Rieckmann T, Shores-Wilson K, Turrigiano E, Greenfield SF. Gender-based outcomes and acceptability of a computer-assisted psychosocial intervention for substance use disorders. J Subst Abuse Treat. 2015;53:9–15. doi: 10.1016/j.jsat.2014.12.006. https://europepmc.org/abstract/MED/25613105 .S0740-5472(14)00256-6 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 118. Campbell W, Hester RK, Lenberg KL, Delaney HD. Overcoming addictions, a web-based application, and SMART recovery, an online and in-person mutual help group for problem drinkers, part 2: six-month outcomes of a randomized controlled trial and qualitative feedback from participants. J Med Internet Res. 2016;18(10):e262. doi: 10.2196/jmir.5508. https://www.jmir.org/2016/10/e262/ v18i10e262 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 119. Carroll KM, Ball SA, Martino S, Nich C, Babuscio TA, Rounsaville BJ. Enduring effects of a computer-assisted training program for cognitive behavioral therapy: a 6-month follow-up of CBT4CBT. Drug Alcohol Depend. 2009;100(1-2):178–181. doi: 10.1016/j.drugalcdep.2008.09.015. https://europepmc.org/abstract/MED/19041197 .S0376-8716(08)00360-8 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 120. Carroll KM, Herman A, DeVito EE, Frankforter TL, Potenza MN, Sofuoglu M. Catehol-o-methyltransferase gene val158met polymorphism as a potential predictor of response to computer-assisted delivery of cognitive-behavioral therapy among cocaine-dependent individuals: preliminary findings from a randomized controlled trial. Am J Addict. 2015;24(5):443–451. doi: 10.1111/ajad.12238. https://europepmc.org/abstract/MED/25930952 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 121. Cochran G, Stitzer M, Campbell ANC, Hu MC, Vandrey R, Nunes EV. Web-based treatment for substance use disorders: differential effects by primary substance. Addict Behav. 2015;45:191–194. doi: 10.1016/j.addbeh.2015.02.002. https://europepmc.org/abstract/MED/25697725 .S0306-4603(15)00050-7 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 122. Decker SE, Morie KP, Malin-Mayo B, Nich C, Carroll KM. Positive and negative affect in cocaine use disorder treatment: change across time and relevance to treatment outcome. Am J Addict. 2018;27(5):375–382. doi: 10.1111/ajad.12716. https://europepmc.org/abstract/MED/29923665 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 123. DeVito EE, Kiluk BD, Nich C, Mouratidis M, Carroll KM. Drug stroop: mechanisms of response to computerized cognitive behavioral therapy for cocaine dependence in a randomized clinical trial. Drug Alcohol Depend. 2018;183:162–168. doi: 10.1016/j.drugalcdep.2017.10.022. https://europepmc.org/abstract/MED/29258028 .S0376-8716(17)30570-7 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 124. DeVito EE, Kober H, Carroll KM, Potenza MN. fMRI Stroop and behavioral treatment for cocaine-dependence: preliminary findings in methadone-maintained individuals. Addict Behav. 2019;89:10–14. doi: 10.1016/j.addbeh.2018.09.005. https://europepmc.org/abstract/MED/30240978 .S0306-4603(18)30307-1 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 125. Enggasser JL, Hermos JA, Rubin A, Lachowicz M, Rybin D, Brief DJ, Roy M, Helmuth E, Rosenbloom D, Keane TM. Drinking goal choice and outcomes in a web-based alcohol intervention: results from VetChange. Addict Behav. 2015;42:63–68. doi: 10.1016/j.addbeh.2014.10.036. https://europepmc.org/abstract/MED/25671224 .S0306-4603(14)00368-2 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 126. Handley TE, Kay-Lambkin FJ, Baker AL, Lewin TJ, Kelly BJ, Inder KJ, Attia JR, Kavanagh DJ. Incidental treatment effects of CBT on suicidal ideation and hopelessness. J Affect Disord. 2013;151(1):275–283. doi: 10.1016/j.jad.2013.06.005.S0165-0327(13)00481-3 [ DOI ] [ PubMed ] [ Google Scholar ] 127. Hester RK, Delaney HD, Campbell W, Handmaker N. A web application for moderation training: initial results of a randomized clinical trial. J Subst Abuse Treat. 2009;37(3):266–276. doi: 10.1016/j.jsat.2009.03.001. https://europepmc.org/abstract/MED/19339137 .S0740-5472(09)00029-4 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 128. Jaramillo Y, DeVito EE, Frankforter T, Silva MA, Añez LM, Kiluk BD, Carroll KM, Paris M. Religiosity and spirituality in latinx individuals with substance use disorders: association with treatment outcomes in a randomized clinical trial. J Relig Health. 2022;61(5):4139–4154. doi: 10.1007/s10943-022-01544-2. https://europepmc.org/abstract/MED/35305222 .10.1007/s10943-022-01544-2 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 129. Kacmarek CN, Yates BT, Nich C, Kiluk BD. A pilot economic evaluation of computerized cognitive behavioral therapy for alcohol use disorder as an addition and alternative to traditional therapy. Alcohol Clin Exp Res. 2021;45(5):1109–1121. doi: 10.1111/acer.14601. https://europepmc.org/abstract/MED/33730384 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 130. Kay-Lambkin FJ, Baker AL, Kelly BJ, Lewin TJ. It's worth a try: the treatment experiences of rural and Urban participants in a randomized controlled trial of computerized psychological treatment for comorbid depression and alcohol/other drug use. J Dual Diagnosis. 2012;8(4):262–276. doi: 10.1080/15504263.2012.723315. [ DOI ] [ Google Scholar ] 131. Kay-Lambkin FJ, Baker AL, Palazzi K, Lewin TJ, Kelly BJ. Therapeutic alliance, client need for approval, and perfectionism as differential moderators of response to eHealth and traditionally delivered treatments for comorbid depression and substance use problems. Int J Behav Med. 2017;24(5):728–739. doi: 10.1007/s12529-017-9676-x.10.1007/s12529-017-9676-x [ DOI ] [ PubMed ] [ Google Scholar ] 132. Kiluk BD, DeVito EE, Buck MB, Hunkele K, Nich C, Carroll KM. Effect of computerized cognitive behavioral therapy on acquisition of coping skills among cocaine-dependent individuals enrolled in methadone maintenance. J Subst Abuse Treat. 2017;82:87–92. doi: 10.1016/j.jsat.2017.09.011. https://europepmc.org/abstract/MED/29021121 .S0740-5472(17)30171-X [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 133. Kiluk BD, Frankforter TL, Cusumano M, Nich C, Carroll KM. Change in DSM-5 alcohol use disorder criteria count and severity level as a treatment outcome indicator: results from a randomized trial. Alcohol Clin Exp Res. 2018;42(8):1556–1563. doi: 10.1111/acer.13807. https://europepmc.org/abstract/MED/29870051 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 134. Kiluk BD, Nich C, Babuscio T, Carroll KM. Quality versus quantity: acquisition of coping skills following computerized cognitive-behavioral therapy for substance use disorders. Addiction. 2010;105(12):2120–2127. doi: 10.1111/j.1360-0443.2010.03076.x. https://europepmc.org/abstract/MED/20854334 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 135. Kiluk BD, Serafini K, Frankforter T, Nich C, Carroll KM. Only connect: the working alliance in computer-based cognitive behavioral therapy. Behav Res Ther. 2014;63:139–146. doi: 10.1016/j.brat.2014.10.003. https://europepmc.org/abstract/MED/25461789 .S0005-7967(14)00166-1 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 136. Kim SJ, Marsch LA, Acosta MC, Guarino H, Aponte-Melendez Y. Can persons with a history of multiple addiction treatment episodes benefit from technology delivered behavior therapy? A moderating role of treatment history at baseline. Addict Behav. 2016;54:18–23. doi: 10.1016/j.addbeh.2015.11.009. https://europepmc.org/abstract/MED/26657820 .S0306-4603(15)30060-5 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 137. Kim SJ, Marsch LA, Guarino H, Acosta MC, Aponte-Melendez Y. Predictors of outcome from computer-based treatment for substance use disorders: results from a randomized clinical trial. Drug Alcohol Depend. 2015;157:174–178. doi: 10.1016/j.drugalcdep.2015.09.019. https://europepmc.org/abstract/MED/26433562 .S0376-8716(15)01668-3 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 138. Lévesque A, Campbell ANC, Pavlicova M, Hu MC, Walker R, McClure EA, Ghitza UE, Bailey G, Stitzer M, Nunes EV. Coping strategies as a mediator of internet-delivered psychosocial treatment: secondary analysis from a NIDA CTN multisite effectiveness trial. Addict Behav. 2017;65:74–80. doi: 10.1016/j.addbeh.2016.09.012. https://europepmc.org/abstract/MED/27776269 .S0306-4603(16)30342-2 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 139. Luderer HF, Campbell ANC, Nunes EV, Enman NM, Xiong X, Gerwien R, Maricich YA. Engagement patterns with a digital therapeutic for substance use disorders: correlations with abstinence outcomes. J Subst Abuse Treat. 2022;132:108585. doi: 10.1016/j.jsat.2021.108585. https://linkinghub.elsevier.com/retrieve/pii/S0740-5472(21)00311-1 .S0740-5472(21)00311-1 [ DOI ] [ PubMed ] [ Google Scholar ] 140. Mitchell SG, Schwartz RP, Alvanzo AAH, Weisman MS, Kyle TL, Turrigiano EM, Gibson ML, Perez L, McClure EA, Clingerman S, Froias A, Shandera DR, Walker R, Babcock DL, Bailey GL, Miele GM, Kunkel LE, Norton M, Stitzer ML. The use of technology in participant tracking and study retention: lessons learned from a clinical trials network study. Subst Abus. 2015;36(4):420–426. doi: 10.1080/08897077.2014.992565. https://europepmc.org/abstract/MED/25671593 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 141. Morie KP, Nich C, Hunkele K, Potenza MN, Carroll KM. Alexithymia level and response to computer-based training in cognitive behavioral therapy among cocaine-dependent methadone maintained individuals. Drug Alcohol Depend. 2015;152:157–163. doi: 10.1016/j.drugalcdep.2015.04.004. https://europepmc.org/abstract/MED/25982006 .S0376-8716(15)00199-4 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 142. Mujcic A, Linke S, Hamilton F, Phillips A, Khadjesari Z. Engagement with motivational interviewing and cognitive behavioral therapy components of a web-based alcohol intervention, elicitation of change talk and sustain talk, and impact on drinking outcomes: secondary data analysis. J Med Internet Res. 2020;22(9):e17285. doi: 10.2196/17285. https://www.jmir.org/2020/9/e17285/ v22i9e17285 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 143. Murphy SM, Campbell ANC, Ghitza UE, Kyle TL, Bailey GL, Nunes EV, Polsky D. Cost-effectiveness of an internet-delivered treatment for substance abuse: data from a multisite randomized controlled trial. Drug Alcohol Depend. 2016;161:119–126. doi: 10.1016/j.drugalcdep.2016.01.021. https://europepmc.org/abstract/MED/26880594 .S0376-8716(16)00049-1 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 144. Riper H, Kramer J, Keuken M, Smit F, Schippers G, Cuijpers P. Predicting successful treatment outcome of web-based self-help for problem drinkers: secondary analysis from a randomized controlled trial. J Med Internet Res. 2008;10(4):e46. doi: 10.2196/jmir.1102. https://www.jmir.org/2008/4/e46/ v10i4e46 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 145. Roos CR, Carroll KM, Nich C, Frankforter T, Kiluk BD. Short- and long-term changes in substance-related coping as mediators of in-person and computerized CBT for alcohol and drug use disorders. Drug Alcohol Depend. 2020;212:108044. doi: 10.1016/j.drugalcdep.2020.108044. https://europepmc.org/abstract/MED/32422538 .S0376-8716(20)30209-X [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 146. Roos CR, Kiluk BD, McHugh RK, Carroll KM. Evaluating a longitudinal mediation model of perceived stress, depressive symptoms, and substance use treatment outcomes. Psychol Addict Behav. 2020;34(6):660–668. doi: 10.1037/adb0000581. https://europepmc.org/abstract/MED/32297754 .2020-25927-001 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 147. Silva MA, Jaramillo Y, Paris M, Añez-Nava L, Frankforter TL, Kiluk BD. Changes in DSM criteria following a culturally-adapted computerized CBT for Spanish-speaking individuals with substance use disorders. J Subst Abuse Treat. 2020;110:42–48. doi: 10.1016/j.jsat.2019.12.006. https://europepmc.org/abstract/MED/31952627 .S0740-5472(19)30244-2 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 148. Tait RJ, McKetin R, Kay-Lambkin F, Carron-Arthur B, Bennett A, Bennett K, Christensen H, Griffiths KM. Six-month outcomes of a Web-based intervention for users of amphetamine-type stimulants: randomized controlled trial. J Med Internet Res. 2015;17(4):e105. doi: 10.2196/jmir.3778. https://www.jmir.org/2015/4/e105/ v17i4e105 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 149. Velez FF, Malone DC. Cost-effectiveness analysis of a prescription digital therapeutic for the treatment of opioid use disorder. J Mark Access Health Policy. 2021;9(1):1966187. doi: 10.1080/20016689.2021.1966187. https://www.mdpi.com/resolver?pii=1966187 .1966187 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 150. Xie H, Guarino H, Moore SK, Acosta M, Budney AJ, Rosenblum A, Marsch LA, Fong C. Web-based cognitive behavior therapy for chronic pain patients with aberrant drug-related behavior: how did it work and for whom? J Behav Med. 2021;44(5):704–714. doi: 10.1007/s10865-021-00219-9. https://europepmc.org/abstract/MED/33846875 .10.1007/s10865-021-00219-9 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 151. Dellazizzo L, Potvin S, Giguère S, Landry C, Léveillé N, Dumais A. Meta-review on the efficacy of psychological therapies for the treatment of substance use disorders. Psychiatry Res. 2023;326:115318. doi: 10.1016/j.psychres.2023.115318.S0165-1781(23)00268-8 [ DOI ] [ PubMed ] [ Google Scholar ] 152. Hedman-Lagerlöf E, Carlbring P, Svärdman F, Riper H, Cuijpers P, Andersson G. Therapist-supported Internet-based cognitive behaviour therapy yields similar effects as face-to-face therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. World Psychiatry. 2023;22(2):305–314. doi: 10.1002/wps.21088. https://europepmc.org/abstract/MED/37159350 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 153. Zemore SE, Ziemer KL, Gilbert PA, Karno MP, Kaskutas LA. Understanding the shared meaning of recovery from substance use disorders: new findings from the what is recovery? study. Subst Abuse. 2023;17:11782218231199372. doi: 10.1177/11782218231199372. https://journals.sagepub.com/doi/10.1177/11782218231199372?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .10.1177_11782218231199372 [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 154. Ashford RD, Brown A, Brown T, Callis J, Cleveland HH, Eisenhart E, Groover H, Hayes N, Johnston T, Kimball T, Manteuffel B, McDaniel J, Montgomery L, Phillips S, Polacek M, Statman M, Whitney J. Defining and operationalizing the phenomena of recovery: a working definition from the recovery science research collaborative. Addict Res Theory. 2019;27(3):179–188. doi: 10.1080/16066359.2018.1515352. [ DOI ] [ Google Scholar ] 155. Gressler LE, Natafgi NM, DeForge BR, Shaneman-Robinson B, Welsh C, Shaya FT. What motivates people with substance use disorders to pursue treatment? A patient-centered approach to understanding patient experiences and patient-provider interactions. J Subst Use. 2019;24(6):587–599. doi: 10.1080/14659891.2019.1620891. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 156. Magill M, Kiluk BD, Ray LA. Efficacy of cognitive behavioral therapy for alcohol and other drug use disorders: is a one-size-fits-all approach appropriate? Subst Abuse Rehabil. 2023;14:1–11. doi: 10.2147/sar.s362864. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 157. Torous J, Linardon J, Goldberg SB, Sun S, Bell I, Nicholas J, Hassan L, Hua Y, Milton A, Firth J. The evolving field of digital mental health: current evidence and implementation issues for smartphone apps, generative artificial intelligence, and virtual reality. World Psychiatry. 2025;24(2):156–174. doi: 10.1002/wps.21299. https://onlinelibrary.wiley.com/doi/10.1002/wps.21299 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] 158. Nwosu A, Boardman S, Husain MM, Doraiswamy PM. Digital therapeutics for mental health: is attrition the Achilles heel? Front Psychiatry. 2022;13:900615. doi: 10.3389/fpsyt.2022.900615. https://europepmc.org/abstract/MED/35982936 . [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ] Associated Data This section collects any data citations, data availability statements, or supplementary materials included in this article. Supplementary Materials Multimedia Appendix 1 Sample search strategy. mental_v13i1e82370_app1.docx (18.9KB, docx) Multimedia Appendix 2 Digitally delivered cognitive behaviorally based intervention and comparator descriptions. mental_v13i1e82370_app2.docx (97KB, docx) Multimedia Appendix 3 Measures and outcome scoring. mental_v13i1e82370_app3.docx (55.9KB, docx) Multimedia Appendix 4 PRISMA checklist. mental_v13i1e82370_app4.docx (35KB, docx) Multimedia Appendix 5 Sample-level risk of bias assessment. mental_v13i1e82370_app5.docx (57.2KB, docx) Multimedia Appendix 6 Meta-analysis with study effect sizes averaged to the study level. mental_v13i1e82370_app6.docx (23.4KB, docx) Multimedia Appendix 7 Plot of assessment of publication bias. mental_v13i1e82370_app7.docx (246.9KB, docx) Data Availability Statement The datasets generated or analyzed during this study are available from the corresponding author on reasonable request. Articles from JMIR Mental Health are provided here courtesy of JMIR Publications Inc. ACTIONS View on publisher site PDF (630.8 KB) Cite Collections Permalink RESOURCES Similar articles Cited by other articles Links to NCBI Databases Follow NCBI NCBI on X (formerly known as Twitter) NCBI on Facebook NCBI on LinkedIn NCBI on GitHub NCBI RSS feed Connect with NLM NLM on X (formerly known as Twitter) NLM on Facebook NLM on YouTube National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894 Web Policies FOIA HHS Vulnerability Disclosure Help Accessibility Careers NLM NIH HHS USA.gov Back to Top

Related documents

Record · ID 258075 · SHA-256 68420b8d51231ce0
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive