Reliability
The ability of a test to produce the same results over and over.
Validity
Whether a test measures what it says it measures.
Internal Validity
The ability to establish a causal relationship between independent (causal) and dependent (effect) variables.
External Validity
Whether the relationship between independent and dependent variables can be generalized to others.
Effect Size
A statistic used to compare treatment effectiveness across studies based on standard deviation units.
Type 1 Error
A false positive (rejecting a true null hypothesis).
Type 2 Error
A false negative (failing to reject a false null hypothesis).
Mode
The most frequent score in a dataset.
Median
The score that divides data in half; helps balance out outlying scores.
Mean
The average; least susceptible to sampling fluctuations.
1 Standard Deviation
68.2% of data falls within 1 SD of the mean.
2 Standard Deviations
95% of data falls within 2 SD of the mean.
3 Standard Deviations
99.7% of data falls within 3 SD of the mean.
Evidence-Based Practice
(singular)
Using general evidence to inform treatment (keeping up with literature, attending workshops, using SAMHSA toolkits).
Evidence-Based Treatments/Practices
(plural)
Manualized treatments for specific populations that have been rigorously tested with control groups, blind, randomized, supported by NIMH and SAMHSA.
Clinical Trials Requirements
Outcome-Informed Practice
Using client feedback (ORS and SRS) to inform daily practice based on common factors model.
ORS
(Outcome Rating Scale)
Tool used to measure client outcomes session by session; RCTs with couples showed 4x the rate of change and better long-term outcomes.
SRS
(Session Rating Scale)
Tool used to measure the therapeutic alliance and session quality.
Conduct Disorder Evidence Base for MFT
Very strong evidence for systemic-strategic FAMILY treatment (not individual youth).
Drug Abuse Evidence Base for MFT
Very strong evidence base for family therapy, especially with youth.
Psychoeducation for Major Mental Illness Base for MFT
Very strong evidence, particularly with multifamily groups.
Couple Distress Evidence Base for MFT
Very strong evidence for couple therapy.
Alcoholism Evidence Base for MFT
Strong evidence for couple/family treatment with both adults and adolescents.