Home
How We're Different
Services
News and Resources
Contact Us
     
 

Notes & References

1. Duncan, B., Miller, S. (2004). The Partners for Change Outcome Management System. Institute for the Study of Therapeutic Change. Copyright 2004 PCOMS International Inc.


Duncan, B., & Miller, S., & Sparks, J. (2004). The heroic client: A revolutionary way to improve effectiveness through client directed, outcome informed therapy (revised ed.). San Francisco: Jossey-Bass.


Miller, S., Duncan, D., Brown, J., Sorrell, R., & Chalk, MB. (2006). Using formal client feedback to improve retention and outcome: Making ongoing, real-time assessment feasible. Journal of Brief Therapy, 5(2), 5-22.


2. Brown, J., Dreis, S., & Nace, D.K. (1999). What really makes a difference in psychotherapy outcome? Why does managed care want to know? In M.A. Hubble, B.L. Duncan, & S.D. Miller (Eds.), The heart and soul of change: What works in therapy (pp. 389– 406). Washington, DC: American Psychological Association.


Haas, E., Hill, R. D., Lambert, M. J., Morrell, B. (2002). Do early responders to psychotherapy maintain treatment gains? Journal of Clinical Psychology, 58, 1157-1172.


Hansen, N.B., & Lambert, M.J. (2003). An evaluation of the dose-response relationship in naturalistic treatment settings using survival analysis. Mental Health Services Research, 5, 1-12.


Howard, K.I., Moras, K., Brill, P.L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059–1064.  


Smith, M.L., Glass, G.V., & Miller, T.I. (1980). The benefits of psychotherapy. Baltimore: The Johns Hopkins University Press.


Whipple, J.L., Lambert, M.J., Vermeersch, D.A., Smart, D.W., Nielsen, S.L., Hawkins, E.J. (2003). Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice. Journal of Counseling Psychology, 50, 59-68


3. Elkin, I. (1994). The NIMH treatment of depression collaborative research program: Where we began and where we are. In A. E. Bergin & S. L. Garfield (eds.), Handbook of Psychotherapy and Behavior Change (4th ed.). New York: Wiley, 114-142.


Krupnick, J. L., Sotsky, S. M., Simmens, S., Moyher, J., Elkin, I., Watkins, J., & Pilkonis, P. A. (1996). The role of the therapeutic alliance in psychotherapy and pharmacotherapy outcome: Findings in the National Institute of Mental Health Treatment of Depression Collaborative Research Project. Journal of Consulting and Clinical Psychology, 64, 532-539.


Miller, S.D., Duncan, B.L., & Hubble, M.A. (1997). Escape from Babel: Toward a unifying language for psychotherapy practice. New York: Norton.


Miller, S.D., Hubble, M.A., & Duncan, B.L. (2007). Supershrinks: Learning from the field’s most effective practitioners. The Psychotherapy Networker, 31(6), 26-35, 56.


Wampold, B.E. (2001). The great psychotherapy debate: Models, methods, and findings. Hillsdale, New Jersey: Lawrence Erlbaum.


Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care." Journal of Consulting and Clinical Psychology, 73 (5), 914-23.


4.
Lambert, M. J., Whipple, J., Smart, D., Vermeersch, D., Nielsen, S., & Hawkins, E. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11 (1), 49–68.


Miller S., Duncan, B., Brown, J, Sorrell, R., & Chalk, M. (2007). Using formal client feedback to improve outcome and retention. Journal of Brief Therapy, 5, 19-28.


Miller, S.D., Duncan, B.L., & Hubble, M.A. (2004). Beyond Integration: the Triumph of outcome over process in clinical practice. Psychotherapy in Australia. 10 (2), 2-19.


Whipple, J.L., Lambert, M.J., Vermeersch, D.A., Smart, D.W., Nielsen, S.L., Hawkins, E.J. (2003). Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice. Journal of Counseling Psychology, 50, 59-68.
 

5.
Miller, S., Duncan, B., Brown, J., Sparks, J., & Claud, D. (2003). The Outcome Rating Scale: A  preliminary study of reliability, validity, and feasibility of a brief visual analogue measure. Journal of Brief Therapy, 2, 91-100.


Bringhurst, D.L., Watson, C.W., Miller, S.D., & Duncan, B.L. (2006). The reliability and validity of the Outcome Rating Scale: A replication study of a brief clinical measure. Journal of Brief Therapy, 5(1), 23-30.


Duncan, B., Miller, S., Sparks, J, Claud, D., Reynolds. L., Brown, J., & Johnson, L. (2003). The Session Rating Scale: Preliminary psychometric properties of a “working” alliance measure. Journal of Brief Therapy, 3, 3-12.


Duncan, B., Sparks, J., Miller, S., Bohanske, R., & Claud, D. (2006). Giving youth a voice: A preliminary study of the reliability and validity of a brief outcome measure for children, adolescents, and caretakers. Journal of Brief Therapy, 5(2), 66-82.


6.
We also review functional assessment scores (CAFAS or CANS), but these tools are not designed for use in session. They were developed to inform level-of-care decisions. They do not measure the therapeutic alliance, or week-to-week progress.  For in-session use, feasibility is critical. Two studies have found high rates of compliance for  therapists using CDOI rating scales:


Miller S., Duncan, B., Brown, J, Sorrell, R., & Chalk, M. (2007). Using formal client feedback to improve outcome and retention. Journal of Brief Therapy, 5, 19-28.


Miller, S., Duncan, B., Brown, J., Sparks, J., & Claud, D. (2003). The Outcome Rating Scale: A  preliminary study of reliability, validity, and feasibility of a brief visual analogue measure. Journal of Brief Therapy, 2, 91-100.


7.
Miller, S.D., Duncan, B.L., & Hubble, M.A. (1997). Escape from Babel: Toward a unifying language for psychotherapy practice. New York: Norton.


Duncan, B., & Miller, S., & Sparks, J. (2004). The heroic client: A revolutionary way to improve effectiveness through client directed, outcome informed therapy (revised ed.). San Francisco: Jossey-Bass.


Hubble, M.A., Duncan, B.L., & Miller, S.D. (1999c). Directing attention to what works. In M.A. Hubble, B.L. Duncan, and S.D. Miller (eds). The Heart and Soul of Change: What Works in Therapy. Washington, D.C.: APA press, 407-448.


8. Asay, T.P., & Lambert, M.J. (1999). The empirical case for the common factors in therapy: Quantitative findings. In M.A. Hubble, B.L. Duncan, & S.D. Miller (Eds.), The heart and soul of change: What works in therapy (pp. 33–56). Washington, DC: American Psychological Association.


Dennis, M. Godley, S., Diamond, G., Tims, F. Babor, T. Donaldson, J., Liddle, H. Titus, J., Kaminer, Y., Webb, C., Hamilton, N., Funk, R. (2004). The cannibas youth treatment (CYT) study: Main findings from two randomized trials. Journal of Substance Abuse Treatment, 27, 97– 213.


Duncan, Miller, and Sparks (2007, p. 37) describe the results of several well-designed, large-scale studies that fail to find evidence for the superiority of any particular treatment:


Ushering in the age of the RCT (randomized controlled trial), the landmark Treatment of Depression Collaborative Research Project (TDCRP) (Elkin et al., 1989) assigned 250 depressed participants randomly to four different conditions : cognitive therapy, interpersonal therapy, antidepressants, and, a pill placebo plus clinical management. . .the four treatments -- including placebo -- achieved about the same results. . . .the cannabis youth treatment (CYT) study found that neither the best practice nor researched based intervention was superior (Godley, Jones, Funk, Ives, & Passetti, 2004). Finally, an enormous real-world study conducted by Human Affairs International of over 2000 therapists and 20,000 clients revealed no differences in outcome among thirteen approaches, including medication, as well as family therapy and child approaches (Brown et al., 1999). The preponderance of the data, therefore, indicate a lack of specific effects and refute any claim of superiority when two or more bona fide treatments intended to be therapeutic are compared.



Duncan, B.L., Miller, S.D., & Sparks, J. (2007). Common factors and the uncommon heroism of youth. Psychotherapy in Australia, 13 (2), 34-43.


Shadish, W. R., & Baldwin, S. A. (2002). Meta-analysis of MFT interventions. In D.H. Sprenkle (Ed.). Effectiveness Research in Marriage and Family Therapy (pp. 339–370). Alexandria, VA: American Association for Marriage and Family Therapy.


9.
Duncan, B.L., Miller, S.D., & Sparks, J. (2007). Common factors and the uncommon heroism of youth. Psychotherapy in Australia, 13 (2), 34-43.


Lambert, M.J., Whipple, J.L., Hawkins, E.J., Vermeersch, D.A., Nielsen, S.L., & Smart, D.W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science & Practice, 10, 288–301.


10.
As Barry Duncan points out in “Evidence-based practice (EDP) talking points”:


“While a few studies have reported a favorable finding for one approach or another, the amount of studies finding differences are no more than one would expect from chance. For example, Cognitive Behavioral Therapy (CBT) proponents often point to 15 comparisons showing an advantage for CBT -- however, there are 2985 comparisons that show no difference (Wampold, 2001).”



Duncan, B. Evidence-based practice (EDP) talking points. Web Publication. Institute for the Study of Therapeutic Change.


Wampold, B.E. (2001). The great psychotherapy debate: Models, methods, and findings. Hillsdale, New Jersey: Lawrence Erlbaum.


11.
Duncan, B., Miller, S. (2004). The Partners for Change Outcome Management System. Institute for the Study of Therapeutic Change. Copyright 2004 PCOMS International Inc.


Duncan, B., & Miller, S., & Sparks, J. (2004). The heroic client: A revolutionary way to improve effectiveness through client directed, outcome informed therapy (revised ed.). San Francisco: Jossey-Bass.


Miller, S., Duncan, D., Brown, J., Sorrell, R., & Chalk, MB. (2006). Using formal client feedback to improve retention and outcome: Making ongoing, real-time assessment feasible. Journal of Brief Therapy, 5(2), 5-22.


12.
Hubble, M.A., Duncan, B.L., & Miller, S.D. (1999a). Introduction. In M.A. Hubble, B.L. Duncan, and S.D. Miller (eds). The Heart and Soul of Change: What Works in Therapy. Washington, D.C.: APA press, 1-32.


Miller, S.D., Duncan, B.L., & Hubble, M.A. (2004). Beyond Integration: the Triumph of Outcome Over Process in Clinical Practice. Psychotherapy in Australia. 10 (2), 2-19.


13.
Rath, T. (2007). Strengths finder 2.0. New York: Gallup Press. 


14.
Speigel, D. & Speigel H. (2004) Trance and Treatment: Clinical Uses of Hypnosis (2nd. ed.). Arlington, VA: American Psychiatric Press.


Main FAQs page
Frequently asked questions about hypnotherapy