United States v. Sanchez , 65 M.J. 145 ( 2007 )


Menu:
  •                          UNITED STATES, Appellee
    v.
    Luis D. SANCHEZ, Specialist
    U.S. Army, Appellant
    No. 06-0617
    Crim. App. No. 20010943
    United States Court of Appeals for the Armed Forces
    Argued January 17, 2007
    Decided June 21, 2007
    RYAN, J., delivered the opinion of the Court, in which BAKER,
    ERDMANN, and STUCKY, JJ., joined. EFFRON, C.J., filed a
    dissenting opinion.
    Counsel
    For Appellant: Captain Seth A. Director (argued); Lieutenant
    Colonel Steven C. Henricks and Major Fansu Ku (on brief).
    For Appellee: Captain Michael C. Friess (argued); Colonel John
    W. Miller II, Lieutenant Colonel Michele B. Shields and Captain
    Tami L. Dillahunt (on brief).
    Military Judge:    Debra Boudreau
    THIS OPINION IS SUBJECT TO REVISION BEFORE FINAL PUBLICATION.
    United States v. Sanchez, No. 06-0617/AR
    Judge RYAN delivered the opinion of the Court.
    In this case we are asked to decide whether the military
    judge abused her discretion when she denied the motion in limine
    to exclude testimony from an expert in child sexual abuse that
    was based in part on findings from a physical examination of the
    victim, findings which Appellant claims are unreliable.   See
    Military Rule of Evidence (M.R.E.) 702; Kumho Tire Co. v.
    Carmichael, 
    526 U.S. 137
    , 141 (1999); Daubert v. Merrell Dow
    Pharmaceuticals, Inc., 
    509 U.S. 579
    , 589 (1993); United States
    v. Billings, 
    61 M.J. 163
    , 166 (C.A.A.F 2005).   We conclude that
    the military judge’s determination that the expert opinion had a
    sufficient factual basis and was reliable was not “‘manifestly
    erroneous.’”   General Electric Co. v. Joiner, 
    522 U.S. 136
    , 142
    (1997) (quoting Spring Co. v. Edgar, 
    99 U.S. 645
    , 658 (1879)).
    Therefore, we hold that the military judge did not abuse her
    discretion.
    I.   Background
    A.
    A general court-martial composed of officer and enlisted
    members convicted Appellant, contrary to his pleas, of rape and
    forcible sodomy of his eight-year-old stepdaughter, JA, in
    violation of Articles 120 and 125, Uniform Code of Military
    Justice (UCMJ), 
    10 U.S.C. §§ 920
    , 925 (2000).   The sentence
    2
    United States v. Sanchez, No. 06-0617/AR
    adjudged by the court-martial and approved by the convening
    authority included a dishonorable discharge, confinement for
    nine years, forfeiture of all pay and allowances, and reduction
    to the lowest enlisted grade.   The Court of Criminal Appeals
    affirmed.   United States v. Sanchez, No. ARMY 20010943 (A. Ct.
    Crim. App. Apr. 12, 2006) (unpublished).
    We granted review of the following issue:
    WHETHER THE MILITARY JUDGE ABUSED HER DISCRETION BY
    ADMITTING EXPERT TESTIMONY REGARDING THE ALLEGED VICTIM’S
    MEDICAL EXAMINATION OVER DEFENSE OBJECTION.
    B.
    JA, Appellant’s eight-year-old stepdaughter, complained to
    her mother that Appellant sexually molested her over a period of
    more than two years.   She presented details to her mother and to
    medical professionals regarding the instances of rape and
    forcible oral and anal sodomy of which Appellant was convicted.
    In early January 2001, a few days after the last act of
    forcible anal sodomy, Ms. Lori Long, a forensic examiner and
    sexual assault nurse examiner at the Chrisus Santa Rosa
    Children’s Hospital, examined JA.    Ms. Long concluded that JA’s
    vagina was abnormal, “concerning”1 for abuse, and consistent with
    the history of sexual abuse she took from JA.
    1
    “Concerning” is a medical term for evidence that is consistent
    with possible sexual abuse.
    3
    United States v. Sanchez, No. 06-0617/AR
    At the end of January 2001, Dr. Nancy Kellogg, the Medical
    Director of the Alamo Children’s Advocacy Center, reviewed Ms.
    Long’s conclusions and the patient history taken from JA by Ms.
    Long, interviewed JA, and conducted her own physical examination
    and medical evaluation of JA.
    At trial, Appellant moved in limine to exclude the
    testimony of Dr. Kellogg, who was an expert witness for the
    prosecution, under M.R.E. 702 and Daubert.       The defense accepted
    Dr. Kellogg as an expert in child sexual abuse and did not argue
    that expert testimony on child sexual abuse was irrelevant to
    the facts at issue in the case.2       Instead, the defense argued
    that the expert’s testimony was not the product of reliable
    methodology.   
    Id.
    The military judge conducted an Article 39(a), UCMJ, 
    10 U.S.C. § 839
    (a) (2000) hearing, to assess the reliability of
    this testimony.   At the hearing, Dr. Kellogg explained the
    methodology she used in arriving at her opinion that JA was
    concerning for sexual abuse.    Dr. Kellogg testified that she had
    2
    Dr. Kellogg was a board-certified pediatric physician with
    thirteen years of experience focusing on child sexual abuse.
    She was a full professor in the pediatrics department of the
    University of Texas Health Science Center in San Antonio, Texas.
    She was the Director of the Alamo Children’s Advocacy Center,
    where she had examined more than 6,000 children in possible
    sexual abuse cases. She had published twenty articles on child
    sexual abuse in scholarly and professional journals and been
    elected to the Ray Helfer Society, which is composed of the 100
    physicians in the world considered to be experts by their peers
    in the field of child sexual abuse.
    4
    United States v. Sanchez, No. 06-0617/AR
    conducted a physical examination of JA, taken fluid samples,
    conducted laboratory tests on those samples, reviewed JA’s
    medical history, consulted with a professional colleague, and
    spoken with JA, who made certain comments about the sexual abuse
    that implicated Appellant.    Dr. Kellogg testified that it is
    standard practice in her field to look at all of these factors
    together:   “the diagnosis in medicine is made on the basis of a
    constellation of findings.”
    Dr. Kellogg explained why, using this methodology, she
    concluded that JA was concerning for sexual abuse.      One of the
    most important factors was the consistent patient history.
    Relevant to the instant appeal are three specific medical
    findings from Dr. Kellogg’s physical examination of JA that she
    considered:   (1) a thickened hymen; (2) a high vaginal white
    blood cell count; and (3) anal dilation.      Dr. Kellogg elaborated
    on the significance of each of these findings as it related to
    her conclusion that JA was concerning for sexual abuse.
    Dr. Kellogg testified that the hymenal tissue in a
    prepubertal child should be thin and sheet-like, not thickened.
    JA’s hymen had focal thickening.       Moreover, the vaginal swabs
    revealed that JA had numerous white blood cells inside of her
    vagina.
    These findings were concerning for sexual abuse because
    while the hymen does thicken over time due to estrogen as the
    5
    United States v. Sanchez, No. 06-0617/AR
    child matures and sexual development occurs, focal thickening of
    the sort observed in JA, who was only eight, is not normal and
    is usually the result of trauma.       Trauma includes both
    irritation and penetration, which are consistent with sexual
    abuse.   Further, in light of JA’s prepubertal state of maturity,
    a high white blood cell count was unusual.      It could be caused
    by either an infection or irritation.      JA did not have an
    infection.   A hymen that was torn or attenuated could account
    for the presence of white blood cells because the protective
    shield is less effective in shielding the vagina from bacteria.
    JA’s hymen did not cover her vaginal opening.      The medical
    findings and patient history were the basis of Dr. Kellogg’s
    medical assessment that JA’s vagina was concerning for sexual
    abuse.
    Dr. Kellogg next described her examination of JA’s anus
    while JA was in the knee/chest position.      There was no stool,
    and both the external and internal sphincters immediately
    dilated.   Dr. Kellogg acknowledged that there were certain other
    circumstances where anal dilation might be considered normal.
    But because none of those circumstances existed, the anal
    dilation was concerning for sexual abuse.      Dr. Kellogg admitted
    that reliance on anal dilation findings to support a conclusion
    of sexual abuse is relatively controversial in her field.
    Dr. Kellogg further explained that her medical findings
    6
    United States v. Sanchez, No. 06-0617/AR
    were congruent with both the patient history that Dr. Kellogg
    had reviewed and JA’s statements during her examination.   A
    consistent patient history is one of the strongest indicators of
    sexual abuse.
    Dr. Kellogg admitted that no formal studies addressed the
    error rates for the medical findings she used as part of the
    basis for her conclusion that JA was concerning for sexual
    abuse.   She was unaware of any studies that compare “normal with
    abnormal, sexually abused kids” and that purported to study
    normal, nonabused children.    She explained that she believed
    that it would be impossible to conduct such a study, given the
    nature of child sexual abuse, which made her doubtful as to the
    validity of a “normal” nonabused control group.
    During the Article 39(a) UCMJ, session, defense counsel,
    using studies and journal articles written by other experts in
    the field of child sexual abuse, vigorously cross-examined Dr.
    Kellogg on her findings.   Dr. Kellogg was familiar with the
    studies cited by defense counsel and had coauthored articles
    with some of the individuals cited.   Dr. Kellogg explained,
    during both direct and cross-examinations, why she disagreed
    with the methodology in some of the studies.   She acknowledged
    that people in her field give different weight, or no weight, to
    certain anogenital findings.   She also explained why a prudent
    doctor would take into account the “constellation of findings”
    7
    United States v. Sanchez, No. 06-0617/AR
    in making a determination, rather than subscribe to a single
    diagnostic rubric.
    In response to the military judge’s question whether other
    experts in the field would rely on the same findings that Dr.
    Kellogg had used to evaluate whether a child had been the victim
    of sexual abuse, Dr. Kellogg responded that she could not speak
    for every other expert in the field.   But the colleague to whom
    she had shown the file agreed with her findings in this case.
    Dr. Kellogg also stated that while there is not one universally
    accepted methodology for relating medical findings to child
    sexual abuse, there are recognized standards in the medical
    profession that are relevant to determining if there is sexual
    abuse.
    The military judge stated that Dr. Kellogg’s testimony was
    relevant and admissible because “the members . . . will want to
    know whether there were any physical manifestations” of the
    alleged sexual abuse.   The military judge opined that Dr.
    Kellogg’s testimony would help the members understand the
    medical evidence including the physical examination.    The
    military judge concluded that Dr. Kellogg possessed specialized
    medical knowledge of and experience with the physical
    manifestations of child sexual abuse, and that she had done
    specialized work in identifying physical manifestations that had
    been mistaken for sexual abuse.   The military judge further
    8
    United States v. Sanchez, No. 06-0617/AR
    found that Dr. Kellogg’s testimony had sufficient factual basis
    because she had personally examined JA, had conducted over 6,000
    similar examinations, and was very familiar with the work of
    other experts in the field.
    Specifically addressing the methodology applied by Dr.
    Kellogg in arriving at her opinion in this case, the military
    judge ruled that it was reliable.     The military judge recognized
    that there is disagreement as to the meaning to be ascribed to
    any one measurement or factor between experts in the field, but
    stated that Daubert does not require general acceptance.     The
    military judge found that the conclusions drawn from anogenital
    findings relied upon by Dr. Kellogg had been subject to “peer
    review and publication; apparently hotly so.”    She accepted that
    there could be no known error rate because of the lack of a
    normative population, but nonetheless found that at least to
    some extent, the use of anogenital measurements is accepted by
    experts in the field, and that the “meaning to be given to the
    specific measurement” goes to the weight of the opinion rather
    than to its admissibility.    In light of these conclusions, and
    after conducting a M.R.E. 403 balancing test, the military judge
    permitted Dr. Kellogg to testify on the merits.
    Before the panel, Dr. Kellogg presented her medical
    findings, illustrated her points by referring to pictures and
    exhibits, and opined that her findings were concerning for child
    9
    United States v. Sanchez, No. 06-0617/AR
    sexual abuse.   She was subjected to vigorous cross-examination
    by the defense counsel.   JA also testified at trial.   The panel
    convicted Appellant of the charged offenses.
    The lower court summarily affirmed the approved findings
    and sentence in a per curiam opinion.
    II.   Discussion
    A.
    This Court reviews a military judge’s decision to admit or
    exclude expert testimony over defense objection for an abuse of
    discretion.   Billings, 
    61 M.J. at 166
    ; see also Joiner, 
    522 U.S. at 139
    . “[W]hen judicial action is taken in a discretionary
    matter, such action cannot be set aside by a reviewing court
    unless it has a definite and firm conviction that the court
    below committed a clear error of judgment in the conclusion it
    reached upon a weighing of the relevant factors.”   United States
    v. Houser, 
    36 M.J. 392
    , 397 (C.M.A. 1993) (citation omitted).
    Furthermore, “the abuse of discretion standard of review
    recognizes that a judge has a range of choices and will not be
    reversed so long as the decision remains within that range.”
    United States v. Gore, 
    60 M.J. 178
    , 187 (C.A.A.F. 2004) (citing
    United States v. Wallace, 
    964 F.2d 1214
    , 1217 n.3 (D.C. Cir.
    1992)).   As long as a military judge properly follows the
    appropriate legal framework, we will not overturn a ruling for
    an abuse of discretion unless it was “‘manifestly erroneous.’”
    10
    United States v. Sanchez, No. 06-0617/AR
    United States v. Griffin, 
    50 M.J. 278
    , 284 (C.A.A.F. 1999)
    (quoting Joiner, 
    522 U.S. at 142
    ).    This standard “applies as
    much to the trial court’s decisions about how to determine
    reliability as to its ultimate conclusion.”   Kumho Tire Co., 
    526 U.S. at 152
    .
    B.
    M.R.E. 702 dictates the admissibility of expert testimony.
    As relevant to this case, M.R.E. 702 permits expert testimony in
    the “form of an opinion or otherwise” only if the testimony:
    (1) is “based upon sufficient facts or data,” (2) is “the
    product of reliable principles and methods,” and (3) the
    principles and methods have been “applied . . . reliably to the
    facts of the case.”   Interpreting the analogous Fed. R. Evid.
    702 in Daubert, the Supreme Court both rejected the requirement
    that a scientific theory be “generally accepted” in the
    scientific community and made clear that the trial court has a
    “gatekeeping” role.   
    509 U.S. at 589
    .
    As gatekeeper, the trial court judge is tasked with
    ensuring that an expert’s testimony both rests on a reliable
    foundation and is relevant.   
    Id. at 597
    ; Kumho Tire Co., 
    526 U.S. at 141
    .   This Court also recognizes the gatekeeping role of
    the military judge with respect to expert testimony offered
    pursuant to M.R.E. 702.   Billings, 
    61 M.J. at 167
    .
    In Daubert, the Supreme Court identified four factors that
    11
    United States v. Sanchez, No. 06-0617/AR
    a judge may use to determine the reliability of expert
    testimony.   Those four factors are:     (1) whether a theory or
    technique can be or has been tested; (2) whether the theory or
    technique has been subjected to peer review and publication; (3)
    the known or potential rate of error in using a particular
    scientific technique and the standards controlling the
    technique’s operation; and (4) whether the theory or technique
    has been generally accepted in the particular scientific field.
    Daubert, 
    509 U.S. at 593-94
    .
    This Court has often cited the Daubert factors, along with
    those in Houser, 36 M.J. at 398-99, as firm ground upon which a
    military judge may base a decision.      But while satisfying every
    Daubert or Houser factor is sufficient, it is not necessary.       As
    Daubert itself states, the test of reliability is “flexible,”
    and the factors do not constitute a “definitive checklist or
    test.”    Daubert, 
    509 U.S. at 593-94
    .    The focus is on the
    objective of the gatekeeping requirement, which is to ensure
    that the expert, “whether basing testimony upon professional
    studies or personal experience, employs in the courtroom the
    same level of intellectual rigor that characterizes the practice
    of an expert in the relevant field.”     Kumho Tire Co., 
    526 U.S. at 152
    .
    The inquiry is “a flexible one,” Daubert, 
    509 U.S. at 594
    ,
    and “the gatekeeping inquiry must be tied to the facts of a
    12
    United States v. Sanchez, No. 06-0617/AR
    particular case.”   Kumho Tire Co., 
    526 U.S. at 150
     (citation and
    quotation marks omitted).    The trial judge “must have
    considerable leeway in deciding in a particular case how to go
    about determining whether particular expert testimony is
    reliable.”   
    Id. at 152
    .    Consequently, the trial judge has “the
    same kind of latitude in deciding how to test an expert’s
    reliability . . . as it enjoys when it decides whether that
    expert’s relevant testimony is reliable.”    
    Id. at 152
    .3
    The focus of the military judge’s inquiry into reliability
    is on the principles and methodology employed by the expert,
    without regard to the conclusions reached thereby.    Daubert, 
    509 U.S. at 595
    .   At a minimum, the military judge is required under
    M.R.E. 702 to determine whether the conclusion could reliably
    follow from the facts known to the expert and the methodology
    used, mindful that “conclusions and methodology are not entirely
    distinct from one another.    Trained experts commonly extrapolate
    from existing data.”   Joiner, 
    522 U.S. at 146
    .    Whether
    attempting to determine if there is “too great an analytical gap
    between the data and the opinion proffered,” 
    id.,
     or whether the
    3
    The dissent, while citing Daubert and Kumho Tire Co., gives
    neither latitude nor leeway to the military judge. Moreover, it
    gives no credence to the methodology of a medical expert,
    despite her unquestioned experience, application of the same
    diagnostic methodology in this case as she used in daily
    practice, and unrebutted evidence that she had given expert
    testimony based on the same methodology in approximately 600
    other cases.
    13
    United States v. Sanchez, No. 06-0617/AR
    proffered testimony falls “outside the range where experts might
    reasonably differ,” Kumho Tire Co., 
    526 U.S. at 153
    , the goal is
    to ensure that expert testimony or evidence admitted is relevant
    and reliable, as well as to shield the panel from junk science.
    C.
    Turning to this case, we begin with the observation that
    the military judge understood and applied the correct law in
    deciding whether to admit Dr. Kellogg’s testimony.   At the
    outset of her ruling, the military judge correctly summarized
    the standard for the admission of expert testimony, specifically
    stating the requirements under M.R.E. 702 and Daubert.     While
    this Court’s case in Houser, 36 M.J. at 397-99, was not
    explicitly mentioned, the military judge did analyze the
    qualifications of Dr. Kellogg, the subject matter of the expert
    testimony, the basis for the testimony, and the legal relevance
    of the testimony in compliance with the Houser framework.     The
    military judge specifically addressed the relevance and
    reliability aspects of the gatekeeping function as developed
    under the precedents of this Court and the Supreme Court.
    While Houser sets forth the correct framework for analysis
    of Daubert issues, in this case only the fifth Houser factor --
    the reliability of the evidence -- is in dispute.    Consequently,
    the question for this Court is only whether the military judge
    abused her discretion in determining that Dr. Kellogg’s
    14
    United States v. Sanchez, No. 06-0617/AR
    conclusion that JA was concerning for sexual abuse was reliable.
    We conclude she did not.
    The military judge’s ruling properly evaluated the
    methodology employed by Dr. Kellogg in determining that JA was
    concerning for sexual abuse.   The military judge’s findings are
    supported by Dr. Kellogg’s testimony about her physical
    examination of JA, the laboratory test results, her review of
    JA’s medical history, her consultation with a professional
    colleague, and her discussion with JA in the course of the exam.
    She testified that it is standard practice in her field to look
    at all of these factors together:     “the diagnosis in medicine is
    made on the basis of a constellation of findings.”    That
    evidence is unrebutted.    Moreover, Appellant submitted a study
    as part of his motion in limine,4 which contains a classification
    system for the “overall assessment of likelihood of abuse,” that
    rests on an amalgam of physical, laboratory, and medical history
    findings.
    Further, the military judge properly reviewed and
    personally questioned Dr. Kellogg as to her years of experience,
    her publications, her usual methodology, prior expert testimony
    relying on the same methodology, and her knowledge of other
    experts’ work in the field of child sexual abuse.    See Kumho
    4
    The study was Evolution of a Classification Scale: Medical
    Evaluation of Suspected Child Sexual Abuse, by Joyce A. Adams.
    The defense referred to Ms. Adams as an expert.
    15
    United States v. Sanchez, No. 06-0617/AR
    Tire Co., 
    526 U.S. at 150
     (reasoning that “the expert’s
    particular expertise” is an indicia of reliability).
    Finally, Dr. Kellogg’s testimony established that the
    methodology she employed with JA was the same methodology she
    used in her examination of more than 6,000 patients.    Dr.
    Kellogg also confirmed to the military judge that she had been
    qualified as an expert and been allowed to provide expert
    testimony on whether a patient was concerning for sexual abuse
    based on the methodology she used in this case, in reliance on
    the same universe of facts, approximately 600 times.5    On these
    undisputed facts, we do not think it unreasonable for the
    5
    The military judge specifically    probed   this    area   in   her
    questions to Dr. Kellogg:
    Q.   Okay.   And have you been recognized as an expert in
    each of those 600 [cases]?
    A.   Yes I have.
    Q.   And have you been allowed to testify in the past that
    your findings were “concerning” for child sexual
    abuse?
    A.   Yes I have.
    Q.   As the form of your opinion in that exact manner?
    A.   Yes, ma’am.
    Q.   About how many times?
    A.   “Concerning” specifically? Is that what you’re
    saying?
    Q.   Yes. Concerning that type of an opinion, that “X,”
    “Y,” and “Z” findings were “concerning” or
    “consistent” with child sexual abuse.
    A.   Based on exam alone or everything?
    Q.   Based on everything.
    A.   Based on everything. I have probably -– I would say
    about 90 percent of my actual testimony has been to
    that effect that the findings, the history and/or
    exam, was consistent with possible child abuse.
    16
    United States v. Sanchez, No. 06-0617/AR
    military judge to have found Dr. Kellogg’s methodology reliable.
    Appellant does not so much challenge the overall
    methodology employed by Dr. Kellogg, however, as he does
    question the analytic connection between the physical findings
    from Dr. Kellogg’s examination of JA and her testimony that
    those findings supported the opinion that JA was concerning for
    sexual abuse.   But Appellant’s challenge is rooted in a
    fundamental misapprehension of Dr. Kellogg’s methodology.   Dr.
    Kellogg did not identify any single physical finding as a litmus
    test for sexual abuse.   Instead it was her “constellation of
    findings” that was the basis for her expert opinion.    See United
    States v. Traum, 
    60 M.J. 226
    , 236 (C.A.A.F. 2004) (approving an
    expert doctor’s use of all facts available in reaching a medical
    opinion).6
    We observe that this case is not one where Appellant
    asserts that Dr. Kellogg was deficient because she failed to
    perform other relevant medical tests that would either bolster
    6
    The dissent’s reliance on In re Agent Orange Prod. Liab.
    Litig., 
    611 F. Supp. 1223
     (E.D.N.Y. 1985), for a contrary view
    is unwarranted. That case, of course, is a pre-Daubert case, a
    mass tort case, and does not address the admissibility of expert
    testimony. Moreover, Chief Judge Weinstein based his ruling in
    part on the fact that the experts in that case had not examined
    the victims. 
    Id. at 1235
    . In re Agent Orange does not stand
    for the proposition that a medical doctor, basing her opinion on
    a constellation of observed anogenital findings in an eight-
    year-old girl (after ruling out other explanations for the
    findings), laboratory results, and medical history findings, is
    providing an opinion that is either subjective or speculative.
    17
    United States v. Sanchez, No. 06-0617/AR
    or refute her medical opinion.   Appellant’s challenge is more
    narrow and focused.   In Appellant’s view, the hymenal thickening
    and anal dilation findings are unreliable because they fail to
    satisfy the Daubert factors.
    We reject this assertion for three reasons.    First, Dr.
    Kellogg testified to both hymenal thickening and anal dilation
    as objective medical and physical findings at the sites of the
    alleged sexual abuse.   Moreover, she described how factors, such
    as age, and other physical conditions, might cause these
    findings.   Those factors were ruled out before she considered
    the findings relevant to possible sexual abuse.    Second, defense
    counsel provided an expert study at trial that specifically
    included these findings, placing the use of anal dilation and
    hymenal thickening in the realm of findings where reasonable
    experts might disagree.   Third, the military judge clearly
    understood the Daubert factors, the manner in which the hymenal
    and anal dilation findings did not conform to those factors, and
    nonetheless found the evidence reliable.
    We cannot say that it was manifestly erroneous for the
    military judge to find that the evidence relating to hymenal
    thickening and anal dilation was reliable.   Nothing in the
    precedents of the Supreme Court or this Court requires that a
    military judge either exclude or admit expert testimony because
    it is based in part on an interpretation of facts for which
    18
    United States v. Sanchez, No. 06-0617/AR
    there is no known error rate or where experts in the field
    differ in whether to give, and if so how much, weight to a
    particular fact in deriving an opinion.    See United States v.
    Norris, 
    217 F.3d 262
    , 269-71 (5th Cir. 2000) (holding testimony
    admissible under Daubert even though “no error rate was known”
    and “no independent validation” of the expert’s testing had
    occurred); McReynolds v. Sodexho Marriott Servs., Inc., 
    349 F. Supp. 2d 30
    , 34 (D.D.C. 2004) (holding testimony admissible
    under Daubert although experts “might well differ . . . over
    various details of their analyses”). “Such a bright-line
    requirement would be at odds with the liberal admissibility
    standards of the federal [and military] rules and the express
    teachings of Daubert.”   Amorgianos v. Amtrak, 
    303 F.3d 256
    , 267
    (2d Cir. 2002).   Daubert expressly recognizes that the adversary
    system, including “[v]igorous cross-examination, presentation of
    contrary evidence, and careful instruction on the burden of
    proof are the traditional and appropriate means of attacking
    shaky but admissible evidence.”    
    509 U.S. at 596
    .
    As the military judge recognized, and as the testimony of
    Dr. Kellogg and the two exhibits submitted by the defense at the
    motion supported, different experts in the field of child sexual
    abuse give different weight to anogenital findings, and some
    discount certain types of anogenital findings altogether.    One
    expert study provided by the defense lists both a thickened
    19
    United States v. Sanchez, No. 06-0617/AR
    hymen and anal dilation as factors in assessing child sexual
    abuse.   Another expert study provided by the defense would not
    rely on anal dilation as a factor in assessing child sexual
    abuse.   Given these facts, it does not appear that the analytic
    gap between these physical findings and Dr. Kellogg’s conclusion
    that they supported her diagnosis that JA was concerning for
    sexual abuse was too great, or that Dr. Kellogg’s testimony on
    these points “fell outside the range where experts might
    reasonably differ.”   Kumho Tire Co., 
    526 U.S. at
    153 (citing
    Daubert, 
    509 U.S. at 596
    ).
    Nor was the military judge’s admission of Dr. Kellogg’s
    consideration of the increased white blood cells in JA’s vagina
    unreasonable, given the diagnostic approach taken by Dr.
    Kellogg.   This finding is different than the others, not
    qualitatively, but because there was no explicit reference to
    JA’s increased white blood cells in the military judge’s ruling,
    and, unlike the other anogenital findings, this factor is not
    itself mentioned in any of the articles written by experts
    presented at the motion hearing.
    Nonetheless, we conclude that it was not manifestly
    erroneous for the military judge to admit this testimony.    The
    military judge ruled that Dr. Kellogg’s “role [was] to assist
    [the panel] in understanding the physical examination” and
    therefore permitted her to address “any physical manifestations”
    20
    United States v. Sanchez, No. 06-0617/AR
    of sexual abuse.   The evidence in the record supports this
    ruling by the military judge.
    Dr. Kellogg described why she thought the increased white
    blood count was an “unusual” and concerning finding.   She
    explained that it was unusual because young children do not have
    an increased white blood cell count except under a few specific
    circumstances, which she ruled out.    She further explained that
    “the hymen acts as a protective shield in normal children,” and
    that a larger than normal hymenal opening could lead to
    irritation and increased white blood cells in the vagina.     She
    elaborated on this point, testifying that “we sometimes see [it]
    [] in victims of sexual abuse.”    She therefore concluded that
    the increased white blood cell count, in conjunction with the
    patient history and other findings, was concerning for sexual
    abuse because she had ruled out infection, JA’s hymen did not
    cover her vaginal opening, and a girl of JA’s age does not
    normally have increased white blood cells in her vagina.
    We observe there was some conflict in Dr. Kellogg’s expert
    testimony as to the exact size of a hymenal opening that is
    clinically significant.   In her Article 39(a), UCMJ, testimony,
    Dr. Kellogg states that JA’s hymen is abnormally short because
    it covers only 2.5 millimeters of the opening.   At another point
    in her Article 39(a), UCMJ, testimony she states that the hymen
    only covers one-eighth to one-tenth of the opening when it
    21
    United States v. Sanchez, No. 06-0617/AR
    should cover one-third.   On cross-examination defense counsel
    pointed out that Dr. Kellogg had previously stated that a normal
    range for this particular measurement could be between one and
    four millimeters, and because JA’s hymenal rim measured 2.5
    millimeters it fell within what could be considered normal
    range.   These statements were not harmonized during the Article
    39(a), UCMJ, testimony.
    Notwithstanding this point, we do not consider any slight
    flaw with regard to this single finding so significant as to
    undermine the otherwise proper reliability determination of the
    military judge.   See Amorgianos, 
    303 F.3d at 267
     (“The judge
    should only exclude the evidence if the flaw is large enough
    that the expert lacks ‘good grounds’ for his or her
    conclusions.”); Roane v. Greenwich Swim Comm., 
    330 F. Supp. 2d 306
    , 317 (S.D.N.Y. 2004) (quoting In re Paoli, 
    35 F.3d 717
    , 746
    (3d Cir. 1994)) (“Minor flaws in an expert analysis or slight
    modifications of otherwise reliable methods will not render an
    expert opinion per se inadmissible.”).
    In light of Dr. Kellogg’s testimony, and in the context of
    other anogenital medical findings, it was reasonable for the
    military judge to admit testimony on JA’s increased white blood
    count.   See Daubert, 
    509 U.S. at 593-94
    .   “Trained experts
    commonly extrapolate from existing data.”   Joiner, 
    522 U.S. at 146
    .   We do, however, have serious reservations regarding
    22
    United States v. Sanchez, No. 06-0617/AR
    whether this individual finding would have been admissible
    without being presented in the context of the other medical
    findings in this case.
    Given the standard of review in this case, we cannot say
    that the military judge abused her discretion.     It was not
    manifestly erroneous for the military judge to leave this
    admissible but, in Appellant’s view, shaky evidence to the
    adversarial process.   Daubert, 
    509 U.S. at 596
    .    It is the
    members who “must decide among the conflicting views of
    different experts, even though the evidence is ‘shaky.’”    Kumho
    Tire Co., 
    526 U.S. at
    123 (citing Daubert, 
    509 U.S. at 596
    ).
    III.   Conclusion
    In summary, the linchpin of this case is Dr. Kellogg’s
    reliance on a “constellation of findings” generated from a
    reliable methodology as the basis of her expert opinion.    We
    conclude that the military judge properly performed her
    “gatekeeping” duty established in Daubert.   
    509 U.S. at 593-94
    .
    The decision of the United States Army Court of Criminal Appeals
    is affirmed.
    23
    United States v. Sanchez, No. 06-0617/AR
    EFFRON, Chief Judge (dissenting):
    The majority opinion concludes that the military judge did
    not err in determining that Dr. Kellogg based her testimony on a
    reliable methodology under Daubert v. Merrell Dow
    Pharmaceuticals, Inc., 
    509 U.S. 579
     (1993). For the reasons set
    forth below, I respectfully dissent.
    I.   ADMISSIBILITY OF SCIENTIFIC EVIDENCE UNDER DAUBERT
    In Daubert, the Supreme Court placed ultimate
    responsibility on the trial judge to ensure that scientific
    evidence is reliable by critically examining the methodology
    from which the expert’s conclusions are derived.    
    Id. at 588, 592-93
    .   The Court stated that:
    in order to qualify as “scientific knowledge,” an
    inference or assertion must be derived by the
    scientific method. Proposed testimony must be
    supported by appropriate validation –- i.e.,
    “good grounds,” based on what is known. In
    short, the requirement that an expert’s testimony
    pertain to “scientific knowledge” establishes a
    standard of evidentiary reliability.
    
    Id. at 590
    .    The Court reasoned that the trial judge’s inquiry
    must be “a flexible one [whose] overarching subject is the
    scientific validity –- and thus the evidentiary relevance and
    reliability –- of the principles that underlie a proposed
    submission.”   
    Id. at 594-95
     (footnote omitted).
    United States v. Sanchez, No. 06-0617/AR
    Under Daubert, the trial judge must make “a preliminary
    assessment of whether the reasoning or methodology underlying
    the testimony is scientifically valid and of whether that
    reasoning or methodology properly can be applied to the facts in
    issue.”   
    Id. at 592-93
    .    The Court provided a nonexclusive list
    of factors that may be used for assessing reliability,
    including:   (1) whether the theory or technique can be or has
    been tested through use of scientific methodology; (2) whether
    the theory or technique has been subject to peer review and
    publication; (3) the known or potential rate of error; (4) the
    existence and maintenance of standards and controls; and (5)
    whether the theory or technique has been generally accepted in
    the expert community.    
    Id. at 593-94
    .
    In crafting the Daubert test, the Court rejected the
    previous standard, which asked only whether a scientific theory
    enjoyed “general acceptance” in the relevant professional
    community.   
    Id. at 588
    ; see Frye v. United States, 
    293 F. 1013
    ,
    1014 (D.C. Cir. 1923).     Although Daubert includes a broader
    range of scientific or technical evidence than the Frye general
    acceptance test, it is more restrictive than Frye because it
    requires a determination of whether that evidence is reliable
    even if it meets a general acceptance test.    See Edward J.
    Imwinkelried et al., 1 Courtroom Criminal Evidence 222-24 (4th
    ed. 2005).
    2
    United States v. Sanchez, No. 06-0617/AR
    The Daubert reliability assessment must be narrowly
    tailored to the precise issue before the court.   Kumho Tire Co.
    v. Carmichael, 
    526 U.S. 137
    , 141 (1999) (citing Daubert, 
    509 U.S. at 597
    ).   Evidence of an expert’s qualifications and
    general approach is not sufficient to establish the reliability
    of a particular technique used by the expert to analyze data and
    draw conclusions.   Id. at 153-54.   The specific theory or
    technique that is the subject of expert testimony must be
    sufficiently reliable to perform the “task at hand.”   Daubert,
    
    509 U.S. at 597
    ; Kumho Tire, 
    526 U.S. at 153-54
    ; see also
    Weisgram v. Marley Co., 528 U.S 440, 455 (2000) (opining that
    “[s]ince Daubert . . . parties relying on expert evidence have
    had notice of the exacting standards of reliability such
    evidence must meet”).
    The scientific methodology required by Daubert and its
    progeny is embodied in Military Rule of Evidence (M.R.E.) 702,
    which provides:
    If scientific, technical, or other specialized
    knowledge will assist the trier of fact to
    understand the evidence or to determine a fact in
    issue, a witness qualified as an expert by
    knowledge, skill, experience, training, or
    education may testify thereto in the form of an
    opinion or otherwise if (1) the testimony is
    based upon sufficient facts or data, (2) the
    testimony is the product of reliable principles
    and methods, and (3) the witness has applied the
    principles and methods reliably to the facts of
    the case.
    3
    United States v. Sanchez, No. 06-0617/AR
    See Daubert, 
    509 U.S. at 589-90
    ; Fed. R. Evid. 702.      As noted by
    the drafters of the parallel Federal Rule of Evidence, “[t]he
    more subjective and controversial the expert’s inquiry, the more
    likely the testimony should be excluded as unreliable.”      Fed. R.
    Evid. 702, Notes of Advisory Committee on 2000 Amendments.
    II.    ADMISSION OF DR. KELLOGG’S TESTIMONY
    At the time of Appellant’s court-martial, Dr. Nancy Kellogg
    was a physician and the director of the Alamo Children’s
    Advocacy Center.     Doctors at the Children’s Advocacy Center
    examined all children referred by the local hospital as
    potential victims of sexual abuse.     Dr. Kellogg estimated that
    she has examined approximately 6,000 children referred for this
    reason as well as approximately 2,000 children referred for
    other conditions.    The Government moved to permit Dr. Kellogg to
    testify as an expert witness in the field of child sexual abuse
    regarding the conclusions she derived from her physical
    examination of JA, the victim in this case.
    In a hearing on the motion under Article 39(a), Uniform
    Code of Military Justice (UCMJ), 
    10 U.S.C. § 839
    (a) (2000), Dr.
    Kellogg explained that she would testify about three physical
    findings that led her to conclude JA was “concerning” for sexual
    abuse:   (1) hymenal measurement; (2) anal dilation; and (3)
    vaginal white blood cell count.    Dr. Kellogg defined
    4
    United States v. Sanchez, No. 06-0617/AR
    “concerning” for sexual abuse as “a finding or a group of
    findings that I cannot readily explain as being normal or
    [attributed] to a condition other than sexual abuse. . . .
    they’re concerning in the sense that they signify possible
    trauma to the genitals”; however, “it could also be attributed
    to a nontraumatic event.”    Additionally, Dr. Kellogg explained
    that the most important factor in her assessment is a patient’s
    history, or account of abuse, especially if it remains
    consistent over time.
    Trial defense counsel opposed admission of Dr. Kellogg’s
    testimony, contesting the reliability of her methodology under
    M.R.E. 702 and Daubert.     Specifically, trial defense counsel
    challenged reliability under three of the Daubert factors:        the
    failure to calculate an error rate for these studies, the
    absence of direct peer review and publication, and the lack of
    general acceptance of Dr. Kellogg’s standards.    The defense
    argued that Dr. Kellogg’s experience at the sexual abuse clinic
    had not been subjected to “any statistical analysis, any
    verification, nor has she gone out into the community to
    determine the extent of these concerning findings in normal
    children.”
    The military judge granted the prosecution’s motion to
    admit Dr. Kellogg’s testimony, concluding that her methodology
    was reliable under M.R.E. 702 and Daubert.     The military judge
    5
    United States v. Sanchez, No. 06-0617/AR
    determined that Dr. Kellogg’s findings were based on sufficient
    facts or data under M.R.E. 702(1) because “[e]ven if there is a
    disagreement on matters within this area of expertise, Dr.
    Kellogg herself still has a basis of her own 6,000 examinations
    to fall back upon . . . .”   With respect to the Daubert factors,
    the military judge stated that: (1) although Dr. Kellogg’s
    methods were not universally accepted, lack of general
    acceptance is not a bar to admissibility; (2) Dr. Kellogg’s
    factors “have been subject to peer review and publication;
    apparently, hotly so.   But that is still peer review and
    publication”; and (3) “while there can be no known error rate
    because of the lack of a normative population, that at least to
    some extent the use of measurements and more than one
    measurement is accepted in that field.”
    III.    DISCUSSION
    “When expert testimony’s factual basis, data, principles,
    methods, or their application are called sufficiently into
    question, . . . the trial judge must determine whether the
    testimony has a reliable basis in the knowledge and experience
    of [the relevant] discipline.”    United States v. Billings, 
    61 M.J. 163
    , 168 (C.A.A.F. 2005) (quoting Kumho Tire, 
    526 U.S. at 149
    ) (quotation marks omitted).    In the present case, the
    military judge referred to the Daubert factors but failed to
    6
    United States v. Sanchez, No. 06-0617/AR
    either properly apply these factors or employ adequate
    alternative factors to assess the reliability of Dr. Kellogg’s
    methodology.
    Dr. Kellogg stated that she had testified previously in
    approximately 600 cases “on numerous subjects” involving a
    variety of matters related to child sexual abuse.   However, the
    record does not identify which methodologies were at issue in
    those cases –- which Dr. Kellogg said involved issues such as
    patterns of child disclosure and conditions confused with sexual
    abuse; nor does the record indicate that the methodology at
    issue in the present case -- see Part II supra (reliance on
    hymenal measurement, anal dilation, and vaginal white blood cell
    count) -- was litigated and determined to be reliable under
    Daubert in the prior cases.   Assuming that her prior testimony
    “on numerous subjects” was sufficient to qualify her as an
    expert, it was not sufficient to establish the reliability of
    the specific methodology used to support her testimony in the
    present case.   See Kumho Tire, 
    526 U.S. at 153
    ; Margaret A.
    Berger, The Supreme Court’s Trilogy on the Admissibility of
    Expert Testimony in Reference Manual on Scientific Evidence 9,
    34-35 (Federal Judicial Center, 2d ed. 2000) [hereinafter
    Admissibility of Expert Testimony].
    The military judge was required to examine the specific
    issue of whether Dr. Kellogg’s methodology supported her
    7
    United States v. Sanchez, No. 06-0617/AR
    conclusion that JA was “concerning” for child sexual abuse.
    Kumho Tire, 
    526 U.S. at 154-55
    .    In that regard, the military
    judge was required to ensure that the methodology not only
    enabled the expert to ascertain the existence of a physical
    condition, but also enabled the expert to testify as to the
    causation of that condition.   See, e.g., Berger, Admissibility
    of Expert Testimony at 34-35; Edward Imwinkelried, Forensic
    Science:   The Relativity of Reliability, 40, No. 
    4 Crim. L. Bull. 386
     (2004).   Assuming that Dr. Kellogg’s testimony would
    have been admissible, based on her clinical experience, to
    describe JA’s physical characteristics, Dr. Kellogg went beyond
    that scope to draw conclusions about the causation of those
    characteristics –- that they were “concerning” for sexual abuse.
    See Berger, Admissibility of Expert Testimony at 34-35.     The
    military judge failed to ascertain whether Dr. Kellogg’s
    methodology reliably supported this precise conclusion.     Kumho
    Tire, 
    526 U.S. at 154-55
    .
    As the majority opinion notes, Dr. Kellogg made “objective
    medical and physical findings at the sites of the alleged
    abuse.”    The conclusions Dr. Kellogg derived from her physical
    findings, however, were subjective.   Dr. Kellogg did not
    tabulate or verify her data and could not correlate the findings
    to a concrete likelihood of abuse.    Dr. Kellogg’s observations
    were based primarily on her experience as a clinician, which in
    8
    United States v. Sanchez, No. 06-0617/AR
    the absence of her own or other empirical support does not
    qualify such observations as evidence “derived by the scientific
    method.”   Daubert, 
    509 U.S. at 590
    .   As noted in David L.
    Faigman et al., 1 Modern Scientific Evidence:   The Law and
    Science of Expert Testimony 182 (2006-2007 ed.) [hereinafter
    Modern Scientific Evidence]:
    For scientists, the key word in the phrase
    “scientific method” is method . . .
    [C]laims [that do not utilize the scientific
    method] are likely to be defended by statements
    that the truth of the assertion rests on “my many
    years of experience,” . . . . [but w]ere the
    findings based on evidence produced by the
    scientific method, the expert should be able to
    present those studies to any audience, including
    a court, along with the methodology and the
    results of the studies.
    Dr. Kellogg’s conclusions constituted “merely an hypothesis,”
    not the product of a reliable scientific method.   Whiting v.
    Boston Edison Co., 
    891 F. Supp. 12
    , 25 (D. Mass. 1995) (finding
    a methodology unreliable when it could not be tested, was
    rejected by scientists in peer-reviewed journals, and had no
    known or potential rate of error).
    Dr. Kellogg considered findings to be “concerning” for
    abuse when there was no other readily attributable cause for
    “possible trauma.”   Dr. Kellogg also explained that the most
    important factor in her appraisal is the patient’s verbal
    account of abuse.    Dr. Kellogg’s hypothesis appears to be as
    9
    United States v. Sanchez, No. 06-0617/AR
    follows:    if the child is telling the truth, and there is no
    other readily apparent cause for the findings of “possible
    trauma,” then the findings are “concerning” for sexual abuse,
    meaning only that the possibility of sexual abuse cannot be
    ruled out.   This is the same type of ungrounded testimony Chief
    Judge Weinstein rejected in In re Agent Orange Product Liability
    Litigation, 
    611 F. Supp. 1223
    , 1238-39, 1250-51 (E.D.N.Y. 1985).
    Agent Orange foreshadowed Daubert in its critique of the Frye
    standard and emphasis on reliability of the expert’s
    methodology.   Daubert, 
    509 U.S. at
    586 n.4 (citing Michael D.
    Green, Legal Theory:   Expert Witnesses and Sufficiency of
    Evidence in Toxic Substances Litigation:   The Legacy of Agent
    Orange and Bendectin Litigation, 
    86 Nw. U. L. Rev. 643
     (1992)).
    In that case, the court barred proposed expert testimony
    that was based on the following hypothesis:   if the plaintiffs
    accurately reported symptoms, and if there was no evidence of
    other causes, then exposure to the Agent Orange chemical was
    “more likely than not” the proximate cause of the plaintiffs’
    symptoms.    In re Agent Orange, 
    611 F. Supp. at 1237-38
    .    In
    rejecting the proposed testimony, the court found that it was
    “speculative,” “so guarded as to be worthless,” and lacked “any
    foundation in fact.”   
    Id. at 1238
    .
    The military judge’s assessment of Dr. Kellogg’s
    methodology is similar to the assessment rejected by the United
    10
    United States v. Sanchez, No. 06-0617/AR
    States Court of Appeals for the Fifth Circuit in Black v. Food
    Lion, Inc., 
    171 F.3d 308
     (5th Cir. 1999).    The plaintiff in
    Black alleged that she developed fibromyalgia as a result of
    falling in defendant’s grocery store.   
    Id. at 309-10
    .    The trial
    judge admitted the plaintiff’s diagnosing physician as an expert
    witness on the issue of causation.   
    Id.
        The physician’s
    methodology consisted of: taking a patient history; diagnosing
    fibromyalgia; attempting to eliminate other causes; and
    concluding that the fall was the only possible remaining cause
    of the disease.   
    Id. at 313
    .
    In rejecting this testimony as unreliable scientific
    evidence, the Fifth Circuit stated that the Daubert inquiry
    required that the expert’s specific conclusion –- that the fall
    could have caused the plaintiff’s condition –- must be the
    product of a reliable methodology.   
    Id. at 311
    .   The court
    determined this methodology was unreliable under Daubert because
    it had not been tested or peer reviewed, lacked a rate of error,
    and was not generally accepted in the medical community.      
    Id. 313-14
    .   Although the expert followed the “approved protocol for
    determining fibromyalgia,” a methodology used in medical
    practice, it did not constitute reliable scientific evidence.
    See Berger, Admissibility of Expert Testimony at 34-35 (citing
    Black, 
    171 F.3d at 313
    ).   The Fifth Circuit determined that the
    trial judge, in admitting the expert testimony, “fatally erred
    11
    United States v. Sanchez, No. 06-0617/AR
    by applying [Daubert’s] criteria at a standard of meaninglessly
    high generality rather than boring in on the precise state of
    scientific knowledge in this case.”   Black, 
    171 F.3d at 314
    .
    The military judge in Appellant’s case committed a similar
    error.   Assuming that Dr. Kellogg’s methodology may be used in
    clinical practice, such use is not sufficient to establish
    reliability under Daubert and its progeny.      See Berger,
    Admissibility of Expert Testimony at 34-35.
    Examination of the Daubert factors identified by the
    military judge –- error rate, peer review and publication, and
    general acceptance –- further underscores the unreliability of
    Dr. Kellogg’s findings.
    A.   Error Rate
    Dr. Kellogg’s methodology for assessing physical findings
    did not utilize the scientific method.      Dr. Kellogg did not
    offer any support from the scientific community for the validity
    of her observations or the conclusions she drew from them.
    Despite her recognition that other studies have employed
    scientific research principles in this area, Dr. Kellogg did not
    record measurements, tabulate data, or otherwise conduct formal
    studies with her examination results.    Although Dr. Kellogg
    examined approximately 2,000 children who were not referred for
    possible sexual abuse, she did not attempt to study them as a
    control group and record the findings.      Further, Dr. Kellogg did
    12
    United States v. Sanchez, No. 06-0617/AR
    not test her conclusion that the findings introduced into
    evidence were “concerning” for sexual abuse in a blind case
    study.   That is, she did not compare examination results of
    abused versus non-abused children, nor did she research the
    prevalence of abused children who did not present physical
    evidence of abuse versus those who did.
    Dr. Kellogg maintained that there could be no measurable
    rate of error for the predictive value of her findings due to a
    lack of a normative population of non-abused children despite
    recognizing that “numerous studies” have calculated error rates
    for factors that may be indicative of child sexual abuse.     The
    military judge improperly relied on Dr. Kellogg’s claim that
    child sexual abuse is so rampant and hidden that no normative
    population could be identified in light of her acknowledgment
    that such studies are regularly conducted.   See, e.g., John
    McCann et al., Perianal Findings in Prepubertal Children
    Selected for Nonabuse:   A Descriptive Study, 13 Child Abuse &
    Neglect 179 (1989) [hereinafter Perianal Findings in Prepubertal
    Children].
    Even if Dr. Kellogg’s findings were potentially useful for
    treatment purposes in her clinic, they were not sufficiently
    reliable to be admitted in a court of law.   See Faigman, 1
    Modern Scientific Evidence at 182.   Her assessments of what
    constitutes trauma and when trauma is “concerning” for abuse
    13
    United States v. Sanchez, No. 06-0617/AR
    have not been empirically verified and therefore do not evoke
    sufficient guarantees of reliability to be admitted as expert
    testimony before a court-martial panel.
    B.   Peer Review and Publication
    The military judge found that Dr. Kellogg’s methods “have
    been subject to peer review and publication; apparently, hotly
    so.   But that is still peer review and publication.”   However,
    the peer review and publication factor “does not necessarily
    correlate with reliability.”   Daubert, 
    509 U.S. at 593
    ; Faigman,
    1 Modern Scientific Evidence at 60.     Rather, the value of peer
    review lies in the likelihood that other experts will detect
    flaws in and refine the methodology.    Daubert, 
    509 U.S. at 593
    .
    “The courts, no less than the scientific community, should be
    concerned not with the mere formal act of submission to the
    scrutiny of the scientific community, but with what the
    community concluded following such scrutiny.”    Faigman, 1 Modern
    Scientific Evidence at 60.
    Dr. Kellogg did not refer to any peer-reviewed article or
    scientific study that supported her findings.    A study cited by
    the defense directly contradicted her finding that the hymenal
    rim measurements are significant.     Joyce A. Adams, Evolution of
    a Classification Scale:   Medical Evaluation of Suspected Child
    Sexual Abuse, 6 Child Maltreatment 31, 33 (2001) [hereinafter
    Evolution of a Classification Scale] (stating that “[t]here are
    14
    United States v. Sanchez, No. 06-0617/AR
    currently no published research studies that show that a smooth
    but narrow posterior rim of hymen, or an enlarged hymenal
    opening diameter, or any combination of findings, are any more
    common in abused than in nonabused children”).   The pertinent
    studies in the record, which were submitted by the defense,
    underscore the absence of a scientific basis for Dr. Kellogg’s
    views regarding the significance of focal hymenal thickness or a
    high vaginal white blood cell count as “concerning” for sexual
    abuse.   Joyce A. Adams et. al., A Proposed System for the
    Classification of Anogenital Findings in Children with Suspected
    Sexual Abuse, 5 Adolescent Pediatric Gynecology 73 (1992);
    Adams, Evolution of a Classification Scale at 31; McCann,
    Perianal Findings in Prepubertal Children at 179.
    C.   Support in the Scientific Community
    The record demonstrates that the three factors Dr. Kellogg
    identified as “concerning” for sexual abuse have attracted
    little support in the scientific community.   Dr. Kellogg cited
    the thickening of JA’s hymen in only a localized area as the
    reason for classifying the hymen as “concerning,” but she
    acknowledged that there is no data to support her theory that
    focal hymenal thickening is “concerning” for sexual abuse.
    Likewise, Dr. Kellogg was aware of only one study that measured
    anal dilation, and there is no evidence as to how many
    physicians employ the method and with what criteria, as its use
    15
    United States v. Sanchez, No. 06-0617/AR
    is “very controversial” in the field.    Third, Dr. Kellogg
    testified that JA’s white blood cell count was “concerning” for
    abuse due to the finding of lack of adequate hymenal tissue.
    The high white blood cell count had no independent significance
    –- it was “concerning” for abuse only if the hymenal findings
    were the reliable product of a proven methodology, which Dr.
    Kellogg acknowledged was not the case.   Lastly, the patient’s
    consistent history, or account of abuse over time, to which Dr.
    Kellogg gave the greatest weight in making her assessment, is
    simply not scientific evidence.    It is the victim’s account of
    what occurred, and in this case, it was clinically unverifiable.
    Dr. Kellogg’s testimony was admitted to clarify medical
    evidence for the panel.   M.R.E. 702.   In this context, the
    military judge should have ensured that a reliable scientific
    methodology supported Dr. Kellogg’s conclusions.   Daubert, 
    509 U.S. at 591-92
     (reasoning that Fed. R. Evid. 702 “requires a
    valid scientific connection to the pertinent inquiry as a
    precondition to admissibility”); Billings, 
    61 M.J. at 168
    .
    Instead, Dr. Kellogg’s findings were based on unverified
    hypotheses.   Even though Dr. Kellogg conducted thousands of
    examinations for “objective medical and physical findings,” she
    did not use a reliable scientific methodology to evaluate those
    findings.
    16
    United States v. Sanchez, No. 06-0617/AR
    IV.   CONCLUSION
    In the present case, the military judge was required to
    determine “whether the expert’s theory can be challenged in some
    objective sense, or whether it is instead simply a subjective,
    conclusory approach that cannot reasonably be assessed for
    reliability.”   Fed. R. Evid. 702, Notes of Advisory Committee on
    2000 Amendments.   Here, the military judge did not recognize
    that there was no independent scientific support for Dr.
    Kellogg’s findings and Dr. Kellogg had failed to test her
    observations through a reliable scientific method.   Accordingly,
    I would conclude that the military judge abused her discretion
    in admitting Dr. Kellogg’s testimony.   See Billings, 
    61 M.J. at 167-68
    .
    17