|
|
|
This section focuses on economics expert testimony in
antitrust litigation. Most
such testimony is based upon regression studies executed by the testifying
expert, so the discussion begins there. This material is widely misconstrued
by courts. But again, this
is not the fault of the courts so much as it is the result of the failure
of counsel to educate the courts on how the current admissibility criteria
apply to this subject area. In one of the important cases discussed
here, counsel, who described himself as specializing in handling experts,
lacked the specialized skills necessary to exclude clearly inadmissible
expert testimony. As a
result, he lost an important part of his case that he perhaps should
have won. ECONOMICS
EXPERT TESTIMONY IN ANTITRUST MATTERS
1
Introduction
There is a long and well-established history of regression based
expert testimony in the antitrust cases. Regression and hypothesis testing
are applied to determining whether an antitrust violation has taken
place and also to the calculation of antitrust damages when a violation
has been established. This analysis is often based on comparing actual
prices to the "but for" price that would have existed in the absence
of a violation. See section
2.a. Regression is used to calculate damages when antitrust violations
are alleged to have caused a plaintiff to over pay for a product, such
as In re Chicken Antitrust.
See Proving Antitrust Damages: Legal
and Economic Issues, Section of Antitrust Law of the American Bar
Association, 1996, at 174, (discussing the particulars of the regression
model used in Chicken Antitrust),
and In re Corrugated Container
Antitrust Litigation Id. At 175. It is used to calculate damages
from exclusionary practices, such as in Key Enterprises v. Venice Hospitals
919 F.2d 1550 (11th Cir. 1990) and Aspen Skiing Co. v. Aspen Highlands
Skiing Corp. 472 U.S. 585 (1985). Id., at 209-26. It has been used to calculate damages
from Robinson Patman violations Alan's of Atlanta v. Minolta Corp.,
903 F.2d 1414 (11th
Antitrust presents an interesting scenario for analyzing admissibility
of expert testimony. Because
so many of the most interesting cases are pre-Daubert, the opinions on the governing
law are of limited interest. The testimony is, however, of great
interest, because there is a wealth of pre-Daubert expert testimony that was
done in accordance with the standards that economists apply to their
non-litigation work. This
testimony typically meets the Daubert criteria because the Daubert criteria are based upon
scientific principals that had governed economics research for decades
when they first informed the law through their incorporation into
Daubert. More importantly, there
is information available about some of the pre-Daubert cases that illuminates Daubert in important ways.
Paralleling the antitrust caselaw is a substantial pedagogic
literature that addresses the "scientific method" discussed in Daubert, the ways in which the scientific
method and the econometric and statistical methods that it governs
form the core of economics research methodology, and how these methods
are applied in producing admissible expert testimony. Proving Antitrust Damages cited
supra, is part of that literature.
Part of the strategy of this chapter to fit a representative
introduction to scientific antitrust expert testimony into a small
space is to cite to accessible but sophisticated materials in the
scientific/legal branch of the antitrust literature.
Interestingly, since most of this literature is pre-Daubert, the fact that it relies
on the scientific principles articulated in Daubert is all the more telling.
In the language of Daubert’s
While a comprehensive assessment of expert testimony in antitrust
is far outside the scope of this chapter, by drawing on the statistical
tools developed in sections V.A and V.B, much of the expert testimony
materials in a range of cases can be illustrated in a case study of
the expert testimony used in
In re: Ampicillin Antitrust Litig. The expert testimony in Ampicillin made extensive use of
regression-based hypothesis
testing and is highly instructive.
See Rubinfeld and
Steiner, Quantitative Methods
in Antitrust Litigation. Law and Contemp. Probs., Autumn 1983,
at 69 (providing, in the words of two of the experts in the Ampicillin
case, a description of the regression analysis that was the basis
for the ampicillin expert testimony.)
Section V.C.2 takes up this analysis and generalizes it to
some other cases, while section V.C.3 discusses current 11th
Circuit cases, some of which apply sophisticated Daubert V.C.2 In re: Ampicillin Antitrust Litig
Two
of the testifying experts in the Ampicillin Antitrust litigation
have published an article that provides a much deeper look into regression
based expert testimony than is provided in the opinioins. See Rubinfeld and Steiner, Quantitative Methods in Antitrust Litigation.
Law and Contemp. Probs., Autumn 1983, at 69. Although it predates
Daubert by ten years, even
on a casual reading Rubinfeld and Steiner sounds like it is echoing
Daubert on testing and error rates.
This is because Daubert was informed by the scientific
literature and Rubinfeld and Steiner is a scientific-literature import
into the legal literature. There are several of these scientific imports
into the legal literature, many of which are cited throughout this
chapter. Several of these are jointly authored by economists and lawyers
or by legally sophisticated economists, and they tend to be among
the most informative works available.
In many cases, how the language of the scientific literature
has been imported into the cases is important, so the balance of this
section quotes liberally from Rubinfeld and Steiner. In the Ampicillin litigation plaintiffs
alleged that Ampicillin prices had been propped up by illegal antitrust
activity. This hypothesis test
begins the Daubert analysis. The testing is operationalized by
specifying a model, including dependent and explanatory (or independent)
variables and using data to estimate the parameters (the regression
coefficients and standard deviations) of the resulting model. These resulting parameters are used
to test the desired hypothesis(es). See Rubinfeld and Steiner at
105, [noting that "[t]he initial step in analyzing whether
there is an effect in any particular case is to define the list of
variables to be studied. . . . Once the variables have been listed
. . . verbal hypotheses
can be translated into specific, statistically testable null hypotheses.
. . . Once the null hypothesis has been specified, one chooses the
appropriate form for the multiple regression and estimates the model
using an appropriate data set. The estimated model is then used to
perform the test of hypotheses described previously. The result
should indicate whether or not there has been an effect." Specifying a model requires
setting out what variables are believed to impact the price of ampicillin.
In this case, the first step is to use an underlying understanding
of economics and of the institutions of the ampicillin market to model
the factors expected to determine the price of ampicillin in the market.
Surely the cost of ampicillin production will matter, as might competition
and the time period in which the ampicillin is produced.
See
(1) Cost,
C (2) Measure of Competition, COMP (3) Time
Dummy Variable, TIME (4) Generic
Competition Variable, N =
Rubinfeld and Steiner at , discussing a similar model
and noting that “e is
a random disturbance term. See
also Section V.A for discussion of the disturbance term. It is important to include
all the variables that are likely to affect P, but the object of the
exercise is to determine if N impacts P, for this supports plaintiff’s
contention. The impact
of N on P is determined by a hypothesis test of b=0. See Rubinfeld and Steiner at 106-7
(noting that “[t]he null hypothesis of no effect with respect to generic
house competition is the hypothesis that b =0, while the alternative hypothesis
is that b This is the prototype
of the testing requirement articulated in Daubert. As in section V.A, associated with
this test will be the rate of error of the test. Also, as supra, this rate of error is known
as the level of statistical significance. Testing the hypothesis
requires gathering relevant data, estimating the regression equation
and analyzing the resulting parameter estimates. The regression analysis will generate,
for each variable, two parameter estimates. The first of these will be the coefficient
estimate, which is the regression's estimate of a, b, c & d.
The second will be a standard deviation for each coefficient
estimate. Taken together, the coefficient
estimate and the standard deviation of the coefficient estimate generate
the hypothesis test discussed in Daubert.
Table
1A
Variable
Coefficient
t-Statistic
Coefficient t-Statistic&
N
0.06
0.67
0.01
0.12 C
3.45
14.03
-2.76
C2
0.54
This table summarizes
the results of hypothesis tests on all of the explanatory variables.
An economist would say that Table 1A shows that the coefficient on
N is not statistically significant, or that the coefficient is not
differentiable from zero. In
a Daubert hearing the same information
would be asserted as ‘the hypothesis test on N fails to show that
it impacted the price of Ampicillin when tested with a 5% rate of
error.’ On the other
hand, the hypothesis that C does not affect the price of Ampicillin
is rejected at an error rate of 5%.
The other interesting thing to note about Table 1 is that it
is divided into two parts. Table
1B exists because there is concern that costs may influence the price
of ampicillin in a more complicated way than is captured by the regression
specification employed to generate the results found in Table 1A. In particular, the concern is that
it may be that production cost increases affect price more when cost
is already fairly high. As
a result, the proper specification may include the square of cost
as an explanatory variable.
Table 1B shows results for a regression equation that includes
this variable. This is an example of the model specification problem
discussed in section V.A. Notice
that while the coefficients in the table change, the coefficient on
N is very small and continues to be statistically insignificant (and
fails the Daubert factor 1 test at any rate
of error that is ever used for such tests).
The Daubert summary
of the investigation into the impact of the presence of generic houses
on the price of Ampicillin is that the testimony has been Daubert
There
are two important things to note about the preceding description.
The
second is that the basis of the economists work is the hypothesis
testing that some commentators believe cannot be widely done in the
economic analysis that underlies expert testimony in antitrust litigation. Indeed, the most important point
to be made about this table of coefficient estimates and t-statistics
is that its purpose is to report
on the testing of hypotheses of the sort that the Daubert court discusses
and that scientifically unsophisticated commentators have dubbed as
being impossible in most economics expert testimony work. See section V.C.3. Such a table of hypothesis tests
is present in almost all credibly published empirical economics research,
and usually the point of such a table is to show the results of the
hypothesis tests that are the core of the economists work. Here the point is simpler. Here the point is merely that hypothesis
tests are the core of the economist's work and that hypothesis testing,
far from being impossible in most economics is, indeed, required in
most economics.
Professors Rubinfeld
and Steiner have served as experts in a number of other antitrust
litigations and, in addition to its discussion of the ampicillin litigation,
their Quantitative Methods
in Antitrust Litigation discusses their statistical analyses in
In re: Plywood Antitrust Litig.,
In re: Uranium Antitrust Litig., and Pacific Mailing Equipment v.
Pitney Bowes
a.
As supra, antitrust
price fixing damages are measured by the difference between the prices
actually paid by the plaintiff and the market price that would have
obtained in the absence of defendant's alleged conspiracy. Much of the application of regression
analysis to antitrust is solving the data and econometric problems
associated with estimating these but-for prices. See Finkelstein and
Levenbauch, Regression Estimates
of Damages in Price Fixing Cases, Law and Contemp. Probs., Autumn
1983, at 145 (illustrating this proposition in discussing regression
estimation in cases including In re: Corrugated Containers Antitrust
Litig., Concrete Pipe Litigation, In re: Chicken Antitrust Litig.
and Ohio Valley v. General
Electric. Finkelstein and Levenbauch is almost a companion piece
to Quantitative Methods in Antitrust Litigation
Note
the analogue to what could be called "but for" returns in the event
study technique of section V.B, where regression techniques are used
to estimate what the return on a security would have been, "but-for"
the release of fraudulent information.
If the point of this
section can be summarized into a single notion, it is that hypothesis
testing at particular error rates was a staple of the methods of expert
testimony in antitrust for decades before Daubert first articulated "testing"
and "error rates" as criteria for admissibility of expert testimony.
They have been the staples of almost all credible non-forensic economics
for much longer than that.
3.
POST DAUBERT EXPERT
TESTIMONY IN THE 11TH
Section V.B began with
the proposition that since virtually all credible economics, as practiced
outside of the courtroom, so routinely meets the test that the Daubert Court articulated, there
is little room to argue against requiring that economics based expert
testimony be tested by the Daubert factors, but noted also
that there is a contrasting view.
Many of the post-Daubert opinions are applying increasingly sophisticated scrutiny to the econometric analysis that underlies proffered expert testimony. Two such opinions were written by the same 11th Circuit trial judge in the same month and are somewhat complimentary. These opinions look carefully at econometric issues like model selection, heteroskedasticity and regression model assumptions that importantly inform the trial court's reliability investigation required by Daubert. a.
A Prototype Antitrust Daubert The
court in In Re: Polypropylene Carpet Antitrust
Litigation, 966 F. Supp. 18 (N.D. Ga. 1997), held a hearing to
determine whether an expert’s proposed methodology would “comport
with the basic principles of econometric theory,” id., at 26, and agreed that the
economist’s “multiple regression analysis is a scientific endeavor
whose admissibility in court proceedings must be determined using
the test set forth in Daubert
v. Merrell Dow Pharmaceuticals, Inc.” Id.
The court then analyzed econometric model selection, including some
of the possible different independent variables that could be included
and then analyzed the hidden the perils of trying a large number of
variables in a regression and excluding the ones that don’t seem to
fit. In Estate of Bud Hill v. ConAgra, 1997
U.S. Dist. LEXIS 13083, an unreported opinion by the same judge, the
court articulates some of the particular shortcomings that can cause
regression to fail a Daubert
test. Bud Hill at *16. Defendant challenged the reliability
of plaintiff’s expert’s testimony on the ground that it failed to
satisfy the regression assumptions (the court calls them principals).
In particular, defendant alleged that the plaintiff had failed
to test whether the error term of the regression formula was independent
of the included explanatory variables. Id.
The
court investigates and determines that defendant fails to show that
the regression violates the independence assumption “in a way that
the analysis fails to follow standard, acceptable econometric practices.”
The court reasoned that the evidence cited by defendants “does not
show that Dr. Jackson failed to test for the independence assumption.
Rather, Defendants' evidence shows only that Dr. Jackson failed to
test whether his formulas satisfy . . . the "constant variance assumption."
Id at 17. The court faults the defendant’s
failure to define the constant variance assumption (what we call the
heteroskedasticity problem), id, or establish that the constant
variance assumption must be fulfilled in order to perform a valid
regression analysis. .
. . Nonetheless,
the burden of explaining how Dr. Jackson's failure to satisfy the
constant variance assumption impacts the regression analysis belongs
to Defendants, as they are the parties raising the issue. Defendants'
failure to discharge this burden is reason alone to deny summary judgment
with respect to this issue.”
Bud Hill at *18. A subsequent section
of the court’s analysis is interesting for the depth of its probing
into the violation of the regression assumptions. It is somewhat lengthy, but I believe
that it reflects where sophisticated courts are in their application
of Daubert
specified
in Defendants' argument. Dr. Jackson defines the " variance
assumption" in
the regression formula. Heteroscedasticity occurs "when the disturbance
or error associated with a multiple regression model has a nonconstant
variance; that is, the error values associated with some observations
are typically high, whereas the values associated with other observations
are typically low." supra,
at 464. Stated differently, heteroscedasticity " to
the values of the coefficients"
that
heteroscedasticity was [*22]
degree,
court concluded that " not]
detract from the validity" Legal
Econ. 1, 14 n.4 (1994) (" consistent
and unbiased."
his
regression analysis. Bud Hill
Having dispatched defendant's
allegation that plaintiff’s regression residuals were heteroskedastic,
the court turned its attention to defendant’s allegation that plaintiff’s
regression does not include certain significant variables.
The court cited Bazemore v. Friday, 487 U.S. 385
(1986), a pre-Daubert admissibility.
Bazemore
As
the econometric discussion of section V.A demonstrates, when variables
are improperly omitted from a regression study, the outcome is that
the resulting estimators lose the desirable properties that make them
scientifically reliable, and lost with this scientific reliability
is the estimates evidentiary reliability.
While econometrics is a powerful tool, when it is used other
than in accord with the assumptive structure upon which it is built,
the answers that it produces are really answers to questions other
than the ones that were thought to be being asked of it. A misspecificed
model must fail a Daubert
examination because its tests are invalid, the error rates of those
tests are unknowable, misspecified models are not generally accepted
and are poor candidates for peer-reviewed publication because of the
well-known invalidity both of its tests and the error rates of those
tests. Bazemore may accommodate model
misspecification. Daubert does not, and it will be
interesting to see if the Court takes the opportunity to conform Bazemore to its more sophisticated
analysis in Judge Posner provides
an accessible but sophisticated discussion of specification error
in Sheehan v. Daily Racing Form, Inc.
104 F.3d 940 (7th b.
ASIDE: ANOTHER VIEW OF DAUBERT One
commentator has recently observed that "[i]t is doubtful that much
economic testimony would survive a strict and literal application
of the Daubert factors.
. . .few economic techniques of the ilk utilized in antitrust litigation
could be "tested" in the sense contemplated by Daubert, i.e., falsified." Gavil, After Daubert: Discerning the Increasingly
Fine Line Between the Admissibility and Sufficiency of Expert Testimony
in Antitrust Litigation, 65 Antitrust L. J. 663, 673-4. The cases of section V.C.3.a, would
seem to refute this assertion and it is interesting to contrast it
with the views of the scientifically sophisticated commentators cited
elsewhere in this chapter. See Rubinfeld and Steiner
at
70 [noting that "hypothesis testing is particularly useful for dealing
with questions of whether an antitrust violation has occurred], Rubinfeld
Econometrics in the Courtroom,
85 Colum. L. Rev. 1048 at 1049 [noting that "the most prominent application
of econometric methods" is "the use of significance levels for hypothesis
testing," (or to use the less descriptive term employed in Daubert, falsification)]. Proving Antitrust Damages, at 145
[beginning a full chapter discussion of the use of econometrics
and statistical analysis in antitrust by stating that "[r]egression
analysis is a statistical technique that . . .can assist an antitrust
plaintiff in proving both the fact and the amount of its injury,"
before going on to develop the notions of hypothesis testing and falsifiability
for application to antitrust damage calculations]
This list of contra
The
author himself notes that his "exposition of 'falsifiability' and 'rate of error'
is somewhat simplistic," Gavil at 675, note 48. The resulting observations may have
just given way to the preponderant evidence on the role of testing
in economics and econometrics, except that these "simplistic" arguments
were made in the commentator's discussion of the trial courts analysis
of expert testimony in City
of Tuscaloosa v. Harcross Chems., 877 F. Supp. 1504 (N. D. Ala.
1995). When Tuscaloosa v. Harcross
went up to the 11th Circuit on appeal, an amicus brief
that echos these misconceptions was filed in support of Tuscaloosa and the Court cited to
the brief with approval in a footnote that has been cited by another
11th Circuit trial court.
The connection may just be coincidence because the amici did
not cite to Gavil, but regardless, this commentary is apparently adopted
in the 11th Circuit, subject to how the Circuit interprets
Tuscaloosa c.
Tuscaloosa v. Harcros
Chems., Inc., 158 F.3d 548 (11th In
Tuscaloosa v. Harcros,
the 11th Circuit generally reversed the district court's
exclusion of proffered antitrust expert testimony and stated that
many of the problems in the district court's opinion "might have been
avoided had the district court simply held a Daubert hearing to allow the parties
to clarify their positions, as well as the law, regarding the admissibility
of these experts' testimony." Tuscaloosa With
respect to admissibility of the experts' testimony, the court affirmed
that "[e]xpert testimony may be admitted into evidence if: (1) the
expert is qualified to testify competently regarding the matters he
intends to address; (2) the methodology by which the expert reaches
his conclusions is sufficiently reliable as determined by the sort
of inquiry mandated in Daubert;
and (3) the testimony assists the trier of fact, through the application
of scientific, technical, or specialized expertise, to understand
the evidence or to determine a fact in issue. See Fed. R. Evid. 702;
Daubert, 509 U.S. at 589, 113 S.
Ct. at 2794. Id. The
Court quoted Daubert for
the propositions that "the inquiry envisioned by Rule 702 is . . .
a flexible one", and that "many factors may bear on the inquiry" into
the reliability of the testimony. To the four Daubert factors, the Court added
a fifth, "the existence and maintenance of standards controlling [its]
operation" (referring to the operation of the experts methods. Id.
The
Court applied a novel version of flexibility and decided against applying
the testing factor at all, citing amici, who "helpfully point out
that, although 'an important aspect of assessing scientific validity
(and therefore evidentiary reliability) is the ability of other scientists
to test or retest a proponent's theory,' not every scientific or technical
methodology applied by expert witnesses is susceptible to such an
analysis. (citations omitted)” Tuscaloosa at 566 n.25. The Court
reasoned that "[e]conomic or statistical analysis of markets alleged
to be collusive, for instance, cannot readily be repeatedly tested,
because each such case is widely different from other such cases and
because such cases cannot be made the subject of repeated experiments."
Id. The Court said that "[t]he proper inquiry regarding the reliability
of the methodologies implemented by economic and statistical experts
in this context is not whether other experts, faced with substantially
similar facts, have repeatedly reached the same conclusions (because
there will be few or no cases that have presented substantially similar
facts). Instead, the proper inquiry is whether the techniques utilized
by the experts are reliable in light of the factors (other than testability)
identified in Daubert and in light of other factors
bearing on the reliability of the methodologies.” Id. This
is difficult to square with the analysis of sophisticated commentators,
who propose that testing is the essence of Daubert. See Faigman, Kaye, Saks & Sanders,
Modern Scientific Evidence: the Law and Science of Expert Testimony
at 20 (observing that "courts will find application of Daubert difficult if they treat
testability as an optional factor. The other three factors all presuppose
testability; in science, a non-testable hypothesis cannot have an
error rate and is exceedingly unlikely to be published in a peer-reviewed
journal and achieve general acceptance.) It is well established that "economics
in general uses a scientific methodology." 108 Harv. L. Rev. 1481,
1524 (1995), and that regression, the economist's primary tool of
analysis, is prototypical of scientific methodology. In Re: Polypropylene Carpet Antitrust
Litigation, 966 F. Supp. 18, 26 (N.D. Ga. 1997), (citing to highly
informed sources and observing that “multiple regression analysis
is a scientific endeavor . . ") The
Court reversed the district court's exclusion of the expert's testimony,
writing that his "testimony is entirely within his competence as a
statistician" and that "his testimony regarding estimated damages,
are the products of simple arithmetic and algebra and of multiple
regression analysis, a methodology that is well-established as reliable."
Id. Perhaps
the court's observation about testing will be limited to "arithmetic
and algebra," which surely are admissible without a testing requirement,
although, at least in the former case, there is question as to how
the expert testimony will assist any but the most innumerate trier
of fact. However, to apply such statements to an economist's regression
analysis would fly in the face of the overwhelming preponderance of
the informed literature, which generally accepts hypothesis testing
as the sine qua non Finally,
the court added to the Daubert
factors a fifth factor, the existence and maintenance of standards
controlling the use of the expert's methods. Id. at 563. d.
Allapattah Services
Inc. v. Exxon, 61 F. Supp. 2d 1335 (S.D.Fla. 1999).
Allapattah Services held
several days of Daubert hearings,
citing to Daubert for the
eleventh circuits five factors for admissibility of expert testimony
(Daubert's four plus "the
existence of standards" factor discussed supra.) See Allapattah Services at 1338. The Court then cited to Tuscaloosa for the 11th Circuits opinion
on the proper way to apply those factors to an economist's testimony. The Court wrote that "the Eleventh
Circuit, in a pre-Kumho
case, discussed, in a footnote, the proper inquiry regarding the reliability
of the methodologies implemented by economic and statistical experts
in the Daubert context.
The entire footnote is set forth because of its importance to this
court's analysis." Id.
at 1339. The referenced footnote is footnote 25, discussed at length
supra
The proffered expert testimony in Allapattah Services did include
regression testimony and |
| |||||||||