Our studies also show that the relative e ectiveness of various techniques can vary signi cantly across target programs.Furthermore, our analysis shows that whether the e ectiveness di erences observed will result in savings in practice varies substantially with the cost factors associated with particular testing processes. From that perspective, our studies have elements of the software engineering validation models classified as “dynamic analysis and legacy systems” in =-=-=-.
As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce.
To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. Gregg Rothermel z To reduce the cost of regression testing, software testers may prioritize their test cases so that those which are more important, by some measure, are run earlier in the regression testing process.
The study reported here entails the use of empirical field study methods =-=-=- that follow conform to the principles for conducting and evaluating interpretive research design  as identified here. Increasingly applications rely on services, such as job submission, data transfer or data portal services. While the invocation of grid services could be hard coded in theo ..." Abstract.
Seven principles are used in this study in the following manner. Modern scientific applications often need to be distributed across grids.
A method based on design of experiments is proposed by which the validation experiments could be well arranged across the factor space through optimal design.
The p-value test technology is employed to evaluate the statistical consistency of the static data, and for a set of validation experiments obtained by Do E, the combined analysis of all the p-values resulted from these experiments can be taken based on the inverse-CDF theorem, to make an overall characterization of degree of the simulation credibility on the entire factor space.
We describe our experience in orchestrating scientific workflows using BPEL.
We have gained this experience during an extensive case study that orchestrates grid services for the automation of a polymorph prediction application.
Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive.
As ..." Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology.
Further work to understand the sources of this variance, and to incorporate such understanding into prioritization techniques and the choice of techniques, would be bene cial. ELBAUM ET AL.: TEST CASE PRIORITIZATION: A FAMILY OF EMPIRICAL STUDIES 175 with the testing process are not fully controlled.