|
|
SPEC/OSG Fair Use RuleConsistency and fairness are guiding principles for SPEC. To assure these principles are sustained, the following guidelines have been created with the intent that they serve as specific guidance for any organization (or individual) who chooses to make public comparisons using SPEC benchmark results. When any organization or individual makes public claims using SPEC benchmark results, SPEC requires that the following guidelines be observed: [1] Reference is made to the SPEC trademark. Such reference may be included in a notes section with other trademark references (see http://www.spec.org/spec/trademarks.html for all SPEC trademarks and service marks). [2] The SPEC web site (http://www.spec.org) or a suitable sub page is noted as the source for more information. [3] If competitive comparisons are made the following rules apply: a. the results compared must utilize SPEC metrics and be compliant with that SPEC benchmark's run and reporting rules, b. the basis for comparison must be stated, c. the source of the competitive data must be stated, and the licensee (tester) must be identified or be clearly identifiable from the source, d. the date competitive data was retrieved must be stated, e. All data used in comparisons must be publicly available (from SPEC or elsewhere) [4] Comparisons with or between non-compliant test results can only be made within academic or research documents where the deviations from the rules for any non-compliant results have been disclosed. [5] For benchmarks that allow estimates, it is acceptable to compare estimates to rule-compliant results only if the estimates are clearly identified as estimates. Comparisons, including competitive comparisons, are allowed as an exception to rules [3a] and [4] above. Details regarding clear identification of estimates are provided in the run rules for benchmarks that allow them. [6] If public claims are made using a retired benchmark, with results that have not been previously reviewed and accepted by SPEC, then the fact that the benchmark has been retired and new results are no longer being accepted for review and publication by SPEC must be plainly disclosed. Some benchmarks require that SPEC review and accept results prior to public use. For such benchmarks, the review process is not available after benchmark retirement, and therefore no new results may be published. The following paragraph(s) is an example of acceptable language when publicly using SPEC benchmarks for competitive comparisons: Example: SPEC® and the benchmark name SPECweb® are registered trademarks of the Standard Performance Evaluation Corporation. Competitive benchmark results stated above reflect results published on www.spec.org as of Jan 12, 2001. The comparison presented above is based on the best performing 4-cpu servers currently shipping by Vendor 1, Vendor 2 and Vendor 3. For the latest SPECweb99 benchmark results, visit http://www.spec.org/web99. The following is the list of approved SPEC OSG metrics and submetrics that may be used for competitive comparisons within the guidelines of the Fair Use Rule:
|