McJimbo - Re: "Intel will change the benchmarks!"
But it's PERFECTLY ALL RIGHT for AMD to change the Benchmark tests - RIGHT, JIMBO ?
Athlon Test Results Called Into Question
By Mark Hachman, Electronic Buyers' News
Aug 19, 1999 (9:05 AM)
URL: techweb.com
A Canadian benchmarking company Wednesday said Advanced Micro Devices modified tests to give its Athlon microprocessor an unfair advantage over Intel's Pentium III. FutureMark Software said AMD is violating the trademark of the Toronto company's 3DMark 99 MAX test suite and related licensing agreement. While FutureMark has not taken any legal action against AMD, the company said AMD's actions were inappropriate.
According to FutureMark, AMD modified the 3DMark 99 MAX test by optimizing the DLL test code for its recently released Athlon. AMD's own test results demonstrated that in one of the two 3DMark tests, the 600-MHz Athlon outperformed the 600-MHz Pentium III by over 30 percent. Of the 13 test results accompanying AMD's Athlon press release, the 3DMark figures were among the highest in favor of the chip.
FutureMark's claims are the latest example of "specmanship", the complicated practice of manipulating the convoluted melange of testing applications and benchmarks. Benchmarks are a series of tests performed to reduce a chip's performance in a variety of applications and situations to a single, simplified number for marketing purposes. The process is further complicated because the choice of tests itself is somewhat subjective.
A spokesman for AMD said mention of the customized 3DMark test suite was fully disclosed on page 39 of a 42-page "software performance guide" accompanying the test results. In the guide, AMD makes no mention of optimizing its code for the other test suites. Calls to the test software manufacturers mentioned in the guide have not been returned. However, several test firms have said the Athlon generally outperforms the Pentium III in a variety of applications.
Where AMD erred, according to FutureMark, was in comparing the optimized Athlon results to the generic test suite used with the Pentium III. FutureMark said official results should be based solely on the same 3DMark test being applied across the board to all microprocessors.
"No other CPU manufacturers have been given a chance to make optimizations," FutureMark said in a statement. "As such, it is inappropriate to compare the AMD special DLL version results with the official 3DMark 99 MAX version results."
A FutureMark spokesman declined further comment. |
