Update and Corrections for Bakeoff comments
Upon further review, the Bakeoff document printed out OK. (It was just hard to read on my screen.)
As for the methodology and results, I suggest the following:
1) This was not a “Consumer Reports” type of product review in my opinion.
2) If I had a specific operating system environment, e.g., UNIX, then the methodology in the report would be very useful for tuning my system to optimize performance.
3) Commercial customers are likely to evaluate Caching Products against their needs, the Product's performance when running specific applications and the ability to integrate the Product into their own operating environment with minimal impact. Important factors for purchase decisions are: ease of use,
performance, cost, service and support, ability to grow the system, is the vendor likely to still be in business two years from now, etc.
The bakeoff was useful for analyzing technical factors impacting caching performance.
In my opinion, the bakeoff methodology is not sufficient for making purchase decisions.
Comparing products in a benchmark evaluation is a complex process, and based on my business experience it requires many factors not considered in the bakeoff report. These factors include an assessment of customer requirements, current and planned operating system and network environment, ease of use and ease of implementation and integration, growth potential, vendor stability, etc.
|
