SI
SI
discoversearch

We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor.  We ask that you disable ad blocking while on Silicon Investor in the best interests of our community.  If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.
Technology Stocks : Network Appliance -- Ignore unavailable to you. Want to Upgrade?


To: JakeStraw who wrote (8827)8/2/2001 9:13:58 AM
From: riposte  Respond to of 10934
 
Benchmarking the benchmarks

An interesting article from SearchStorage.com...(I wish I had more time to read it all...)

Steve



Benchmarking the benchmarks


By Alan Earls
Benchmarks, like EPA mileage ratings, offer an appealing if, at
times, flawed means of assessing the relative merit of competing
products. Unlike EPA ratings, however, there are numerous different
benchmarking standards and tests.

According to Arun Taneja, analyst with Enterprise Storage Group,
Milford, Mass., individual switch companies generally use their own
benchmarks to measure latency and other characteristics of the
switch. The same is true of host bus adapters (HBAs).

However, Taneja says the industry benchmarks that dominate SANs are
IOmeter and NetBench while for NAS the dominant benchmark has been
SPECsfs from SPEC.org. "EMC and NetApp have fought battles on this
for several years --unfortunately, SPEC found a serious bug in the
benchmark recently and in mid-June put up a note on their web site
that SPECsfs should not be used for NAS comparison until the bug is
fixed," says Taneja. This doesn't necessarily mean that SPECsfs
numbers are suspect because, Taneja suggests, it may simply have been
a problem with accommodating new architectures like BlueArc.

"I think SPEC has the opportunity to take the lead in SANs just like
they did in measuring system performance with SPECint and SPECfp,"
says Taneja. "They already have the organizational and technical
infrastructure set up and have relationships with the relevant vendor
community," he adds.

Additionally, for an alternative view of benchmarks -- and some
useful downloads -- visit
raid-storage.com, a site provided by
Advanced Computer & Network Corporation as an adjunct to their main
focus (which is the design, manufacture and sale of RAID systems).