Cisco: Introducing the First Benchmark Standard for HCI
Industry standards enable fair competition and provide an objective “truth” to the customers. No one buys a car without first inquiring about its miles per gallon and vehicle safety ratings. Prior to the advent of standards, developed and administered by neutral parties, there was no way to compare different systems as each vendor would showcase their best performance in a contrived environment. Standards level the playing field, so to speak, bringing everyone to the same starting position and then based on their capabilities see who will finish first.
The Transaction Processing Performance Council (TPC) and the Standard Performance Evaluation Corporation (SPEC) have defined several standards for benchmarking computing systems. In recent years, the TPC has developed standards in the big data analytics and Internet of Things space: the TPCx-HS, TPCx-BB and TPC-DS V2 are standards for big data systems; while the TPCx-IoT is the industry’s first standard for IoT gateway systems.
These standards are widely used by customers in their key purchasing decisions; and they also influence technology enhancement with newer versions of products performing at higher levels with better energy efficiency at lower cost than previous versions. As pioneered by Jim Gray, et al. (in their early attempts at civilized competition) the TPC doesn’t just create the benchmarks, it also implements a process to review and monitor those benchmarks, and this lays the foundation for a fair competition.
Read the entire article here, Introducing the First Benchmark Standard for HCI
Via the fine folks at Cisco Systems.