Transaction Processing Performance Council (TPC) (Source : Wikipedia) is a non-profit organization founded in 1988 to define transaction processing and database benchmarks and to disseminate objective, verifiable TPC performance data to the industry. TPC benchmarks are used in evaluating the performance of computer systems; the results are published on the TPC web site. TPC’s flagship benchmark TPC-C, which simulates Online Transaction Processing (OLTP) Systems, has been applied in performance evaluations which have been published over the past two decades across a wide range of hardware and software platforms. Large number of sellers and database platforms have used TPC-C results in their publications.
From the TPC website,
“The term transaction is often applied to a wide variety of business and computer functions. Looked at as a computer function, a transaction could refer to a set of operations including disk read/writes, operating system calls, or some form of data transfer from one subsystem to another. While TPC benchmarks certainly involve the measurement and evaluation of computer functions and operations, TPC regards a transaction as it is commonly understood in the business world: a commercial exchange of goods, services, or money. A typical transaction, as defined by TPC, would include the updating to a database system for such things as inventory control (goods), airline reservations (services), or banking (money).
In these environments, a number of customers or service representatives input and manage their transactions via a terminal or desktop computer connected to a database. Typically, the TPC produces benchmarks that measure transaction processing (TP) and database (DB) performance in terms of how many transactions a given system and database can perform per unit of time, e.g., transactions per second or transactions per minute.”
To read more about TPC please Click Here.
Standard Performance Evaluation Corporation (SPEC) (Source : Wikipedia) is an American non-profit organization that aims to “produce, establish, maintain and endorse a standardized set” of performance benchmarks for computers. SPEC was founded in 1988. SPEC benchmarks are widely used to evaluate the performance of computer systems; the test results are published on the SPEC website. Results are sometimes informally referred to as “SPECmarks” or just “SPEC”.
SPEC evolved into an umbrella organization encompassing four diverse groups; Graphics and Workstation Performance Group (GWPG), the High Performance Group (HPG), the Open Systems Group (OSG) and the newest, the Research Group (RG).
From the SPEC Website,
“The System Performance Evaluation Cooperative, now named the Standard Performance Evaluation Corporation (SPEC), was founded by a small number of workstation vendors who realized that the marketplace was in desperate need of realistic, standardized performance tests. SPEC was founded based on the key realization that an ounce of honest data was worth more than a pound of marketing hype.
SPEC has grown to become one of the more successful performance standardization bodies with more than 60 member companies. SPEC publishes several hundred different performance results each quarter spanning a variety of system performance disciplines.”
To read more about SPEC please Click Here.
RPE2 or Relative server Performance Estimate 2, (Source : Wikipedia) is a computer benchmark developed initially by IDEAS International to compare the relative performance of servers built on x86, IA-64, and RISC processor architectures. IDEAS International was acquired by Gartner in June 2012 and is now part of the Gartner offerings.
The RPE2 benchmark is a composite of results, or estimated results, from the SAP SD Standard Application Two-Tier benchmark, TPC-C, TPC-H, SPECjbb2006, SPECint, and SPECfp benchmarks. The benchmark was initially created by IDEAS International in 2005, replacing an earlier benchmark called RPE. RPE2 data is incorporated into some server capacity planning tools, such as the ATS Server Consolidation Monitor from IBM and Data Center Intelligence software from CIRBA. RPE2 and all the associated Intellectual Property is now owned by Gartner.
From the Gartner website,
“Unlike other performance-ranking assessments, RPE2 was developed and is maintained by an independent, vendor-neutral research and advisory company. It is the only composite benchmark that offers full documentation on its data sources, providing complete transparency to give you peace of mind.
RPE2 data is utilized by the Gartner Technology Planner for Technical Professionals and the IDEAS Competitive Profiles information services. These services offer comprehensive coverage of the comparative features, pricing and performance characteristics of a wide range of enterprise servers sold across major global markets. RPE2 data enables them to identify which servers will likely compete with one another, based on their performance profiles. Your organization can use this same capability to quickly develop a shortlist of server options.
When used in conjunction with other Gartner services, RPE2 effectively supplements industry benchmark information and serves as a productivity aid to make rapid assessments.”
The Gartner Relative Performance Estimate (RPE2) is a ranking methodology that consolidates benchmark data from a broad spectrum of sources to generate a reliable, comprehensive picture of performance for server models and configurations. RPE2 Workload Extensions, introduced in 2010, are a derivative of RPE2 that use different weightings of the constituent benchmark components of RPE2 in order to highlight performance within specific workload profiles. Whereas RPE2 represents a composite mix of workloads, there are RPE2 Workload Extensions that provide a workload-specific estimate of performance for four areas: ERP, Java, OLTP and compute-intensive workloads.
For more details on RPE2 and Gartner’s current offering please Click Here.
SAP Application Performance Standard or SAPS (Source : Wikipedia) is a unit of measurement that describes the performance (throughput result) of a SAP system configuration. This hardware-independent unit is based on the SAP Sales and Distribution (SD) Benchmark.
From the SAP website
“SAP Application Performance Standard (SAPS) is a hardware-independent unit of measurement that describes the performance of a system configuration in the SAP environment. It is derived from the Sales and Distribution (SD) benchmark, where 100 SAPS is defined as 2,000 fully business processed order line items per hour.
In technical terms, this throughput is achieved by processing 6,000 dialog steps (screen changes), 2,000 postings per hour in the SD Benchmark, or 2,400 SAP transactions.
In the SD benchmark, fully business processed means the full business process of an order line item: creating the order, creating a delivery note for the order, displaying the order, changing the delivery, posting a goods issue, listing orders, and creating an invoice.”
For more details on the SAP benchmark please Click Here.