Volume 4, Number 40 -- November 1, 2007

SPEC Launches Java Messaging Benchmark

Published: November 1, 2007

by Timothy Prickett Morgan

Getting a sense of the performance of applications on various server platforms has been made more problematic since the advent of distributed computing a decade ago. But real distributed computing--the kind driving Web-based applications today--is not just about separating application serving and database serving, which was complex enough. It is about having many different applications and pieces of middleware mashed up into a new kind of application that is inherently more complex than a simple two-tier or three-tier architecture.

To help company's better assess how iron performs in this more complicated hardware and software environment, the techies and vendors who participate in benchmark test development at the Standard Performance Evaluation Corporation have worked together to create the SPECjms2007 Java Message Service test, one of a suite of Java benchmarks. The new test does not, by the way, replace the SPECjAppServer2004 test, which was designed to stress Java-based application servers; nor does it obsolete the SPECjbb2005 server benchmark, which is an implementation of a Java-based online transaction environment.

According to SPEC, the SPECjms2007 test is the first industry-standard benchmark created to evaluate the performance of enterprise message-oriented middleware servers based on the Java Message Service. Message-oriented middleware is used in a number of financial services and telecommunications applications. (Remember all the noise that IBM made about MQ Series, now called WebSphere MQ, and Microsoft made about Message Queuing, or MSMQ, a few years back?) In any event, message queuing software is used to link distributed applications and the servers that support them together such that delays or broken links between machines do not stop transactions dead in their tracks; transactions are done by brokering message exchanges between machines and their software, and if a link gets broken or swamped, the messages are queued up for completion later. The net effect is that when you go to the ATM to get your money, you can get that money even if a part of the bank's financial applications are offline. Because of the flexibility that message queuing gives to applications, companies in the manufacturing, healthcare, and distribution industries are now looking at how to deploy this technology, and the JMS approach is one way to get this done in a Java environment. The benchmark spans the entire Java application, from hardware, the Java Virtual Machine and JMS service, the database, and the application that hammers on this software stack.

Unlike many benchmark tests that have been created by SPEC, the Transaction Processing Council, and other organizations, the SPECjms2007 test has two different metrics, which relates to the two ways in which JMS-style applications can be scaled--a horizontal and a vertical metric. The horizontal metric means that the workload on a network is scaled up by increasing the number of queue destinations that messages have to be transmitted to as part of the application; message traffic remains constant. The vertical metric scales the JMS application keeps the number of message destinations constant, but the number of messages is boosted. Both scenarios happen in the real world, hence the need to measure performance in both ways.

The Technische Universitat Darmstadt in Germany, the Apache project, and IT vendors BEA Systems, IBM, Oracle, and Sun Microsystems worked together to create the SPECjms2007 test.

No vendors have released any test results on the SPECjms2007 test as yet.


SPEC Introduces MPI Supercomputer Benchmark

Power6-Based System i Performance: Your Mileage Will Vary

Power6-Based System i Performance and Bang for the Buck

Transaction Processing Council Launches TPC-E Benchmark

                     Post this story to del.icio.us
               Post this story to Digg
    Post this story to Slashdot

Sponsored By

MKS Takes Risk Out of Change Management
for Puget Sound Blood Center

At Puget Sound Blood Center (PSBC) we need our systems to run
24/7 x 365 days a year - lives depend on it.

Software change can be risky business. MKS gives us
one change management solution across all of our platforms.

With MKS for System i and distributed change control,
our systems run risk free.

With MKS, we are one.

Read our story: Puget Sound Blood Center

Editor: Timothy Prickett Morgan
Contributing Editors: Dan Burger, Joe Hertvik,
Shannon O'Donnell, Timothy Prickett Morgan
Publisher and Advertising Director: Jenny Thomas
Advertising Sales Representative: Kim Reed
Contact the Editors: To contact anyone on the IT Jungle Team
Go to our contacts page and send us a message.

Sponsored Links

COMMON:  Join us at the annual 2008 conference, March 30 - April 3, in Nashville, Tennessee
Roaring Penguin:  Stop spam at the mail server on YOUR terms with CanIt-PRO
NowWhatJobs.net:  NowWhatJobs.net is the resource for job transitions after age 40


IT Jungle Store Top Book Picks

The System i Pocket RPG & RPG IV Guide: List Price, $69.95
The iSeries Pocket Database Guide: List Price, $59.00
The iSeries Pocket Developers' Guide: List Price, $59.00
The iSeries Pocket SQL Guide: List Price, $59.00
The iSeries Pocket Query Guide: List Price, $49.00
The iSeries Pocket WebFacing Primer: List Price, $39.00
Migrating to WebSphere Express for iSeries: List Price, $49.00
iSeries Express Web Implementer's Guide: List Price, $59.00
Getting Started with WebSphere Development Studio for iSeries: List Price, $79.95
Getting Started With WebSphere Development Studio Client for iSeries: List Price, $89.00
Getting Started with WebSphere Express for iSeries: List Price, $49.00
WebFacing Application Design and Development Guide: List Price, $55.00
Can the AS/400 Survive IBM?: List Price, $49.00
The All-Everything Machine: List Price, $29.95
Chip Wars: List Price, $29.95

The Four Hundred
IBM's Math on User-Priced System i Versus Vintage Machines

Midrange Shops Get Disaster Recovery Services from IBM

Ask TPM: Two System i Questions, and Two Responses

As I See It: Survey Says . . .

The Linux Beacon
Egenera Breaks Blade Software Free from Hardware

Citrix Closes XenSource Deal, Does Deal with Dell and Xen Desktops

Sun Puts Intel Quad-Core Chips into Ultra Workstations

Midrange Shops Get Disaster Recovery Services from IBM

Four Hundred Stuff
Zend Plans Treats, Tricks for System i Programmers

Mantis Bug Tracker Ported to i5/OS

mrc Goes Web 2.0 with m-Power

IBM Updates Disk and Tape, Buys Storage Software Developer

Big Iron
IBM Readies Quad-Core z6 Chip for Mainframe Iron

Top Mainframe Stories From Around the Web

Chats, Webinars, Seminars, Shows, and Other Happenings

Four Hundred Guru
Use PHP to Bring i5/OS Resources to the Web

Wrapping Free Form Text

Admin Alert: Limiting System i User Sign-ons the Smart Way

System i PTF Guide
October 27, 2007: Volume 9, Number 43

October 20, 2007: Volume 9, Number 42

October 13, 2007: Volume 9, Number 41

October 6, 2007: Volume 9, Number 40

September 29, 2007: Volume 9, Number 39

September 22, 2007: Volume 9, Number 38

The Windows Observer
Microsoft Unveils New 'Oslo' Approach to SOA

Good Times Roll for Microsoft Financially

Microsoft Concedes to EC, Slashes Protocol Pricing

'Viridian' Hypercall APIs to be Open Source, Microsoft Says

Four Hundred Monitor
Four Hundred Monitor's
Full iSeries Events Calendar


Gabriel Consulting Group
Computer Measurement Group
Canvas Systems

Printer Friendly Version

SCO to Sell Unix Wares for $36 Million?

Sun Sues NetApp Right Back Over Patents

'Project Indiana' OpenSolaris Preview Debuts

Midrange Shops Get Disaster Recovery Services from IBM

But Wait, There's More:

Gartner Says CIOs Will Be Measured on IT and Business Agility . . . Egenera Breaks Blade Software Free from Hardware . . . VMware's Sales Up 90 Percent in the Third Quarter . . . SPEC Launches Java Messaging Benchmark . . . SAP Boosts Sales and Profits in the Third Quarter . . . Symantec Survey Says DR Planning and Testing Are Inadequate . . .

The Unix Guardian


Subscription Information:
You can unsubscribe, change your email address, or sign up for any of IT Jungle's free e-newsletters through our Web site at http://www.itjungle.com/sub/subscribe.html.

Copyright © 1996-2008 Guild Companies, Inc. All Rights Reserved.
Guild Companies, Inc., 50 Park Terrace East, Suite 8F, New York, NY 10034

Privacy Statement