The 1st International Workshop on Load Testing of Large Software Systems (LT2012)

April 17, 2012.
Montreal, Quebec, Canada.
Co-located with ICST 2012,
The 5th IEEE International Conference on Software Testing, Verification and Validation

To those industrial practitioners and researchers, who don't have time to write a 5 page research paper, but still want to participate in the LT 2012 workshop: we have created a new track for you!

We want to hear your stories about challenges, opportunities and experiences on testing large scale software systems. We are interested in all aspect of testing large systems such as load testing, performance testing, stress testing, stability testing and reliability testing. The theme for the new track is Large Scale Testing. Testing large scale software systems faces many difficulties, such as tooling (choosing/implementing the testing tools), environments (software, hardware setup) and time (limited time to design, test, and analyze). This track will accept 5 minutes lightening talks and 20 minutes presentation talks (max 25 slides). The accepted works will be posted on the LT 2012 website. The deadline is March 13th, 2012.

Please consider submitting and spread the news! Submissions are accepted here. Once you log in, under the Submission tab, please check the Large Scale Testing track.

Modern software systems ranging from e-commerce websites to communication infrastructures must service millions of users. Many field problems of these systems are due to their inability to scale to field workloads, not due to feature bugs. To assure the quality of these systems, load testing simulates thousands or millions of users performing tasks at the same time. A load test can last from several hours to a few days, during which gigabytes of performance counter and log data is generated.

Load testing is a difficult task requiring a great understanding of the system under test. Problems in the application under test, the load generator or the load environment all could be the sources of load testing problems. Yet, load testing has received relatively little attention in the software testing research community. Load testing is gaining more importance, as an increasing number of services are being offered in the cloud to millions of users. This one-day workshop intends to bring together software testing researchers, practitioners, and load testing tool developers to discuss the challenges and opportunities of conducting load testing research on large scale software systems. Our ultimate goal is to establish and grow an active community around this important and practical research topic.

Papers should be at most 5 pages using the two-column IEEE conference publication format two-column IEEE conference publication format and need to be submitted online via EasyChair. The accepted papers will be published in the ICST 2012 Proceedings. The submitted papers can be research papers, position papers, case studies or experience reports to address the issues including but not limited to the following:

  • Leveraging the extensive software testing literature to solve load testing challenges;
  • Development of realistic load tests;
  • Optimal planning of load tests to reduce the number of needed resources to conduct large scale load tests;
  • Optimized execution of load tests to reduce the number and duration of tests;
  • Efficient analysis of the load test results (e.g., large volume of execution logs and performance counters);
  • Load testing on adaptive/autonomic systems;
  • Leveraging cloud computing to conduct load testing;
  • Case studies and experience reports on load testing large scale applications;