CTWatch
Volume 2 Number 4A
November 2006 A
High Productivity Computing Systems and the Path Towards Usable Petascale Computing
Printable Format
Experiments to Understand HPC Time to Development
Lorin Hochstein, University of Nebraska
Taiga Nakamura, University of Maryland, College Park
Victor R. Basili, University of Maryland, College Park; Fraunhofer Center, Maryland
Sima Asgari, University of Maryland, College Park
Marvin V. Zelkowitz, University of Maryland, College Park; Fraunhofer Center, Maryland
Jeffrey K. Hollingsworth, University of Maryland, College Park
Forrest Shull, Fraunhofer Center, Maryland
Jeffrey Carver, Mississippi State University
Martin Voelp, University of Maryland, College Park
Nico Zazworka, University of Maryland, College Park
Philip Johnson, University of Hawaii

6
5. Conclusions

Over the past three years we have been developing a methodology for running HPC experiments in a classroom setting and obtaining results we believe are applicable to HPC programming in general. We are starting to look at larger developments and at large university and government HPC projects in order to increase the confidence on the early results we have obtained with students.

Our development of the Experiment Manager system allows us to more easily expand our capabilities in this area. This allows many others to run such experiments on their own in a way that allows for the appropriate controls of the experiment so that results across classes and organization at geographically diverse locations can be compared in order to get a thorough understanding of the HPC development model.

Acknowledgement This research was supported in part by Department of Energy contract DE-FG02-04ER25633 and Air Force grant FA8750-05-1-0100 to the University of Maryland.
References
1 Johnson, P. M., Kou, H., Agustin, J. M., Zhang, Q., Kagawa, A., Yamashita, T. “Practical automated process and product metric collection and analysis in a classroom setting: Lessons learned from Hackystat-UH,” Proceedings of the 2004 International Symposium on Empirical Software Engineering, Los Angeles, California, August, 2004.
2 Hochstein, L., Basili, V., Zelkowitz, M., Hollingsworth, J., Carver, J. “Combining self-reported and automatic data to improve effort measurement,” Joint 10th European Software Engineering Conference and 13th ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2005), Lisbon, Portugal, September 2005, 356-365.
3 Asgari, S., Hochstein, L., Basili, V., Zelkowitz, M., Hollingsworth, J., Carver, J., Shull, F. “Generating Testable Hypotheses from Tacit Knowledge for High Productivity Computing,” 2nd International Workshop on Software Engineering for High Performance Computing System Applications, (May, 2005) St. Louis, MO, 17-21.
4 Post, D., Kendall, R.P., Whitney, E. “Case study of the Falcon Project,” Second International Workshop on Software Engineering for High Performance Computing Systems Applications,. St. Louis, MO, 2005.
5 Nakamura, T., Hochstein, L., Basili, V. R. “Identifying Domain-Specific Defect Classes: Using Inspections and Change History,” International Symposium on Empirical Software Engineering, (ISESE), Rio de Janeiro, September, 2006.
6 The International Journal of High Performance Computing Applications, (18)4, Winter 2004.
7 Zelkowitz, M., Basili, V., Asgari, S., Hochstein, L., Hollingsworth, J., Nakamura, T. “Measuring productivity on high performance computers,” IEEE Symp. on Software Metrics, Como, Italy, (September 2005).
8 Gardner, M. “Mathematical games,” Scientific American, October, 1970.
9 Vishkin, U., Dascal, S., Berkovich, E., Nuzman, J. “Explicit Multi-Threading (XMT) Bridging Models for Instruction Parallelism,” 10th ACM Symposium on Parallel Algorithms and Architectures (SPAA), 1998.
10 Hochstein, L., Basili, V. R. “An Empirical Study to Compare Two Parallel Programming Models,” 18th ACM Symposium on Parallelism in Algorithms and Architectures (SPAA '06). July 2006, Cambridge, MA.
11 Hochstein, L., Carver, J., Shull, F., Asgari, S., Basili, V., Hollingsworth, J. K., Zelkowitz, M. “HPC Programmer Productivity: A Case Study of Novice HPC Programmers,” Supercomputing 2005, Seattle, WA, November 2005.

Pages: 1 2 3 4 5 6

Reference this article
Hochstein, L., Nakamura, T., Basili, V. R., Asgari, S., Zelkowitz, M. V., Hollingsworth, J. K., Shull, F., Carver, J., Voelp, M., Zazworka, N., Johnson, P. "Experiments to Understand HPC Time to Development ," CTWatch Quarterly, Volume 2, Number 4A, November 2006 A. http://www.ctwatch.org/quarterly/articles/2006/11/experiments-to-understand-hpc-time-to-development/

Any opinions expressed on this site belong to their respective authors and are not necessarily shared by the sponsoring institutions or the National Science Foundation (NSF).

Any trademarks or trade names, registered or otherwise, that appear on this site are the property of their respective owners and, unless noted, do not represent endorsement by the editors, publishers, sponsoring institutions, the National Science Foundation, or any other member of the CTWatch team.

No guarantee is granted by CTWatch that information appearing in articles published by the Quarterly or appearing in the Blog is complete or accurate. Information on this site is not intended for commercial purposes.