ESG has made significant progress towards the definition of the federated metadata, security, and data services required to enable distributed access to, and analysis of, large quantities of climate simulation data. The current production-level ESG system primarily addresses the tasks of publishing and cataloging terabytes of climate model data for a diverse set of registered users. We are now working to take ESG-CET to the next level of distributed environments with an even greater emphasis on federation and server-side capabilities. ESG-CET will build upon the current ESG system and target flexibility, efficiency, and more universal access while expanding to serve much larger archives (petabytes), as required for CMIP4 (IPCC AR5), CCSM, and CCES. To this end, ESG-CET is working with disparate technologies and partnering with national and international leaders in the computer and climate communities to build a robust data and analysis distributed infrastructure in support of advancing climate change research.
This work is supported through the U.S. Department of Energy Office of Science, Offices of Advanced Scientific Computing Research and Biological and Environmental Research, through the SciDAC program. Argonne National Laboratory is managed by Argonne Chicago LLC under Contract DE-AC02-06CH11357. Information Sciences Institute is a research institute of the Viterbi School of Engineering at the University of Southern California. Lawrence Berkeley National Laboratory is managed by the University of California for the U.S. Department of Energy under contract No. DE-AC02-05CH11231. Lawrence Livermore National Laboratory is managed by the University of California for the U.S. Department of Energy under contract No. W-7405-Eng-48. Los Alamos National Security is managed by LLC (LANS) for the U.S. Department of Energy under the contract No. DE-AC52-06NA25396. National Center for Atmospheric Research is managed by the University Corporation for Atmospheric Research under the sponsorship of the U.S. National Science Foundation. Oak Ridge National Laboratory is managed by UT-Battelle, LLC for the U.S. Dept. of Energy under contract DE-AC-05-00OR22725. Pacific Marine Environmental Laboratory is under the National Oceanic and Atmospheric Administration's line office of Ocean and Atmosphere Research, which lies within the U.S. Department of Commerce.
2 Scientific Discovery through Advanced Computing (SciDAC) - www.scidac.gov/, 2007.
3 Office of Advanced Scientific Computing Research (OASCR) - www.science.doe.gov/ascr/, 2007.
4 Offices of Biological and Environmental Research (OBER) - www.science.doe.gov/ober/, 2007.
5 Bernholdt, D., Bharathi, S., Brown, D., Chanchio, K., Chen, M., Chervenak, A., Cinquini, L., Drach, B., Foster, I., Fox, P., Garcia, J., Kesselman, C., Markel, R., Middleton, D., Nefedova, V., Pouchard, L., Shoshani, A., Sim, A., Strand, G. and Williams, D. "The Earth System Grid: Supporting the Next Generation of Climate Modeling Research," Proceedings of the IEEE, 93 (3). 485-495. 2005.
6 Foster, I., Alpert, E., Chervenak, A., Drach, B., Kesselman, C., Nefedova, V., Middleton, D., Shoshani, A., Sims, A. and Williams, D., "The Earth System Grid: Turning Climate Datasets Into Community Resources," in 82nd Annual American Meteorological Society Meeting, (Orlando, FL., 2002).
7 Eaton, B., Gregory, J., Drach, B., Taylor, K. and Hankin, S. "NetCDF Climate and Forecast Metadata Conventions," cf-pcmdi.llnl.gov, 2007.
8 Welch, V., Siebenlist, F., Foster, I., Bresnahan, J., Czajkowski, K., Gawor, J., Kesselman, C., Meder, S., Pearlman, L. and Tuecke, S., "Security for Grid Services," 12th IEEE International Symposium on High Performance Distributed Computing. 2003.
9Fox, P., Garcia, J. and West, P. "OPeNDAP for the Earth System Grid," Data Science Journal. 2007.
10 Allcock, B., Bresnahan, J., Kettimuthu, R., Link, M., Dumitrescu, C., Raicu, I. and Foster, I., "The Globus Striped GridFTP Framework and Server," Supercomputing 2005 (SC ’05) conference proceedings. 2005.
11 Intergovernmental Panel on Climate Change (IPCC) 4th Assessment Report - www.ipcc.ch/activity/ar.htm, 2007.
12 CCSM Carbon LAnd Model intercomparison Project (C-LAMP) - www.climatemodeling.org/c-lamp/, 2007.
13 World Climate Research Program (WCRP) CMIP3 (IPCC AR4) Subproject Publications - www-pcmdi.llnl.gov/ipcc/subproject_publications.php, 2007.
14 The Parallel Climate Model - www.cgd.ucar.edu/pcm/, 2007.
15 The Parallel Ocean Program (POP) ocean circulation model - climate.lanl.gov/Models/POP/, 2007.
