Walt is new to Chicago, but is a Midwestern native who spent the last 9 years in Brooklyn, NY working for a nonprofit that helps organizations with their resource development.  He’ll be helping the OCC expand its internal and external infrastructure while the OCC helps researchers with all of their important big data.

The integrated services include: hosting large public scientific datasets; standard installations of the open source OpenStack and Eucalyptus systems, which provide instant on demand computing infrastructure; standard installations of the open source Hadoop system, which is the most popular platform for processing big data; standard installations of UDT, which is a protocol for transporting large datasets; authentication with Shibboleth, a SSO authentication service developed by Internet2; and a variety of domain specific applications.

The beta version of Tukey is being used by several of the OCC Open Science Data Cloud research projects, including: the Matsu Project, which hosts over two years of data from NASA’s EO-1 satellite; Bionimbus, which is a system for managing, analyzing, and sharing large genomic datasets; and bookworm, which is an applications that extracts patterns from large collections of books.

Learn more at: http://www.whitehouse.gov/blog/2012/03/29/big-data-big-deal

• The Open Science Data Cloud (OSDC) currently consists of six racks containing 159 nodes, 1248 cores and 1.2 PB of usable storage. This is divided into a utility cloud called OSDC-Adler that is based upon Eucalyptus and a utility cloud called OSDC-Sullivan that is based upon OpenStack. This equipment was provided by a grant from the Gordon and Betty Moore Foundation (GBMF). The OSDC is being rolled out over three years and this is the Phase 1a infrastructure. The Phase 1b infrastructure will be added in 2012 and will be approximately the same size.
• The OCC-Y Cluster consists of 4 racks, 928 cores and 1 PB of storage and is a data cloud based upon the Hadoop.
• The OCC Open Cloud Testbed has approximately 1 rack of equipment at three different locations (Chicago, Livermore and Miami) that can be used for experimental studies and testing of cloud computing software and services.

If you have a project that would like to use the OSDC-Adler, OSDC-Sullivan or OCC-Y facilities, please write us at info at opencloudconsortium dot org.

We also recently completed a health and status monitoring and accounting system. We can now monitor the health and status of the OSDC and we will be making this information available on a status page. We can now also more easily track per user usage.

This data will be accessible to the public and will also be easily available to those computing with the OSDC.

If you would like to donate some additional disk so that we can make more data publicly available or help us with the administration of the OSDC, please contact us at info at opencloudconsortium dot org.