About SPOT Suite for ALS Data and Simulations

Stats:


N.B. This site is very much a work in progress. Please report any problems with the page to spot-help .at. lists.lbl.gov

The SPOT Suite project is funded under an LBNL LDRD to research and develop a suite of tools to provide ALS scientists access to best-of-breed data management, data analysis, and simulation tools. When complete, the portal will allow ALS scientists to manage and share their experimental and simulation data, analyze experimental data, and view real time results during their ALS beamtimes.

Recent improvements in detector resolution and speed and in source luminosity are yielding unprecedented data rates at BES's national light source and neutron source facilities. Data rates that exceed the capabilities of data analysis approaches and computing resources utilized in the past, and will continue to outpace Moore's law scaling for the foreseeable future. The consensus within light source scientific communities is that scientific insight and discovery at BES facilities are now being limited by computational and computing capabilities much more than by detector or accelerator technology.

Problems addressed by modern day light sources are very diverse. The science questions range from biology, material science, physics to earth science and archeology. While the science challenges are diverse the techniques are connected by common data themes (Real Space, Reciprocal Space, and Spectroscopy). Domain scientists today are routinely able to generate 10,000's to 100,000's of images in a few days of running. Using current analysis techniques, software, and resources only a small percentage of usable data are analyzed.

Real-time feedback during beamtime is a capability critically needed by many light source users. LBNL provides a unique confluence of the required capabilities and expertise to address the BES data management and analysis crisis. This project brings together the expertise, experience, and facilities needed to address the light source data deluge. Computer scientists from CRD bring experience in data intensive science technologies and techniques. Photon scientists from four (4) ALS beamlines represent each of the three light source data themes and high data rate detectors. And materials science theorists from Material Sciences Division, the Molecular Foundry, and NERSC provide state-of-the-art simulations. The collocation of these experts with three national facilities, ALS, NERSC, and ESNet provides the ideal environment and skillset for developing a solution that will scale to the next generation of light sources.