About SPOT Suite for ALS Data and Simulations
N.B. This site is very much a work in progress. Please report any
problems with the page to spot-help .at. lists.lbl.gov
The SPOT Suite project is funded under an LBNL LDRD to research and
develop a suite of tools to provide ALS scientists access to
best-of-breed data management, data analysis, and simulation tools.
When complete, the portal will allow ALS scientists to manage and share
their experimental and simulation data, analyze experimental data, and
view real time results during their ALS beamtimes.
Recent improvements in detector resolution and speed and in source
luminosity are yielding unprecedented data rates at BES's national light
source and neutron source facilities. Data rates that exceed the
capabilities of data analysis approaches and computing resources
utilized in the past, and will continue to outpace Moore's law scaling
for the foreseeable future. The consensus within light source
scientific communities is that scientific insight and discovery at BES
facilities are now being limited by computational and computing
capabilities much more than by detector or accelerator technology.
Problems addressed by modern day light sources are very diverse. The
science questions range from biology, material science, physics to
earth science and archeology. While the science challenges are diverse
the techniques are connected by common data themes (Real Space,
Reciprocal Space, and Spectroscopy). Domain scientists today are
routinely able to generate 10,000's to 100,000's of images in a few
days of running. Using current analysis techniques, software, and
resources only a small percentage of usable data are analyzed.
Real-time feedback during beamtime is a capability critically needed by
many light source users. LBNL provides a unique confluence of the
required capabilities and expertise to address the BES data management
and analysis crisis. This project brings together the expertise,
experience, and facilities needed to address the light source data
deluge. Computer scientists from CRD bring experience in data intensive
science technologies and techniques. Photon scientists from four (4)
ALS beamlines represent each of the three light source data themes and
high data rate detectors. And materials science theorists from Material
Sciences Division, the Molecular Foundry, and
NERSC provide state-of-the-art simulations. The collocation of these
experts with three national facilities, ALS, NERSC, and ESNet provides
the ideal environment and skillset for developing a solution that will
scale to the next generation of light sources.