Pavilion HyperOS with HyperParallel Flash Array Enables Analytics Offloads
SAN JOSE, Calif., May 25, 2022 /PRNewswire/ — Pavilion™ Data Systems, a leading data analytics acceleration platform provider and a pioneer of NVMe-Over-Fabrics (NVMe-oF), today announced a partnership with Los Alamos National Laboratories (LANL) to co-develop and evaluate acceleration of analytics by offloading analytics functions from storage servers to the storage array, minimizing data movement by enabling data reduction near the storage.
LANL is moving their I/O from file based to record or column based, which enables analytics to be done using tools from the big data/analytics community. LANL has shown 1000X speedups on analytics functions by leveraging data reduction near the storage devices via their DeltaFS technology. Shaping standards and commercialization of storage capabilities to assist in leveraging analytics near the storage is at the heart of the Pavilion/LANL partnership.
“For decades, our large-scale physics simulations used file-based I/O, as these simulations were tuned for disk-based parallel file systems,” stated Gary Grider, High-Performance Computing Division Leader at LANL. “The file-based I/O had hidden the inherent structure in the data in those files. Switching to record/column-based I/O exposes the structure in the data, thereby enabling analytics. Leveraging technology from the big data/analytics community is a natural method to accomplish this, and partnering with industry to explore this at extreme scale is the basis for this partnership with Pavilion.”
“We are very excited about partnering with LANL on this high-performance innovation, as together we explore the use of HyperOS™ functionality to enable offloaded analytics from extreme-scale scientific applications,” stated Dario Zamarian, Pavilion CEO.
The data processing algorithms of Pavilion HyperOS coupled with the performance density of the Pavilion HyperParallel™ Flash Array provides a highly performant computational storage array capability enabling analytics offloads at scale.
About Los Alamos National Laboratory
Los Alamos National Laboratory, a multidisciplinary research institution engaged in strategic science on behalf of national security, is managed by Triad, a public service-oriented, national security science organization equally owned by its three founding members: Battelle Memorial Institute (Battelle), the Texas A&M University System (TAMUS), and the Regents of the University of California (UC) for the Department of Energy’s National Nuclear Security Administration.
Los Alamos enhances national security by ensuring the safety and reliability of the U.S. nuclear stockpile, developing technologies to reduce threats from weapons of mass destruction, and solving problems related to energy, environment, infrastructure, health, and global security concerns.
About Pavilion Data Systems
Pavilion provides the data analytics acceleration platform that enables organizations to derive greater value from their data—faster, simpler, and at scale. We are the perfect complement for AI/ML, HPC, analytics, edge, and other data-driven workloads and the ideal data I/O platform for GPU-based computing platforms. The Pavilion HyperParallel Data Platform, powered by Pavilion HyperOS, delivers unmatched performance and density, ultra-low latency, and unlimited scalability and flexibility, providing customers unprecedented choice and control. Learn why Fortune 500 companies and federal government agencies choose Pavilion. Visit www.pavilion.io, and follow Pavilion on LinkedIn, Twitter, and Facebook.
PAVILION CONTACT:
[email protected]
SOURCE Pavilion
