Data Carousel

Common software: yes

Data Carousel in NPPS

Participants
    Johannes Elmsheuser     WLCG DOMA co-coordinator, USATLAS L2 Manager WBS 2.4 Computing R&D
    Alexei Klimentov     Leadership team member     SDCC Director (Interim)
    Tadashi Maeno     PanDA Project Leader, Harvester Project Leader, iDDS Project Leader
    Cedric Serfon     Leadership team member     Belle II Deputy Computing Coordinator

Experiments and projects
    ATLAS at the LHC (CERN)
    Google-ATLAS HL-LHC R&D Project

Technical teams  
    Distributed data management    
    Workflow and workload management    

Related materials
    The ATLAS Data Carousel Project,   HEPiX Fall 2019,   Nov 2019

Description

The data carousel R&D project is an ATLAS initiative originating at BNL to develop a disk-efficient means of processing data residing in cold storage (tape). Workload and data management systems together with the site’s storage services orchestrate the staging and processing of a dynamic sliding window of disk-resident data, such that the disk footprint of the production campaign’s input data is just a fraction of its full size.

References