Distributed Systems • Cloud Native • Research

Tracking the systems behind modern compute.

A focused digest of distributed computing, cloud-native infrastructure, and engineering research from authoritative sources.

Curated from primary sources · refreshed hourly

Latest briefings

Follow the feed ↗
arXiv Distributed Computing

Scaling Inference Prefill with High-Radix Photonic Interconnects

arXiv:2609.01821v1 Announce Type: new Abstract: With the rise of inference as today's dominant AI workload, the industry is transitioning to high-bandwidth photonic interconnects to meet the large scale-up requirements of increasingly complex Mixture-of-Experts (MoE) models. This paper quantifies the benefits of 3D-in…

Read at source
arXiv Distributed Computing

CREDIT: Cost-guided Reduction-reuse with Efficient DSMEM Inter-CTA Tiling

arXiv:2609.01864v1 Announce Type: new Abstract: NVIDIA distributed shared memory (DSMEM) enables direct shared-memory access within a thread block cluster. However, cluster synchronization, remote access, and resource costs make it difficult to determine when DSMEM improves performance. To fill this gap, we propose CR…

Read at source
arXiv Distributed Computing

Federated Learning on the American Science Cloud using APPFL

arXiv:2609.02238v1 Announce Type: new Abstract: The American Science Cloud (AmSC), established under the Genesis Mission of the U.S. Department of Energy (DOE), aims to integrate DOE high-performance computing systems, experimental facilities, and data resources into a single, coordinated, AI-driven discovery platform…

Read at source
arXiv Distributed Computing

When Does Authorization End? Effect Closure at Provider Boundaries

arXiv:2609.02866v1 Announce Type: cross Abstract: Revocation completion, clean state, or operation success can leave authorized work able to cause an effect the application rejects while the provider stays within its contract. We call the absence of all such paths policy-relative effect closure, or effect closure for…

Read at source
arXiv Distributed Computing

GRADSOLVE: fast exact gradients for ODE ensembles on GPUs

arXiv:2609.02876v1 Announce Type: cross Abstract: Ordinary differential equations (ODEs) underlie models in science and engineering, and many applications need derivatives of their solutions with respect to parameters. Ensembles of independent trajectories suit graphics processing units (GPUs), but current GPU softwar…

Read at source
arXiv Distributed Computing

OctoPipe: Reducing Pipeline Bubbles for Heterogeneous Models via Co-Optimizing Partitioning, Placement, and Scheduling

arXiv:2509.23722v3 Announce Type: replace Abstract: Pipeline parallelism is widely used to train large language models (LLMs). However, increasing heterogeneity in model architectures exacerbates pipeline bubbles, thereby reducing training efficiency. Prior approaches typically optimize a single phase of the pipeline…

Read at source
arXiv Distributed Computing

rush: Scalable Asynchronous Distributed Computing via Shared State in R

arXiv:2606.21430v3 Announce Type: replace Abstract: Many algorithms in statistics and machine learning can be parallelized in an asynchronous manner where workers need to communicate through shared state rather than execute independent tasks dispatched by a central controller. Especially in modern hyperparameter optim…

Read at source