Distributed Systems • Cloud Native • Research

Tracking the systems behind modern compute.

A focused digest of distributed computing, cloud-native infrastructure, and engineering research from authoritative sources.

Curated from primary sources · refreshed hourly

Latest briefings

Follow the feed ↗
arXiv Distributed Computing

Dynamic HBM Repartitioning for Multi-Turn MoE Serving

arXiv:2609.13537v1 Announce Type: new Abstract: Long-running multi-turn requests accumulate reusable key-value (KV) state. Once this state exceeds a fixed GPU KV-cache allocation, serving systems evict reusable prefixes, repeat prefill work, and may preempt requests. This pressure is particularly acute for Mixture-of…

Read at source
arXiv Distributed Computing

PEAT: Pseudo-Error Assessment for GPU Kernel Validation in DNN Training

arXiv:2609.13544v1 Announce Type: new Abstract: Deep neural networks (DNNs) are widely adopted in various fields, driving an emerging trend in developing software stacks associated with DNN training systems. For example, many codes have been ported across different frameworks or developed to leverage the computing pow…

Read at source
arXiv Distributed Computing

The Essence of Git: Concepts for P2P Replication

arXiv:2609.13555v1 Announce Type: new Abstract: Git is most commonly known as a decentralized version control system. Underneath the surface, the design of Git exhibits an elegant object model and incremental replication protocols that have been used to build a variety of applications that go much beyond version contr…

Read at source
arXiv Distributed Computing

Object Model Analysis of a Supercomputer with Digital Twin

arXiv:2609.13571v1 Announce Type: new Abstract: Operators and developers need a mental model of both the structure and the live behavior of a large supercomputer, but its physical layout, logical organization, and streams of per-node telemetry are difficult to relate to one another, making it hard to trace a metric or…

Read at source
arXiv Distributed Computing

mKernel: Fast Multi-GPU, Multi-Node Fused Kernels

arXiv:2609.13585v1 Announce Type: new Abstract: Communication has become a bottleneck in distributed training and inference of large models. Overlapping communication with computation at the granularity of kernels, on separate streams, reduces only part of this communication cost. Fused kernels often have better perfo…

Read at source
arXiv Distributed Computing

Real-World Deployment and Performance Characterisation of Fog-Based Deep Learning for Cold-Chain Temperature Prediction over LoRaWAN

arXiv:2609.14036v1 Announce Type: new Abstract: Fresh fruits and vegetables (FFVs) are highly perishable, and cold-chain breaks contribute significantly to global food waste. While Machine Learning (ML) can enable proactive intervention, cloud-based inference faces challenges such as latency and data loss. Fog computi…

Read at source
arXiv Distributed Computing

OpWeave: Flexible Operator Disaggregation for Heterogeneous LLM Serving

arXiv:2609.14237v1 Announce Type: new Abstract: LLM serving systems increasingly disaggregate inference into finer-grained stages, with recent approaches separating attention from FFN or MoE execution during decode. This operator-level disaggregated serving (ODS) can improve hardware matching and enable independent sc…

Read at source
arXiv Distributed Computing

Flattening Every Memory Peak in Long-Context Mixture-of-Experts Training

arXiv:2609.14306v1 Announce Type: new Abstract: Training a Mixture-of-Experts (MoE) model at long context or large batch size fails as soon as any one component's peak allocation exceeds device memory, so the target is every peak at once, not the average footprint. Four are left unbounded by the parallelism plans in c…

Read at source
arXiv Distributed Computing

PaxosLease Revisited: A Checked Model of Diskless Distributed Leases

arXiv:2609.14640v1 Announce Type: new Abstract: PaxosLease is a protocol by which a quorum of acceptors grants time-bounded exclusive ownership with no durable acceptor lease state and no disk write on the lease acquisition path. This paper gives a precise, machine-checked statement of the protocol and of its standard…

Read at source