Data Infrastructure

Data infrastructure is the layer that moves data between storage and computation, and its quality is measured in what it makes possible rather than in what it does. Query engines, columnar formats and object-store clients decide whether a dataset is workable or merely present. Writing here covers contributions to distributed data engines, where the interesting constraints are build size, dependency weight and the cost of a scan.