xarray-sql/benchmarks/ml/01_attention.py at 6debe2495dcb4e8fac20ab97df5b89baae2a31a6 · xqlsystems/xarray-sql

In this demo, we automatically deduce a FlashAttention kernel with ~25 lines of SQL, which just expresses vanilla attention. This is possible due to three portable SQL extensions that we’re building: - xarray-sql: a library that efficiently represents petabyte scale array datasets in the cloud as…