lake-orm

lake-orm and the datalake-go projects.

a lakehouse is just parts, and i wrote the parts in go. lake-orm is a typed orm over spark connect for databricks, delta lake and apache iceberg tables: Query[T] with projection pushdown, typed dataframe scans, streaming rows, inserts through a staging writer, migrations as struct diffs in goose format. around it i maintain the fork of spark’s go client with streaming, typed dataframes and gRPC transport options; lake-goose, goose-compatible migrations for delta and iceberg over spark sql; and lake-k8s, a helm chart and a pre-baked spark connect image. the roadmaps are public on each tracker.