AI for Data Engineers

Embedding pipeline at lakehouse scale

Vector ops at scale: index choice + tuning

Hybrid retrieval (BM25 + dense + RRF)

Eval automation in CI

Drift detection on embeddings

Backfills + re-embedding strategies

Chunking + embedding co-design