Generative Databases

Warning

This post is more than a year old. Information may be outdated.

In the world of Generative AIs, can we think Database as Gen AI models instead of key-value storages?

Different trade-offs already give rise to significantly different types of databases - from OLTP to OLAP, relational to non-relational, key-value, graph, document, and object database (to name a few
If you squint, LLMs resemble something like a vector search database. Items are stored as embeddings, and queries return deterministic yet fuzzy results. What you lose in data loading time (i.e., model training), you make up for in compression (model size) and query time (inference). In the best case, models denoise and clean data automatically. The schema is learned rather than declared
Authorization is done through public-key infrastructure, and a generalized computing model can be built on top of the distributed ledger (e.g., the EVM
SQLite/DuckDB answer this question. While neither can support concurrent writes from different processes and are limited in other terms of horizontal scaling, they can be easier to use and can fit in more workflows (e.g., serverless, edge, browser). In many cases, they are operationally much easier to manage than a traditional database.