Enterprise Retrieval Platform
OpenSearch serving · object storage durability · PostgreSQL control plane · Snowflake analytics
Enterprise retrieval architecture based on OpenSearch, PostgreSQL, S3 and Snowflake
Clients query a Search API. The API reads namespace and ACL state from PostgreSQL and executes retrieval against OpenSearch. Source connectors feed ingestion workers, which write original and normalized data to object storage, update PostgreSQL, and publish searchable projections to OpenSearch. Snowflake consumes the durable data for governance and analytics.
Enterprise Retrieval Platform
OPEN SEARCH SERVING · OBJECT STORAGE DURABILITY · POSTGRES CONTROL PLANE · SNOWFLAKE ANALYTICS
ONLINE RETRIEVAL
INGESTION & DATA FOUNDATION
CLIENT
Clients / Agents
UI · SDK · MCP
API
Search API
Auth · Routing · Fusion
SERVE
OpenSearch
BM25 · ANN · Hybrid
CONTROL
PostgreSQL
Namespace · ACL · Outbox
SOURCES
Connectors
Feeds · Files · APIs
PIPELINE
Ingestion Workers
Parse · Embed · Version
Outbox · Retry · Replay
DURABLE
Object Storage
S3 / R2 · Originals
Snapshots · Manifests
ANALYTICS
Snowflake
Governance · Coverage
Historical analysis · Evals
query
BM25 / ANN
ACL / namespace
ingest
canonical data
analytics feed
write state
index projection
S3 is the durable document source; OpenSearch is a rebuildable retrieval projection.
REFERENCE ARCHITECTURE · NOT A TURBOPUFFER CLONE