Response Caching

TruthVouch automatically caches verification results to avoid redundant LLM calls. When a query has been processed before, the cached result is returned instantly instead of making another LLM request.

How It Works

When the same query is submitted again, TruthVouch returns the cached response in under 1ms. Cache entries expire based on configurable time windows (default: 1 hour for LLM responses, 24 hours for embeddings).

When no cached result exists, the query is sent to the LLM provider. The response is then stored in the cache for future lookups.

Cache Invalidation

When truth nuggets are updated, affected cached results are cleared automatically. The next query re-verifies against the updated truth.

Monitoring

Platform administrators can view cache performance metrics including hit rate, memory usage, and operations per second through the admin dashboard.

Next Steps

• Truth Nuggets: Create the knowledge base used for verification
• Embeddings: Understand semantic matching