What the product already does, today.
Metadata, not message content
The gateway stores metadata: model, tokens, latency, cost, status and a keyed fingerprint of each prompt, not the prompt or the answer. A failed request also keeps the provider's error message, which can quote part of the request. One deliberate exception: free-text tests run from the dashboard keep a small sample of questions and answers so you can grade the judge blind. Run tests with the model-test kit to keep all text on your side.
Evaluation inside your environment
Our evaluation runner is a single file you run on your own systems with your own API keys. It returns right/wrong per example, never text, and Cermelo refuses any results file that contains more.
Uploaded logs are not kept
Log files you upload for cost analysis are analyzed in memory. Only the resulting report is saved.
EU data region
Our database is hosted in the EU (Ireland).
No training on your data
Cermelo does not train or fine-tune AI models, on your data or anyone else's.
Closed access by default
Every dashboard request requires a login. Access is by invitation, you choose your own password from the invitation e-mail, and database tables are closed to direct public access.
Customers kept apart twice
Each customer's data is separated by the application and, independently, by the database itself: every request runs as a restricted database role that can only see and change your organization's rows.
Encrypted connections
Connections to model providers and to our database are encrypted, and stored data is encrypted at rest by our database provider.