Skip to main content

traceloop home page

Community
Support
Start now
Start now

Documentation
OpenLLMetry
Hub
Dashboard API
Community
GitHub

API Reference

Introduction

Tracing

POST
Enable logging of prompts and responses
GET
Get identifiers of users that are allowed to be logged
DEL
Disable logging of prompts and responses for specific users

GDPR & Privacy

DEL
Delete specific user data
GET
Status of user deletion request

Costs

GET
Get costs by property

Warehouse

GET
Get Spans

Organizations

POST
Create a new organization

Evaluators

POST
Create a custom LLM-as-a-judge evaluator
POST
Execute agent-efficiency evaluator
POST
Execute agent-flow-quality evaluator
POST
Execute agent-goal-accuracy evaluator
POST
Execute agent-goal-completeness evaluator
POST
Execute agent-tool-error-detector evaluator
POST
Execute agent-tool-trajectory evaluator
POST
Execute answer-completeness evaluator
POST
Execute answer-correctness evaluator
POST
Execute answer-relevancy evaluator
POST
Execute char-count evaluator
POST
Execute char-count-ratio evaluator
POST
Execute context-relevance evaluator
POST
Execute conversation-quality evaluator
POST
Execute faithfulness evaluator
POST
Execute html-comparison evaluator
POST
Execute instruction-adherence evaluator
POST
Execute intent-change evaluator
POST
Execute json-validator evaluator
POST
Execute perplexity evaluator
POST
Execute pii-detector evaluator
POST
Execute placeholder-regex evaluator
POST
Execute profanity-detector evaluator
POST
Execute prompt-injection evaluator
POST
Execute prompt-perplexity evaluator
POST
Execute regex-validator evaluator
POST
Execute secrets-detector evaluator
POST
Execute semantic-similarity evaluator
POST
Execute sexism-detector evaluator
POST
Execute sql-validator evaluator
POST
Execute tone-detection evaluator
POST
Execute topic-adherence evaluator
POST
Execute toxicity-detector evaluator
POST
Execute uncertainty-detector evaluator
POST
Execute word-count evaluator
POST
Execute word-count-ratio evaluator

Metrics

GET
Get metrics high water mark
POST
Get metrics with filtering and grouping

Auto-monitor-setups

POST
Create an Auto Monitor Setup
DEL
Delete an auto monitor setup by external ID
GET
Get an auto monitor setup by external ID
GET
List auto monitor setups
PUT
Update an auto monitor setup by external ID

Create custom evaluator

Was this page helpful?

⌘I

Powered byThis documentation is built and hosted on Mintlify, a developer documentation platform

Assistant

Responses are generated using AI and may contain mistakes.