langwatch/langwatch
Support
Dashboard
langwatch/langwatch

API Endpoints

PII Detection

Documentation

LangEvals

Open Dashboard

GitHub Repo

Documentation

Introduction
Evaluators
Unit Tests
API Example
How to Choose Your Evaluator Guide
Modular Architecture

Tutorials

Extensive Unit Testing
RAG Evaluation
Evaluate on CI/CD Pipeline

API Endpoints

POST
Language Detection
POST
OpenAI Moderation
POST
PII Detection
POST
Content Safety
POST
Jailbreak Detection
POST
Prompt Injection Detection
POST
Competitor Detection with LLM
POST
Prompt Injection Detection
POST
Off-Topic Detection
POST
Answer Relevancy
POST
Context Precision
POST
Context Recall
POST
Context Relevancy
POST
Context Utilization
POST
Faithfulness
POST
Haystack Faithfulness
POST
LLM Boolean Evaluator
POST
LLM Score Evaluator
POST
LLM Basic Evaluator
POST
LLM Similarity Evaluator
POST
Llama Guard

API Endpoints

PII Detection

Google DLP PII detects personally identifiable information in text, including phone numbers, email addresses, and social security numbers. It allows customization of the detection threshold and the specific types of PII to check.

Env vars: GOOGLE_APPLICATION_CREDENTIALS

Docs: https://cloud.google.com/sensitive-data-protection/docs/apis

POST

google_cloud

dlp_pii_detection

evaluate

object

data

array

data

Required

array

List of entries to be evaluated, check the field type for the necessary keys

settings

object

settings

object

Evaluator settings, check the field type for what settings this evaluator supports

info_types

object

info_types

object

The types of PII to check for in the input.

phone_number

boolean

phone_number

boolean

email_address

boolean

email_address

boolean

credit_card_number

boolean

credit_card_number

boolean

iban_code

boolean

iban_code

boolean

ip_address

boolean

ip_address

boolean

passport

boolean

passport

boolean

vat_number

boolean

vat_number

boolean

medical_record_number

boolean

medical_record_number

boolean

min_likelihood

enum<string>

min_likelihood

enum<string>

The minimum confidence required for failing the evaluation on a PII match.

env

object

env

object

Optional environment variables to override the server ones

Add Example Value

Body

application/json

data

object[]

required

List of entries to be evaluated, check the field type for the necessary keys

data.input

string | null

data.output

string | null

settings

object | null

Evaluator settings, check the field type for what settings this evaluator supports

settings.info_types

object

The types of PII to check for in the input.

settings.info_types.phone_number

boolean

default: true

settings.info_types.email_address

boolean

default: true

settings.info_types.credit_card_number

boolean

default: true

settings.info_types.iban_code

boolean

default: true

settings.info_types.ip_address

boolean

default: true

settings.info_types.passport

boolean

default: true

settings.info_types.vat_number

boolean

default: true

settings.info_types.medical_record_number

boolean

default: true

settings.min_likelihood

enum<string>

default: POSSIBLE

The minimum confidence required for failing the evaluation on a PII match.

Available options:

VERY_UNLIKELY,

UNLIKELY,

POSSIBLE,

LIKELY,

VERY_LIKELY

env

object | null

Optional environment variables to override the server ones

env.{key}

string

Response

200 - application/json

status

enum<string>

default: processed

Available options:

processed

score

number

required

Amount of PII detected, 0 means no PII detected

passed

boolean | null

required

If true then no PII was detected, if false then at least one PII was detected

details

string | null

Short human-readable description of the result

cost

object | null

cost.currency

string

required

cost.amount

number

required

raw_response

object

required

OpenAI Moderation Content Safety

github linkedin