View module source on GitHub

MaximLiteLLMProxyTracer

class MaximLiteLLMProxyTracer(CustomLogger)

Custom logger for Litellm Proxy.

log_pre_api_call

def log_pre_api_call(model, messages, kwargs)

Runs when a LLM call starts.

log_success_event

def log_success_event(kwargs, response_obj, start_time, end_time)

Runs when a LLM call succeeds.

log_failure_event

def log_failure_event(kwargs, response_obj, start_time, end_time)

Runs when a LLM call fails.

async_log_pre_api_call

async def async_log_pre_api_call(model, messages, kwargs)

Runs when a LLM call starts.

async_log_success_event

async def async_log_success_event(kwargs, response_obj, start_time, end_time)

Runs when a LLM call succeeds.

async_log_failure_event

async def async_log_failure_event(kwargs, response_obj, start_time, end_time)

Runs when a LLM call fails.