llm-api-client

Contents:

  • Getting Started
    • Installation
    • Quick start
  • Usage Examples
    • Basic concurrent requests
    • Retries with backoff
    • Streaming and large context handling
    • Accessing history and usage
  • Configuration
    • Client limits
    • Environment variables
    • Provider credentials
    • Logging
    • Autodoc and docs
  • API Reference
    • APIClient
      • APIClient.__init__()
      • APIClient.count_messages_tokens()
      • APIClient.details
      • APIClient.get_max_context_tokens()
      • APIClient.history
      • APIClient.make_requests()
      • APIClient.make_requests_with_retries()
      • APIClient.remove_unsupported_params()
      • APIClient.sanitize_completion_request()
      • APIClient.tracker
      • APIClient.truncate_to_max_context_tokens()
    • APIUsageTracker
      • APIUsageTracker.__del__()
      • APIUsageTracker.__init__()
      • APIUsageTracker.__str__()
      • APIUsageTracker.details
      • APIUsageTracker.get_stats_str()
      • APIUsageTracker.mean_response_time
      • APIUsageTracker.num_api_calls
      • APIUsageTracker.response_time_at_percentile()
      • APIUsageTracker.set_up_litellm_cost_tracking()
      • APIUsageTracker.total_completion_tokens
      • APIUsageTracker.total_cost
      • APIUsageTracker.total_prompt_tokens
      • APIUsageTracker.track_cost_callback()
    • Client
      • APIClient
    • Usage Tracker
      • APIUsageTracker
llm-api-client
  • Search

© Copyright 2025, AndreFCruz.

Built with Sphinx using a theme provided by Read the Docs.