Latitude AI

Use Latitude AI’s OpenAI-compatible inference for chat completions, tool calling, and structured output through Portkey.

Quick start

Get started with Latitude AI in under 2 minutes:

Python

from portkey_ai import Portkey

# 1. Install: pip install portkey-ai
# 2. Add @latitude provider in model catalog
# 3. Use it:

portkey = Portkey(api_key="PORTKEY_API_KEY")

response = portkey.chat.completions.create(
    model="@latitude/qwen-2.5-7b",
    messages=[{"role": "user", "content": "Hello!"}]
)

print(response.choices[0].message.content)

import Portkey from 'portkey-ai'

// 1. Install: npm install portkey-ai
// 2. Add @latitude provider in model catalog
// 3. Use it:

const portkey = new Portkey({
    apiKey: "PORTKEY_API_KEY"
})

const response = await portkey.chat.completions.create({
    model: "@latitude/qwen-2.5-7b",
    messages: [{ role: "user", content: "Hello!" }]
})

console.log(response.choices[0].message.content)

from openai import OpenAI
from portkey_ai import PORTKEY_GATEWAY_URL

# 1. Install: pip install openai portkey-ai
# 2. Add @latitude provider in model catalog
# 3. Use it:

client = OpenAI(
    api_key="PORTKEY_API_KEY",  # Portkey API key
    base_url=PORTKEY_GATEWAY_URL
)

response = client.chat.completions.create(
    model="@latitude/qwen-2.5-7b",
    messages=[{"role": "user", "content": "Hello!"}]
)

print(response.choices[0].message.content)

import OpenAI from "openai"
import { PORTKEY_GATEWAY_URL } from "portkey-ai"

// 1. Install: npm install openai portkey-ai
// 2. Add @latitude provider in model catalog
// 3. Use it:

const client = new OpenAI({
    apiKey: "PORTKEY_API_KEY",  // Portkey API key
    baseURL: PORTKEY_GATEWAY_URL
})

const response = await client.chat.completions.create({
    model: "@latitude/qwen-2.5-7b",
    messages: [{ role: "user", content: "Hello!" }]
})

console.log(response.choices[0].message.content)

# 1. Add @latitude provider in model catalog
# 2. Use it:

curl https://api.portkey.ai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "x-portkey-api-key: $PORTKEY_API_KEY" \
  -d '{
    "model": "@latitude/qwen-2.5-7b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Add provider in model catalog

Before making requests, add Latitude AI to your Model Catalog:

1. Go to Model Catalog → Add Provider
2. Select Latitude
3. Enter your Latitude AI API key
4. Name your provider (e.g., latitude)

Complete Setup Guide

See all setup options and detailed configuration instructions

---

Latitude AI capabilities

Tool calling

Use Latitude AI’s tool calling feature to trigger external functions:

Python

from portkey_ai import Portkey

portkey = Portkey(api_key="PORTKEY_API_KEY")

tools = [{
    "type": "function",
    "function": {
        "name": "getWeather",
        "description": "Get the current weather",
        "parameters": {
            "type": "object",
            "properties": {
                "location": {"type": "string", "description": "City and state"},
                "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}
            },
            "required": ["location"]
        }
    }
}]

response = portkey.chat.completions.create(
    model="@latitude/qwen-2.5-7b",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "What's the weather like in Delhi?"}
    ],
    tools=tools,
    tool_choice="auto"
)

print(response.choices[0].finish_reason)

import Portkey from 'portkey-ai';

const portkey = new Portkey({
    apiKey: 'PORTKEY_API_KEY'
});

const tools = [{
    type: "function",
    function: {
        name: "getWeather",
        description: "Get the current weather",
        parameters: {
            type: "object",
            properties: {
                location: { type: "string", description: "City and state" },
                unit: { type: "string", enum: ["celsius", "fahrenheit"] }
            },
            required: ["location"]
        }
    }
}];

const response = await portkey.chat.completions.create({
    model: "@latitude/qwen-2.5-7b",
    messages: [
        { role: "system", content: "You are a helpful assistant." },
        { role: "user", content: "What's the weather like in Delhi?" }
    ],
    tools,
    tool_choice: "auto"
});

console.log(response.choices[0].finish_reason);

JSON output

Force structured JSON responses from Latitude AI models:

Python

from portkey_ai import Portkey

portkey = Portkey(api_key="PORTKEY_API_KEY")

response = portkey.chat.completions.create(
    model="@latitude/qwen-2.5-7b",
    messages=[
        {"role": "system", "content": "Respond in JSON format with keys: answer, confidence"},
        {"role": "user", "content": "What is the capital of France?"}
    ],
    response_format={"type": "json_object"}
)

print(response.choices[0].message.content)

import Portkey from 'portkey-ai';

const portkey = new Portkey({
    apiKey: 'PORTKEY_API_KEY'
});

const response = await portkey.chat.completions.create({
    model: "@latitude/qwen-2.5-7b",
    messages: [
        { role: "system", content: "Respond in JSON format with keys: answer, confidence" },
        { role: "user", content: "What is the capital of France?" }
    ],
    response_format: { type: "json_object" }
});

console.log(response.choices[0].message.content);

---

Supported models

Model	Context	Features
qwen-2.5-7b	131K	Tools, JSON mode
llama-3.1-8b	128K	Tools, JSON mode
qwen3-32b	131K	Tools, JSON mode
gemma-2-27b	8K	Tools, JSON mode
deepseek-r1-distill-14b	64K	Tools, JSON mode, Reasoning
qwen2.5-coder-32b	131K	Tools, JSON mode
qwen-2.5-vl-7b	32K	Tools, JSON mode, Vision

Latitude AI Models

View the complete list of models available on Latitude AI

---

Next steps

Gateway Configs

Add fallbacks, load balancing, and more

Observability

Monitor and trace your Latitude AI requests

Prompt Library

Manage and version your prompts

Metadata

Add custom metadata to requests

For complete SDK documentation:

SDK Reference

Complete Portkey SDK documentation