OpenAI ecosystem apps

Since each GaiaNet node provides an OpenAI-compatible API service, it can be a drop-in replacement for OpenAI in almost all LLM applications and frameworks. Checkout the articles in this section for instructions and examples for how to use GaiaNet in popular LLM apps.

The OpenAI Python library

You can install the official OpenAI Python library as follows.

pip install openai

When you create an OpenAI client using the library, you can pass in the API endpoint point as the base_url. Remember to append the /v1 after the host name. You can find a list of publc nodes here.

import openai

client = openai.OpenAI(base_url="https://YOUR-NODE-ID.us.gaianet.network/v1", api_key="")

Alternatively, you could set an environment variable at the OS level.

export OPENAI_API_BASE=https://YOUR-NODE-ID.us.gaianet.network/v1

Then, when you make API calls from the client, make sure that the model is set to the model name available on your node.

response = client.chat.completions.create(
    model="Meta-Llama-3-8B-Instruct-Q5_K_M",
    messages=[
        {"role": "system", "content": "You are a strategic reasoner."},
            {"role": "user", "content": "What is the purpose of life?"}
        ],
        temperature=0.7,
        max_tokens=500
    ]
)

That's it! You can now take any application built with the official OpenAI Python library and use a Gaia node as its backend!

The OpenAI Node API library

You can install the OpenAI Node library which provides convenient access to the OpenAI REST API from TypeScript or JavaScript as follows:

npm install openai

Import it into your project as:

// Example usage in Node.js
const OpenAI = require('openai');

Create an OpenAI client with a custom base URL. Remember to append the /v1 after the host name.

const client = new OpenAI({
  baseURL: 'https://YOUR-NODE-ID.us.gaianet.network/v1',
  apiKey: '' // Leave this empty when using Gaia
});

Alternatively, you can set an environment variable using dotenv in Node.

process.env.OPENAI_API_BASE = 'https://YOUR-NODE-ID.us.gaianet.network/v1';

Then, when you make API calls from the client, make sure that the model is set to the model name available on your node.

async function callOpenAI() {
  try {
    const response = await client.chat.completions.create({
      model: "Meta-Llama-3-8B-Instruct-Q5_K_M",
      messages: [
        { role: "system", content: "You are a strategic reasoner." },
        { role: "user", content: "What is the purpose of life?" }
      ],
      temperature: 0.7,
      max_tokens: 500
    });

    console.log(response.choices[0].message.content);
  } catch (error) {
    console.error('Error:', error);
  }
}

//Usage
callOpenAI();