LLaVA 13B

LLaVA 13B is a Vision-language model which allows both image and text as inputs.

API

If you're looking for an API, you can choose from your desired programming language.

POST

const axios = require('axios');
const fs = require('fs');
const path = require('path');

// helper function to help you convert your local images into base64 format
async function toB64(imgPath) {
    const data = fs.readFileSync(path.resolve(imgPath));
    return Buffer.from(data).toString('base64');
}

const api_key = "YOUR API-KEY";
const url = "https://api.segmind.com/v1/llava-13b";

const data = {
  
  "messages": [
    {
            "role": "user",
            "content": "tell me a joke on cats"
        },
        {
            "role": "assistant",
            "content": "here is a joke about cats..."
        },
       {
            "role": "user",
            "content": "now a joke on dogs"
        }
  ]
};

(async function() {
    try {
        const response = await axios.post(url, data, { headers: { 'x-api-key': api_key } });
        console.log(response.data);
    } catch (error) {
        console.error('Error:', error.response.data);
    }
})();

RESPONSE

application/json

HTTP Response Codes

200 - OKResponse Generated

401 - UnauthorizedUser authentication failed

404 - Not FoundThe requested URL does not exist

405 - Method Not AllowedThe requested HTTP method is not allowed

406 - Not AcceptableNot enough credits

500 - Server ErrorServer had some issue with processing

Attributes

messagesArray

An array of objects containing the role and content

rolestr

Could be "user", "assistant" or "system".

contentstr

A string containing the user's query or the assistant's response.

To keep track of your credit usage, you can inspect the response headers of each API call. The x-remaining-credits property will indicate the number of remaining credits in your account. Ensure you monitor this value to avoid any disruptions in your API usage.

LLaVA 13B

LLaVA 13B is a vision-language model (VLM) trained on OSS LLM-generated instruction following data. Its state-of-the-art architecture enables seamless interaction between visual content and textual prompts. FireLLaVA supports multi-image and multi-prompt generation. You can seamlessly integrate multiple images into your queries, enhancing context and specificity.

Applications

Image Captioning: Generate descriptive captions for images, enriching content across social media, e-commerce, and more.
Visual Question Answering (VQA): Pose questions about images, and FireLLaVA provides accurate answers.
Creative Writing: Fuel your imagination by combining visual cues with textual prompts

Other Popular Models

sdxl-controlnet

SDXL ControlNet gives unprecedented control over text-to-image generation. SDXL ControlNet models Introduces the concept of conditioning inputs, which provide additional information to guide the image generation process