ChatBot
Qolaba's platform offers a robust chatbot feature equipped with a selection of advanced Large Language Models (LLMs). Here’s how to navigate and utilize the chatbot dashboard effectively.
Accessing the Chatbot:
Dashboard Navigation: Once logged in, locate the chatbot option on the left panel of your dashboard.
Chatbot Interface: Clicking the chatbot icon will lead you to the dedicated chatbot dashboard.
Exploring LLMs:
The top of the left panel allows you to choose from 9 different LLMs, each with unique capabilities and context window sizes. The context window determines the amount of information the LLM can consider when generating responses. This is akin to the model's memory limit during a conversation. If the conversation exceeds this limit, the model may start "forgetting" earlier parts of the conversation, which could impact the relevance and coherence of its responses.
Here's a breakdown of the available LLMs:
ChatGPT 3.5 (OpenAI): Advanced AI for chat, Q&A, and creative writing. Context window: 16,385 tokens (approx. 42 textbook pages).
ChatGPT 4 (OpenAI): Enhanced version of ChatGPT 3.5 with improved understanding and image processing capabilities. Context window: 128,000 tokens (approx. 300 textbook pages).
Claude Haiku (Anthropic): Fast and efficient LLM with similar capabilities to ChatGPT 3.5. Context window: 200,000 tokens (approx. 460 textbook pages).
Claude Opus (Anthropic): Powerful LLM exceeding GPT-4 capabilities with faster response generation. Context window: 200,000 tokens (approx. 460 textbook pages).
Gemini Pro (Google): Versatile LLM with a context window of 32,000 tokens (approx. 75 textbook pages).
Gemini 1.5 Pro (Google): Similar to Gemini Pro with added image understanding. Context window: 1 million tokens (approx. 2000 textbook pages).
Mistral Large (MistralAI): Open-source LLM comparable to GPT-4 and more powerful than Claude Haiku. Context window: 32,000 tokens (approx. 75 textbook pages).
Assistant Options:
Below the LLM selection, you'll find pre-defined "Assistant" options. These are system prompts designed to guide the LLM towards specific tasks. For instance, the "Image Prompt Engineer" assistant helps you craft effective prompts for image generation using tools like DALL-E or SDXL.
Interacting with the Chatbot:
Text Box: The central text box is where you input your queries or instructions for the LLM.
Internet Search: Enable the toggle button available in left panel to allow the LLM access to basic internet information, enhancing its responses with real-time data.
Upload Options: The "+" icon next to the text box provides options to:
Upload Image: Upload up to 5 images for the LLM to analyze and provide information about.
Upload PDF/TXT/DOC/DOCX: Upload a document (max 100 pages for PDF/DOC/DOCX) for the LLM to process and answer your questions based on its content. This is ideal for extracting specific information, generating summaries, or exploring the document in detail.
Managing Document:
Initial Upload: The first upload of a document may take some time for data extraction and processing.
Document Storage: Uploaded documents are saved for future use and can be accessed from the right panel.
Reusing Documents: Type "#" in the text box to view a dropdown list of your uploaded documents. Select up to 5 documents at a time for the LLM to reference in its responses.
Right Panel Options:
History: Review past conversations and resume any chat from where you left off.
Saved Prompts: Store frequently used prompts for easy access and reuse.
Saved Documents: View and manage your uploaded documents.
LLM Temperature Parameter
The left panel provides an option to adjust the temperature parameter, which influences the creativity of the LLM model's output.
Higher temperature values encourage the model to generate more diverse and unexpected responses.
Lower temperature values result in more focused and deterministic outputs, adhering closely to the provided context.
Starting a New Chat
To initiate a new chat session, simply use the "New Chat" option available on the left panel.
Last updated
