1 line
112 KiB
JSON
1 line
112 KiB
JSON
{"repo": "abelcha/doxfiles", "files": {"mods/mods.yml": {"b7b9d5a280430b26b63603fa6d7d7d0fe3a1907a": {"t": 1785746361.33826, "n": 91890, "h": "31fca39343f4a696", "c": "# Default model (gpt-3.5-turbo, gpt-4, ggml-gpt4all-j...).\n# default-model: mistralai/mistral-medium #:ixtral-8x7b-32768\n# default-model: smc\ndefault-model: deepseek-chat\n# default-model: gpt-4\n# default-model: grok-beta #llama-3-sonar-small-32k-online\n# default-model: x-ai/grok-2-1212\n# default-model: ds-chat\n# default-model: anthropic/claude-3-haiku:beta\n # Text to append when using the -f flag.\nformat-text:\n markdown: 'Format the response as markdown without enclosing backticks.'\n # json: 'Format the response as json without enclosing backticks.'\n# List of predefined system messages that can be used as roles.\nroles:\n \"default\": []\n# Ask for the response to be formatted as markdown unless otherwise set.\nformat: true\n# System role to use.\nrole: \"default\"\n# Render output as raw text when connected to a TTY.\nraw: false\n# Quiet mode (hide the spinner while loading and stderr messages for success).\nquiet: false\n# Temperature (randomness) of results, from 0.0 to 2.0.\ntemp: 1.0\n# TopP, an alternative to temperature that narrows response, from 0.0 to 1.0.\ntopp: 1.0\n# Turn off the client-side limit on the size of the input into the model.\nno-limit: false\n# Wrap formatted output at specific width (default is 80)\nword-wrap: 100\n# Include the prompt from the arguments in the response.\ninclude-prompt-args: false\n# Include the prompt from the arguments and stdin, truncate stdin to specified number of lines.\ninclude-prompt: 0\n# Maximum number of times to retry API calls.\nmax-retries: 1\n# Your desired level of fanciness.\nfanciness: 500\n# Text to show while generating.\nstatus-text: Generating\n# Default character limit on input to model.\nmax-input-chars: 12250\n# Maximum number of tokens in response.\n# max-tokens: 40000\ntheme: catppuccin\n# Aliases and endpoints for OpenAI compatible REST API.\napis:\n openrouter:\n base-url: https://openrouter.ai/api/v1\n api-key-env: OPENROUTER_API_KEY\n models:\n eleutherai/llemma_7b:\n max-input-char: 4096\n created: \"2025-04-14\"\n moderated: false\n alias: '[\"llemma_7b\"]'\n description: Llemma 7B is a language model for mathematics. It was initialized with Code Llama 7B weights, and trained on the Proof-Pile-2 for 200B tokens. Llemma models are particularly strong at chain-of-thought\n alfredpros/codellama-7b-instruct-solidity:\n max-input-char: 4096\n created: \"2025-04-14\"\n moderated: false\n alias: '[\"codellama-7b-instruct-solidity\"]'\n description: A finetuned 7 billion parameters Code LLaMA - Instruct model to generate Solidity smart contract using 4-bit QLoRA finetuning provided by PEFT library.\n arliai/qwq-32b-arliai-rpr-v1:free:\n max-input-char: null\n created: \"2025-04-13\"\n moderated: false\n alias: '[\"qwq-32b-arliai-rpr-v1:free\"]'\n description: 'QwQ-32B-ArliAI-RpR-v1 is a 32B parameter model fine-tuned from Qwen/QwQ-32B using a curated creative writing and roleplay dataset originally developed for the RPMax series. It is designed to maintain '\n agentica-org/deepcoder-14b-preview:free:\n max-input-char: null\n created: \"2025-04-13\"\n moderated: false\n alias: '[\"deepcoder-14b-preview:free\"]'\n description: DeepCoder-14B-Preview is a 14B parameter code generation model fine-tuned from DeepSeek-R1-Distill-Qwen-14B using reinforcement learning with GRPO+ and iterative context lengthening. It is optimized f\n moonshotai/kimi-vl-a3b-thinking:free:\n max-input-char: null\n created: \"2025-04-10\"\n moderated: false\n alias: '[\"kimi-vl-a3b-thinking:free\"]'\n description: Kimi-VL is a lightweight Mixture-of-Experts vision-language model that activates only 2.8B parameters per step while delivering strong performance on multimodal reasoning and long-context tasks. The K\n x-ai/grok-3-mini-beta:\n max-input-char: null\n created: \"2025-04-09\"\n moderated: false\n alias: '[\"grok-3-mini-beta\"]'\n description: Grok 3 Mini is a lightweight, smaller thinking model. Unlike traditional models that generate answers immediately, Grok 3 Mini thinks before responding. It’s ideal for reasoning-heavy tasks that don’t\n x-ai/grok-3-beta:\n max-input-char: null\n created: \"2025-04-09\"\n moderated: false\n alias: '[\"grok-3-beta\"]'\n description: Grok 3 is the latest model from xAI. It's their flagship model that excels at enterprise use cases like data extraction, coding, and text summarization. Possesses deep domain knowledge in finance, hea\n nvidia/llama-3.1-nemotron-nano-8b-v1:free:\n max-input-char: null\n created: \"2025-04-08\"\n moderated: false\n alias: '[\"llama-3.1-nemotron-nano-8b-v1:free\"]'\n description: Llama-3.1-Nemotron-Nano-8B-v1 is a compact large language model (LLM) derived from Meta's Llama-3.1-8B-Instruct, specifically optimized for reasoning tasks, conversational interactions, retrieval-augm\n nvidia/llama-3.3-nemotron-super-49b-v1:free:\n max-input-char: null\n created: \"2025-04-08\"\n moderated: false\n alias: '[\"llama-3.3-nemotron-super-49b-v1:free\"]'\n description: Llama-3.3-Nemotron-Super-49B-v1 is a large language model (LLM) optimized for advanced reasoning, conversational interactions, retrieval-augmented generation (RAG), and tool-calling tasks. Derived fro\n nvidia/llama-3.1-nemotron-ultra-253b-v1:free:\n max-input-char: null\n created: \"2025-04-08\"\n moderated: false\n alias: '[\"llama-3.1-nemotron-ultra-253b-v1:free\"]'\n description: Llama-3.1-Nemotron-Ultra-253B-v1 is a large language model (LLM) optimized for advanced reasoning, human-interactive chat, retrieval-augmented generation (RAG), and tool-calling tasks. Derived from Me\n tokyotech-llm/llama-3.1-swallow-8b-instruct-v0.3:\n max-input-char: 4096\n created: \"2025-04-07\"\n moderated: false\n alias: '[\"llama-3.1-swallow-8b-instruct-v0.3\"]'\n description: Llama 3.1 Swallow 8B is a large language model that was built by continual pre-training on the Meta Llama 3.1 8B. Llama 3.1 Swallow enhanced the Japanese language capabilities of the original Llama 3.\n meta-llama/llama-4-maverick:free:\n max-input-char: null\n created: \"2025-04-05\"\n moderated: false\n alias: '[\"llama-4-maverick:free\"]'\n description: Llama 4 Maverick 17B Instruct (128E) is a high-capacity multimodal language model from Meta, built on a mixture-of-experts (MoE) architecture with 128 experts and 17 billion active parameters per forw\n meta-llama/llama-4-maverick:\n max-input-char: 8192\n created: \"2025-04-05\"\n moderated: false\n alias: '[\"llama-4-maverick\"]'\n description: Llama 4 Maverick 17B Instruct (128E) is a high-capacity multimodal language model from Meta, built on a mixture-of-experts (MoE) architecture with 128 experts and 17 billion active parameters per forw\n meta-llama/llama-4-scout:free:\n max-input-char: null\n created: \"2025-04-05\"\n moderated: false\n alias: '[\"llama-4-scout:free\"]'\n description: 'Llama 4 Scout 17B Instruct (16E) is a mixture-of-experts (MoE) language model developed by Meta, activating 17 billion parameters out of a total of 109B. It supports native multimodal input (text and '\n meta-llama/llama-4-scout:\n max-input-char: 8192\n created: \"2025-04-05\"\n moderated: false\n alias: '[\"llama-4-scout\"]'\n description: 'Llama 4 Scout 17B Instruct (16E) is a mixture-of-experts (MoE) language model developed by Meta, activating 17 billion parameters out of a total of 109B. It supports native multimodal input (text and '\n all-hands/openhands-lm-32b-v0.1:\n max-input-char: 4096\n created: \"2025-04-02\"\n moderated: false\n alias: '[\"openhands-lm-32b-v0.1\"]'\n description: OpenHands LM v0.1 is a 32B open-source coding model fine-tuned from Qwen2.5-Coder-32B-Instruct using reinforcement learning techniques outlined in SWE-Gym. It is optimized for autonomous software deve\n scb10x/llama3.1-typhoon2-8b-instruct:\n max-input-char: null\n created: \"2025-03-28\"\n moderated: false\n alias: '[\"llama3.1-typhoon2-8b-instruct\"]'\n description: Llama3.1-Typhoon2-8B-Instruct is a Thai-English instruction-tuned model with 8 billion parameters, built on Llama 3.1. It significantly improves over its base model in Thai reasoning, instruction-foll\n scb10x/llama3.1-typhoon2-70b-instruct:\n max-input-char: null\n created: \"2025-03-28\"\n moderated: false\n alias: '[\"llama3.1-typhoon2-70b-instruct\"]'\n description: Llama3.1-Typhoon2-70B-Instruct is a Thai-English instruction-tuned language model with 70 billion parameters, built on Llama 3.1. It demonstrates strong performance across general instruction-followin\n allenai/molmo-7b-d:free:\n max-input-char: null\n created: \"2025-03-26\"\n moderated: false\n alias: '[\"molmo-7b-d:free\"]'\n description: Molmo is a family of open vision-language models developed by the Allen Institute for AI. Molmo models are trained on PixMo, a dataset of 1 million, highly-curated image-text pairs. It has state-of-th\n bytedance-research/ui-tars-72b:free:\n max-input-char: null\n created: \"2025-03-26\"\n moderated: false\n alias: '[\"ui-tars-72b:free\"]'\n description: UI-TARS 72B is an open-source multimodal AI model designed specifically for automating browser and desktop tasks through visual interaction and control. The model is built with a specialized vision ar\n qwen/qwen2.5-vl-3b-instruct:free:\n max-input-char: null\n created: \"2025-03-26\"\n moderated: false\n alias: '[\"qwen2.5-vl-3b-instruct:free\"]'\n description: 'Qwen2.5 VL 3B is a multimodal LLM from the Qwen Team with the following key enhancements: - - - SoTA understanding of images of various resolution & ratio: Qwen2.5-VL achieves state-of-the-art performanc'\n qwen/qwen2.5-vl-32b-instruct:free:\n max-input-char: null\n created: \"2025-03-24\"\n moderated: false\n alias: '[\"qwen2.5-vl-32b-instruct:free\"]'\n description: Qwen2.5-VL-32B is a multimodal vision-language model fine-tuned through reinforcement learning for enhanced mathematical reasoning, structured outputs, and visual problem-solving capabilities. It exce\n qwen/qwen2.5-vl-32b-instruct:\n max-input-char: null\n created: \"2025-03-24\"\n moderated: false\n alias: '[\"qwen2.5-vl-32b-instruct\"]'\n description: Qwen2.5-VL-32B is a multimodal vision-language model fine-tuned through reinforcement learning for enhanced mathematical reasoning, structured outputs, and visual problem-solving capabilities. It exce\n featherless/qwerky-72b:free:\n max-input-char: 4096\n created: \"2025-03-20\"\n moderated: false\n alias: '[\"qwerky-72b:free\"]'\n description: Qwerky-72B is a linear-attention RWKV variant of the Qwen 2.5 72B model, optimized to significantly reduce computational cost at scale. Leveraging linear attention, it achieves substantial inference s\n open-r1/olympiccoder-7b:free:\n max-input-char: null\n created: \"2025-03-15\"\n moderated: false\n alias: '[\"olympiccoder-7b:free\"]'\n description: OlympicCoder-7B is an open-source language model fine-tuned on the CodeForces-CoTs dataset, consisting of nearly 100,000 high-quality chain-of-thought examples from competitive programming contexts. O\n open-r1/olympiccoder-32b:free:\n max-input-char: null\n created: \"2025-03-15\"\n moderated: false\n alias: '[\"olympiccoder-32b:free\"]'\n description: OlympicCoder-32B is a high-performing open-source model fine-tuned using the CodeForces-CoTs dataset, containing approximately 100,000 chain-of-thought programming samples. It excels at complex compet\n steelskull/l3.3-electra-r1-70b:\n max-input-char: 131072\n created: \"2025-03-15\"\n moderated: false\n alias: '[\"l3.3-electra-r1-70b\"]'\n description: 'L3.3-Electra-R1-70 is the newest release of the Unnamed series. Built on a DeepSeek R1 Distill base, Electra-R1 integrates various models together to provide an intelligent and coherent model capable '\n ai21/jamba-1.6-large:\n max-input-char: 4096\n created: \"2025-03-13\"\n moderated: false\n alias: '[\"jamba-1.6-large\"]'\n description: AI21 Jamba Large 1.6 is a high-performance hybrid foundation model combining State Space Models (Mamba) with Transformer attention mechanisms. Developed by AI21, it excels in extremely long-context ha\n ai21/jamba-1.6-mini:\n max-input-char: 4096\n created: \"2025-03-13\"\n moderated: false\n alias: '[\"jamba-1.6-mini\"]'\n description: 'AI21 Jamba Mini 1.6 is a hybrid foundation model combining State Space Models (Mamba) with Transformer attention mechanisms. With 12 billion active parameters (52 billion total), this model excels in '\n cohere/command-a:\n max-input-char: 8192\n created: \"2025-03-13\"\n moderated: false\n alias: '[\"command-a\"]'\n description: Command A is an open-weights 111B parameter model with a 256k context window focused on delivering great performance across agentic, multilingual, and coding use cases. - Compared to other leading propr\n rekaai/reka-flash-3:free:\n max-input-char: null\n created: \"2025-03-12\"\n moderated: false\n alias: '[\"reka-flash-3:free\"]'\n description: Reka Flash 3 is a general-purpose, instruction-tuned large language model with 21 billion parameters, developed by Reka. It excels at general chat, coding tasks, instruction-following, and function ca\n thedrummer/anubis-pro-105b-v1:\n max-input-char: 131072\n created: \"2025-03-10\"\n moderated: false\n alias: '[\"anubis-pro-105b-v1\"]'\n description: Anubis Pro 105B v1 is an expanded and refined variant of Meta’s Llama 3.3 70B, featuring 50% additional layers and further fine-tuning to leverage its increased capacity. Designed for advanced narrati\n latitudegames/wayfarer-large-70b-llama-3.3:\n max-input-char: 131072\n created: \"2025-03-10\"\n moderated: false\n alias: '[\"wayfarer-large-70b-llama-3.3\"]'\n description: Wayfarer Large 70B is a roleplay and text-adventure model fine-tuned from Meta’s Llama-3.3-70B-Instruct. Specifically optimized for narrative-driven, challenging scenarios, it introduces realistic sta\n thedrummer/skyfall-36b-v2:\n max-input-char: 32768\n created: \"2025-03-10\"\n moderated: false\n alias: '[\"skyfall-36b-v2\"]'\n description: Skyfall 36B v2 is an enhanced iteration of Mistral Small 2501, specifically fine-tuned for improved creativity, nuanced writing, role-playing, and coherent storytelling.\n microsoft/phi-4-multimodal-instruct:\n max-input-char: null\n created: \"2025-03-08\"\n moderated: false\n alias: '[\"phi-4-multimodal-instruct\"]'\n description: 'Phi-4 Multimodal Instruct is a versatile 5.6B parameter foundation model that combines advanced reasoning and instruction-following capabilities across both text and visual inputs, providing accurate '\n perplexity/sonar-reasoning-pro:\n max-input-char: null\n created: \"2025-03-07\"\n moderated: false\n alias: '[\"sonar-reasoning-pro\"]'\n description: 'Note: Sonar Pro pricing includes Perplexity search pricing. See [details here](https://docs.perplexity.ai/guides/pricing#detailed-pricing-breakdown-for-sonar-reasoning-pro-and-sonar-pro) - - Sonar Reason'\n perplexity/sonar-pro:\n max-input-char: 8000\n created: \"2025-03-07\"\n moderated: false\n alias: '[\"sonar-pro\"]'\n description: 'Note: Sonar Pro pricing includes Perplexity search pricing. See [details here](https://docs.perplexity.ai/guides/pricing#detailed-pricing-breakdown-for-sonar-reasoning-pro-and-sonar-pro) - - For enterpri'\n perplexity/sonar-deep-research:\n max-input-char: null\n created: \"2025-03-07\"\n moderated: false\n alias: '[\"sonar-deep-research\"]'\n description: 'Sonar Deep Research is a research-focused model designed for multi-step retrieval, synthesis, and reasoning across complex topics. It autonomously searches, reads, and evaluates sources, refining its '\n qwen/qwq-32b:free:\n max-input-char: 40000\n created: \"2025-03-05\"\n moderated: false\n alias: '[\"qwq-32b:free\"]'\n description: QwQ is the reasoning model of the Qwen series. Compared with conventional instruction-tuned models, QwQ, which is capable of thinking and reasoning, can achieve significantly enhanced performance in d\n qwen/qwq-32b:\n max-input-char: null\n created: \"2025-03-05\"\n moderated: false\n alias: '[\"qwq-32b\"]'\n description: QwQ is the reasoning model of the Qwen series. Compared with conventional instruction-tuned models, QwQ, which is capable of thinking and reasoning, can achieve significantly enhanced performance in d\n moonshotai/moonlight-16b-a3b-instruct:free:\n max-input-char: null\n created: \"2025-02-28\"\n moderated: false\n alias: '[\"moonlight-16b-a3b-instruct:free\"]'\n description: Moonlight-16B-A3B-Instruct is a 16B-parameter Mixture-of-Experts (MoE) language model developed by Moonshot AI. It is optimized for instruction-following tasks with 3B activated parameters per inferen\n nousresearch/deephermes-3-llama-3-8b-preview:free:\n max-input-char: null\n created: \"2025-02-28\"\n moderated: false\n alias: '[\"deephermes-3-llama-3-8b-preview:free\"]'\n description: DeepHermes 3 Preview is the latest version of our flagship Hermes series of LLMs by Nous Research, and one of the first models in the world to unify Reasoning (long chains of thought that improve answ\n anthropic/claude-3.7-sonnet:\n max-input-char: 64000\n created: \"2025-02-24\"\n moderated: false\n alias: '[\"claude-3.7-sonnet\"]'\n description: Claude 3.7 Sonnet is an advanced large language model with improved reasoning, coding, and problem-solving capabilities. It introduces a hybrid reasoning approach, allowing users to choose between rap\n anthropic/claude-3.7-sonnet:thinking:\n max-input-char: 64000\n created: \"2025-02-24\"\n moderated: false\n alias: '[\"claude-3.7-sonnet:thinking\"]'\n description: Claude 3.7 Sonnet is an advanced large language model with improved reasoning, coding, and problem-solving capabilities. It introduces a hybrid reasoning approach, allowing users to choose between rap\n anthropic/claude-3.7-sonnet:beta:\n max-input-char: 128000\n created: \"2025-02-24\"\n moderated: false\n alias: '[\"claude-3.7-sonnet:beta\"]'\n description: Claude 3.7 Sonnet is an advanced large language model with improved reasoning, coding, and problem-solving capabilities. It introduces a hybrid reasoning approach, allowing users to choose between rap\n perplexity/r1-1776:\n max-input-char: null\n created: \"2025-02-19\"\n moderated: false\n alias: '[\"r1-1776\"]'\n description: R1 1776 is a version of DeepSeek-R1 that has been post-trained to remove censorship constraints related to topics restricted by the Chinese government. The model retains its original reasoning capabil\n meta-llama/llama-guard-3-8b:\n max-input-char: null\n created: \"2025-02-12\"\n moderated: false\n alias: '[\"llama-guard-3-8b\"]'\n description: Llama Guard 3 is a Llama-3.1-8B pretrained model, fine-tuned for content safety classification. Similar to previous versions, it can be used to classify content in both LLM inputs (prompt classificati\n qwen/qwen-vl-plus:\n max-input-char: 1500\n created: \"2025-02-05\"\n moderated: false\n alias: '[\"qwen-vl-plus\"]'\n description: Qwen's Enhanced Large Visual Language Model. Significantly upgraded for detailed recognition capabilities and text recognition abilities, supporting ultra-high pixel resolutions up to millions of pixe\n aion-labs/aion-1.0:\n max-input-char: 32768\n created: \"2025-02-04\"\n moderated: false\n alias: '[\"aion-1.0\"]'\n description: Aion-1.0 is a multi-model system designed for high performance across various tasks, including reasoning and coding. It is built on DeepSeek-R1, augmented with additional models and techniques such as\n aion-labs/aion-1.0-mini:\n max-input-char: 32768\n created: \"2025-02-04\"\n moderated: false\n alias: '[\"aion-1.0-mini\"]'\n description: Aion-1.0-Mini 32B parameter model is a distilled version of the DeepSeek-R1 model, designed for strong performance in reasoning domains such as mathematics, coding, and logic. It is a modified variant\n aion-labs/aion-rp-llama-3.1-8b:\n max-input-char: 32768\n created: \"2025-02-04\"\n moderated: false\n alias: '[\"aion-rp-llama-3.1-8b\"]'\n description: Aion-RP-Llama-3.1-8B ranks the highest in the character evaluation portion of the RPBench-Auto benchmark, a roleplaying-specific variant of Arena-Hard-Auto, where LLMs evaluate each other’s responses.\n qwen/qwen-vl-max:\n max-input-char: 1500\n created: \"2025-02-01\"\n moderated: false\n alias: '[\"qwen-vl-max\"]'\n description: 'Qwen VL Max is a visual understanding model with 7500 tokens context length. It excels in delivering optimal performance for a broader spectrum of complex tasks. - '\n qwen/qwen-turbo:\n max-input-char: 8192\n created: \"2025-02-01\"\n moderated: false\n alias: '[\"qwen-turbo\"]'\n description: Qwen-Turbo, based on Qwen2.5, is a 1M context model that provides fast speed and low cost, suitable for simple tasks.\n qwen/qwen2.5-vl-72b-instruct:free:\n max-input-char: 2048\n created: \"2025-02-01\"\n moderated: false\n alias: '[\"qwen2.5-vl-72b-instruct:free\"]'\n description: Qwen2.5-VL is proficient in recognizing common objects such as flowers, birds, fish, and insects. It is also highly capable of analyzing texts, charts, icons, graphics, and layouts within images.\n qwen/qwen2.5-vl-72b-instruct:\n max-input-char: 128000\n created: \"2025-02-01\"\n moderated: false\n alias: '[\"qwen2.5-vl-72b-instruct\"]'\n description: Qwen2.5-VL is proficient in recognizing common objects such as flowers, birds, fish, and insects. It is also highly capable of analyzing texts, charts, icons, graphics, and layouts within images.\n qwen/qwen-plus:\n max-input-char: 8192\n created: \"2025-02-01\"\n moderated: false\n alias: '[\"qwen-plus\"]'\n description: Qwen-Plus, based on the Qwen2.5 foundation model, is a 131K context model with a balanced performance, speed, and cost combination.\n qwen/qwen-max:\n max-input-char: 8192\n created: \"2025-02-01\"\n moderated: false\n alias: '[\"qwen-max\"]'\n description: Qwen-Max, based on Qwen2.5, provides the best inference performance among [Qwen models](/qwen), especially for complex multi-step tasks. It's a large-scale MoE model that has been pretrained on over 2\n perplexity/sonar-reasoning:\n max-input-char: null\n created: \"2025-01-29\"\n moderated: false\n alias: '[\"sonar-reasoning\"]'\n description: Sonar Reasoning is a reasoning model provided by Perplexity based on [DeepSeek R1](/deepseek/deepseek-r1). - - It allows developers to utilize long chain of thought with built-in web search. Sonar Reason\n perplexity/sonar:\n max-input-char: null\n created: \"2025-01-27\"\n moderated: false\n alias: '[\"sonar\"]'\n description: Sonar is lightweight, affordable, fast, and simple to use — now featuring citations and the ability to customize sources. It is designed for companies seeking to integrate lightweight question-and-ans\n liquid/lfm-7b:\n max-input-char: null\n created: \"2025-01-25\"\n moderated: false\n alias: '[\"lfm-7b\"]'\n description: LFM-7B, a new best-in-class language model. LFM-7B is designed for exceptional chat capabilities, including languages like Arabic and Japanese. Powered by the Liquid Foundation Model (LFM) architectur\n liquid/lfm-3b:\n max-input-char: null\n created: \"2025-01-25\"\n moderated: false\n alias: '[\"lfm-3b\"]'\n description: Liquid's LFM 3B delivers incredible performance for its size. It positions itself as first place among 3B parameter transformers, hybrids, and RNN models It is also on par with Phi-3.5-mini on multipl\n sophosympatheia/rogue-rose-103b-v0.2:free:\n max-input-char: null\n created: \"2025-01-18\"\n moderated: false\n alias: '[\"rogue-rose-103b-v0.2:free\"]'\n description: Rogue Rose demonstrates strong capabilities in roleplaying and storytelling applications, potentially surpassing other models in the 103-120B parameter range. While it occasionally exhibits inconsiste\n minimax/minimax-01:\n max-input-char: 1000192\n created: \"2025-01-15\"\n moderated: false\n alias: '[\"minimax-01\"]'\n description: MiniMax-01 is a combines MiniMax-Text-01 for text generation and MiniMax-VL-01 for image understanding. It has 456 billion parameters, with 45.9 billion parameters activated per inference, and can han\n microsoft/phi-4:\n max-input-char: 8192\n created: \"2025-01-10\"\n moderated: false\n alias: '[\"phi-4\"]'\n description: '[Microsoft Research](/microsoft) Phi-4 is designed to perform well in complex reasoning tasks and can operate efficiently in situations with limited memory or where quick responses are needed. - - At 14'\n sao10k/l3.1-70b-hanami-x1:\n max-input-char: null\n created: \"2025-01-08\"\n moderated: false\n alias: '[\"l3.1-70b-hanami-x1\"]'\n description: This is [Sao10K](/sao10k)'s experiment over [Euryale v2.2](/sao10k/l3.1-euryale-70b).\n sao10k/l3.3-euryale-70b:\n max-input-char: 8192\n created: \"2024-12-18\"\n moderated: false\n alias: '[\"l3.3-euryale-70b\"]'\n description: Euryale L3.3 70B is a model focused on creative roleplay from [Sao10k](https://ko-fi.com/sao10k). It is the successor of [Euryale L3 70B v2.2](/models/sao10k/l3-euryale-70b).\n eva-unit-01/eva-llama-3.33-70b:\n max-input-char: 4096\n created: \"2024-12-16\"\n moderated: false\n alias: '[\"eva-llama-3.33-70b\"]'\n description: EVA Llama 3.33 70b is a roleplay and storywriting specialist model. It is a full-parameter finetune of [Llama-3.3-70B-Instruct](https://openrouter.ai/meta-llama/llama-3.3-70b-instruct) on mixture of s\n x-ai/grok-2-vision-1212:\n max-input-char: null\n created: \"2024-12-15\"\n moderated: false\n alias: '[\"grok-2-vision-1212\"]'\n description: Grok 2 Vision 1212 advances image-based AI with stronger visual comprehension, refined instruction-following, and multilingual support. From object recognition to style analysis, it empowers developer\n x-ai/grok-2-1212:\n max-input-char: null\n created: \"2024-12-15\"\n moderated: false\n alias: '[\"grok-2-1212\"]'\n description: Grok 2 1212 introduces significant enhancements to accuracy, instruction adherence, and multilingual support, making it a powerful and flexible choice for developers seeking a highly steerable, intell\n cohere/command-r7b-12-2024:\n max-input-char: 4000\n created: \"2024-12-14\"\n moderated: false\n alias: '[\"command-r7b-12-2024\"]'\n description: Command R7B (12-2024) is a small, fast update of the Command R+ model, delivered in December 2024. It excels at RAG, tool use, agents, and similar tasks requiring complex reasoning and multiple steps.\n meta-llama/llama-3.3-70b-instruct:free:\n max-input-char: 8000\n created: \"2024-12-06\"\n moderated: false\n alias: '[\"llama-3.3-70b-instruct:free\"]'\n description: The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimize\n meta-llama/llama-3.3-70b-instruct:\n max-input-char: 16384\n created: \"2024-12-06\"\n moderated: false\n alias: '[\"llama-3.3-70b-instruct\"]'\n description: The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimize\n amazon/nova-lite-v1:\n max-input-char: 5120\n created: \"2024-12-05\"\n moderated: false\n alias: '[\"nova-lite-v1\"]'\n description: Amazon Nova Lite 1.0 is a very low-cost multimodal model from Amazon that focused on fast processing of image, video, and text inputs to generate text output. Amazon Nova Lite can handle real-time cus\n amazon/nova-micro-v1:\n max-input-char: 5120\n created: \"2024-12-05\"\n moderated: false\n alias: '[\"nova-micro-v1\"]'\n description: Amazon Nova Micro 1.0 is a text-only model that delivers the lowest latency responses in the Amazon Nova family of models at a very low cost. With a context length of 128K tokens and optimized for spe\n amazon/nova-pro-v1:\n max-input-char: 5120\n created: \"2024-12-05\"\n moderated: false\n alias: '[\"nova-pro-v1\"]'\n description: Amazon Nova Pro 1.0 is a capable multimodal model from Amazon focused on providing a combination of accuracy, speed, and cost for a wide range of tasks. As of December 2024, it achieves state-of-the-a\n qwen/qwq-32b-preview:free:\n max-input-char: null\n created: \"2024-11-28\"\n moderated: false\n alias: '[\"qwq-32b-preview:free\"]'\n description: QwQ-32B-Preview is an experimental research model focused on AI reasoning capabilities developed by the Qwen Team. As a preview release, it demonstrates promising analytical abilities while having sev\n qwen/qwq-32b-preview:\n max-input-char: null\n created: \"2024-11-28\"\n moderated: false\n alias: '[\"qwq-32b-preview\"]'\n description: QwQ-32B-Preview is an experimental research model focused on AI reasoning capabilities developed by the Qwen Team. As a preview release, it demonstrates promising analytical abilities while having sev\n eva-unit-01/eva-qwen-2.5-72b:\n max-input-char: 131072\n created: \"2024-11-21\"\n moderated: false\n alias: '[\"eva-qwen-2.5-72b\"]'\n description: 'EVA Qwen2.5 72B is a roleplay and storywriting specialist model. It''s a full-parameter finetune of Qwen2.5-72B on mixture of synthetic and natural data. - - It uses Celeste 70B 0.1 data mixture, greatly '\n x-ai/grok-vision-beta:\n max-input-char: null\n created: \"2024-11-19\"\n moderated: false\n alias: '[\"grok-vision-beta\"]'\n description: 'Grok Vision Beta is xAI''s experimental language model with vision capability. - - '\n infermatic/mn-inferor-12b:\n max-input-char: 4096\n created: \"2024-11-13\"\n moderated: false\n alias: '[\"mn-inferor-12b\"]'\n description: Inferor 12B is a merge of top roleplay models, expert on immersive narratives and storytelling. - - This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [ant\n qwen/qwen-2.5-coder-32b-instruct:free:\n max-input-char: null\n created: \"2024-11-11\"\n moderated: false\n alias: '[\"qwen-2.5-coder-32b-instruct:free\"]'\n description: 'Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). Qwen2.5-Coder brings the following improvements upon CodeQwen1.5: - - - Significantly improvem'\n qwen/qwen-2.5-coder-32b-instruct:\n max-input-char: 8192\n created: \"2024-11-11\"\n moderated: false\n alias: '[\"qwen-2.5-coder-32b-instruct\"]'\n description: 'Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). Qwen2.5-Coder brings the following improvements upon CodeQwen1.5: - - - Significantly improvem'\n raifle/sorcererlm-8x22b:\n max-input-char: null\n created: \"2024-11-08\"\n moderated: false\n alias: '[\"sorcererlm-8x22b\"]'\n description: SorcererLM is an advanced RP and storytelling model, built as a Low-rank 16-bit LoRA fine-tuned on [WizardLM-2 8x22B](/microsoft/wizardlm-2-8x22b). - - - Advanced reasoning and emotional intelligence for\n eva-unit-01/eva-qwen-2.5-32b:\n max-input-char: 4096\n created: \"2024-11-08\"\n moderated: false\n alias: '[\"eva-qwen-2.5-32b\"]'\n description: EVA Qwen2.5 32B is a roleplaying/storywriting specialist model. It's a full-parameter finetune of Qwen2.5-32B on mixture of synthetic and natural data. - - It uses Celeste 70B 0.1 data mixture, greatly e\n thedrummer/unslopnemo-12b:\n max-input-char: null\n created: \"2024-11-08\"\n moderated: false\n alias: '[\"unslopnemo-12b\"]'\n description: UnslopNemo v4.1 is the latest addition from the creator of Rocinante, designed for adventure writing and role-play scenarios.\n anthropic/claude-3.5-haiku:beta:\n max-input-char: 8192\n created: \"2024-11-04\"\n moderated: false\n alias: '[\"claude-3.5-haiku:beta\"]'\n description: Claude 3.5 Haiku features offers enhanced capabilities in speed, coding accuracy, and tool use. Engineered to excel in real-time applications, it delivers quick response times that are essential for d\n anthropic/claude-3.5-haiku:\n max-input-char: 8192\n created: \"2024-11-04\"\n moderated: true\n alias: '[\"claude-3.5-haiku\"]'\n description: '* Claude 3.5 Haiku features offers enhanced capabilities in speed, coding accuracy, and tool use. Engineered to excel in real-time applications, it delivers quick response times that are essential for d'\n anthropic/claude-3.5-haiku-20241022:beta:\n max-input-char: 8192\n created: \"2024-11-04\"\n moderated: false\n alias: '[\"claude-3.5-haiku-20241022:beta\"]'\n description: Claude 3.5 Haiku features enhancements across all skill sets including coding, tool use, and reasoning. As the fastest model in the Anthropic lineup, it offers rapid response times suitable for applic\n anthropic/claude-3.5-haiku-20241022:\n max-input-char: 8192\n created: \"2024-11-04\"\n moderated: true\n alias: '[\"claude-3.5-haiku-20241022\"]'\n description: '* Claude 3.5 Haiku features enhancements across all skill sets including coding, tool use, and reasoning. As the fastest model in the Anthropic lineup, it offers rapid response times suitable for applic'\n neversleep/llama-3.1-lumimaid-70b:\n max-input-char: 2048\n created: \"2024-10-22\"\n moderated: false\n alias: '[\"llama-3.1-lumimaid-70b\"]'\n description: Lumimaid v0.2 70B is a finetune of [Llama 3.1 70B](/meta-llama/llama-3.1-70b-instruct) with a \"HUGE step up dataset wise\" compared to Lumimaid v0.1. Sloppy chats output were purged. - - Usage of this mod\n anthracite-org/magnum-v4-72b:\n max-input-char: 1024\n created: \"2024-10-22\"\n moderated: false\n alias: '[\"magnum-v4-72b\"]'\n description: This is a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet(https://openrouter.ai/anthropic/claude-3.5-sonnet) and Opus(https://openrouter.ai/anthrop\n anthropic/claude-3.5-sonnet:beta:\n max-input-char: 8192\n created: \"2024-10-22\"\n moderated: false\n alias: '[\"claude-3.5-sonnet:beta\"]'\n description: 'New Claude 3.5 Sonnet delivers better-than-Opus capabilities, faster-than-Sonnet speeds, at the same Sonnet prices. Sonnet is particularly good at: - - - Coding: Scores ~49% on SWE-Bench Verified, higher'\n anthropic/claude-3.5-sonnet:\n max-input-char: 8192\n created: \"2024-10-22\"\n moderated: true\n alias: '[\"claude-3.5-sonnet\"]'\n description: '* New Claude 3.5 Sonnet delivers better-than-Opus capabilities, faster-than-Sonnet speeds, at the same Sonnet prices. Sonnet is particularly good at: - - - Coding: Scores ~49% on SWE-Bench Verified, higher'\n x-ai/grok-beta:\n max-input-char: null\n created: \"2024-10-20\"\n moderated: false\n alias: '[\"grok-beta\"]'\n description: 'Grok Beta is xAI''s experimental language model with state-of-the-art reasoning capabilities, best for complex and multi-step use cases. - - It is the successor of [Grok 2](https://x.ai/blog/grok-2) with '\n qwen/qwen-2.5-7b-instruct:free:\n max-input-char: 32768\n created: \"2024-10-16\"\n moderated: false\n alias: '[\"qwen-2.5-7b-instruct:free\"]'\n description: 'Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - - - Significantly more knowledge and has greatly improved capabilities in coding and'\n qwen/qwen-2.5-7b-instruct:\n max-input-char: 8192\n created: \"2024-10-16\"\n moderated: false\n alias: '[\"qwen-2.5-7b-instruct\"]'\n description: 'Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - - - Significantly more knowledge and has greatly improved capabilities in coding and'\n nvidia/llama-3.1-nemotron-70b-instruct:free:\n max-input-char: null\n created: \"2024-10-15\"\n moderated: false\n alias: '[\"llama-3.1-nemotron-70b-instruct:free\"]'\n description: NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging [Llama 3.1 70B](/models/meta-llama/llama-3.1-70b-instruct) architecture and Reinfor\n nvidia/llama-3.1-nemotron-70b-instruct:\n max-input-char: 131000\n created: \"2024-10-15\"\n moderated: false\n alias: '[\"llama-3.1-nemotron-70b-instruct\"]'\n description: NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging [Llama 3.1 70B](/models/meta-llama/llama-3.1-70b-instruct) architecture and Reinfor\n inflection/inflection-3-productivity:\n max-input-char: 1024\n created: \"2024-10-11\"\n moderated: false\n alias: '[\"inflection-3-productivity\"]'\n description: Inflection 3 Productivity is optimized for following instructions. It is better for tasks requiring JSON output or precise adherence to provided guidelines. It has access to recent news. - - For emotiona\n inflection/inflection-3-pi:\n max-input-char: 1024\n created: \"2024-10-11\"\n moderated: false\n alias: '[\"inflection-3-pi\"]'\n description: Inflection 3 Pi powers Inflection's [Pi](https://pi.ai) chatbot, including backstory, emotional intelligence, productivity, and safety. It has access to recent news, and excels in scenarios like custo\n thedrummer/rocinante-12b:\n max-input-char: null\n created: \"2024-09-30\"\n moderated: false\n alias: '[\"rocinante-12b\"]'\n description: 'Rocinante 12B is designed for engaging storytelling and rich prose. - - Early testers have reported: - - Expanded vocabulary with unique and expressive word choices - - Enhanced creativity for vivid narrativ'\n anthracite-org/magnum-v2-72b:\n max-input-char: null\n created: \"2024-09-30\"\n moderated: false\n alias: '[\"magnum-v2-72b\"]'\n description: 'From the maker of [Goliath](https://openrouter.ai/models/alpindale/goliath-120b), Magnum 72B is the seventh in a family of models designed to achieve the prose quality of the Claude 3 models, notably '\n liquid/lfm-40b:\n max-input-char: null\n created: \"2024-09-30\"\n moderated: false\n alias: '[\"lfm-40b\"]'\n description: Liquid's 40.3B Mixture of Experts (MoE) model. Liquid Foundation Models (LFMs) are large neural networks built with computational units rooted in dynamic systems. - - LFMs are general-purpose AI models t\n meta-llama/llama-3.2-3b-instruct:free:\n max-input-char: 20000\n created: \"2024-09-25\"\n moderated: false\n alias: '[\"llama-3.2-3b-instruct:free\"]'\n description: 'Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with '\n meta-llama/llama-3.2-3b-instruct:\n max-input-char: 131000\n created: \"2024-09-25\"\n moderated: false\n alias: '[\"llama-3.2-3b-instruct\"]'\n description: 'Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with '\n meta-llama/llama-3.2-1b-instruct:free:\n max-input-char: 131072\n created: \"2024-09-25\"\n moderated: false\n alias: '[\"llama-3.2-1b-instruct:free\"]'\n description: 'Llama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its smaller size allows '\n meta-llama/llama-3.2-1b-instruct:\n max-input-char: null\n created: \"2024-09-25\"\n moderated: false\n alias: '[\"llama-3.2-1b-instruct\"]'\n description: 'Llama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its smaller size allows '\n meta-llama/llama-3.2-90b-vision-instruct:\n max-input-char: 4096\n created: \"2024-09-25\"\n moderated: false\n alias: '[\"llama-3.2-90b-vision-instruct\"]'\n description: The Llama 90B Vision model is a top-tier, 90-billion-parameter multimodal model designed for the most challenging visual reasoning and language tasks. It offers unparalleled accuracy in image captioni\n meta-llama/llama-3.2-11b-vision-instruct:free:\n max-input-char: 2048\n created: \"2024-09-25\"\n moderated: false\n alias: '[\"llama-3.2-11b-vision-instruct:free\"]'\n description: Llama 3.2 11B Vision is a multimodal model with 11 billion parameters, designed to handle tasks combining visual and textual data. It excels in tasks such as image captioning and visual question answe\n meta-llama/llama-3.2-11b-vision-instruct:\n max-input-char: 8192\n created: \"2024-09-25\"\n moderated: false\n alias: '[\"llama-3.2-11b-vision-instruct\"]'\n description: Llama 3.2 11B Vision is a multimodal model with 11 billion parameters, designed to handle tasks combining visual and textual data. It excels in tasks such as image captioning and visual question answe\n qwen/qwen-2.5-72b-instruct:free:\n max-input-char: null\n created: \"2024-09-19\"\n moderated: false\n alias: '[\"qwen-2.5-72b-instruct:free\"]'\n description: 'Qwen2.5 72B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - - - Significantly more knowledge and has greatly improved capabilities in coding an'\n qwen/qwen-2.5-72b-instruct:\n max-input-char: 8192\n created: \"2024-09-19\"\n moderated: false\n alias: '[\"qwen-2.5-72b-instruct\"]'\n description: 'Qwen2.5 72B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - - - Significantly more knowledge and has greatly improved capabilities in coding an'\n qwen/qwen-2.5-vl-72b-instruct:\n max-input-char: null\n created: \"2024-09-18\"\n moderated: false\n alias: '[\"qwen-2.5-vl-72b-instruct\"]'\n description: 'Qwen2.5 VL 72B is a multimodal LLM from the Qwen Team with the following key enhancements: - - - SoTA understanding of images of various resolution & ratio: Qwen2.5-VL achieves state-of-the-art performan'\n neversleep/llama-3.1-lumimaid-8b:\n max-input-char: 2048\n created: \"2024-09-15\"\n moderated: false\n alias: '[\"llama-3.1-lumimaid-8b\"]'\n description: Lumimaid v0.2 8B is a finetune of [Llama 3.1 8B](/models/meta-llama/llama-3.1-8b-instruct) with a \"HUGE step up dataset wise\" compared to Lumimaid v0.1. Sloppy chats output were purged. - - Usage of this\n cohere/command-r-plus-08-2024:\n max-input-char: 4000\n created: \"2024-08-30\"\n moderated: false\n alias: '[\"command-r-plus-08-2024\"]'\n description: 'command-r-plus-08-2024 is an update of the [Command R+](/models/cohere/command-r-plus) with roughly 50% higher throughput and 25% lower latencies as compared to the previous Command R+ version, while '\n cohere/command-r-08-2024:\n max-input-char: 4000\n created: \"2024-08-30\"\n moderated: false\n alias: '[\"command-r-08-2024\"]'\n description: 'command-r-08-2024 is an update of the [Command R](/models/cohere/command-r) with improved performance for multilingual retrieval-augmented generation (RAG) and tool use. More broadly, it is better at '\n qwen/qwen-2.5-vl-7b-instruct:free:\n max-input-char: 64000\n created: \"2024-08-28\"\n moderated: false\n alias: '[\"qwen-2.5-vl-7b-instruct:free\"]'\n description: 'Qwen2.5 VL 7B is a multimodal LLM from the Qwen Team with the following key enhancements: - - - SoTA understanding of images of various resolution & ratio: Qwen2.5-VL achieves state-of-the-art performanc'\n qwen/qwen-2.5-vl-7b-instruct:\n max-input-char: null\n created: \"2024-08-28\"\n moderated: false\n alias: '[\"qwen-2.5-vl-7b-instruct\"]'\n description: 'Qwen2.5 VL 7B is a multimodal LLM from the Qwen Team with the following key enhancements: - - - SoTA understanding of images of various resolution & ratio: Qwen2.5-VL achieves state-of-the-art performanc'\n sao10k/l3.1-euryale-70b:\n max-input-char: 8192\n created: \"2024-08-28\"\n moderated: false\n alias: '[\"l3.1-euryale-70b\"]'\n description: Euryale L3.1 70B v2.2 is a model focused on creative roleplay from [Sao10k](https://ko-fi.com/sao10k). It is the successor of [Euryale L3 70B v2.1](/models/sao10k/l3-euryale-70b).\n ai21/jamba-1-5-mini:\n max-input-char: 4096\n created: \"2024-08-23\"\n moderated: false\n alias: '[\"jamba-1-5-mini\"]'\n description: Jamba 1.5 Mini is the world's first production-grade Mamba-based model, combining SSM and Transformer architectures for a 256K context window and high efficiency. - - It works with 9 languages and can ha\n ai21/jamba-1-5-large:\n max-input-char: 4096\n created: \"2024-08-23\"\n moderated: false\n alias: '[\"jamba-1-5-large\"]'\n description: Jamba 1.5 Large is part of AI21's new family of open models, offering superior speed, efficiency, and quality. - - It features a 256K effective context window, the longest among open models, enabling imp\n microsoft/phi-3.5-mini-128k-instruct:\n max-input-char: null\n created: \"2024-08-21\"\n moderated: false\n alias: '[\"phi-3.5-mini-128k-instruct\"]'\n description: 'Phi-3.5 models are lightweight, state-of-the-art open models. These models were trained with Phi-3 datasets that include both synthetic data and the filtered, publicly available websites data, with a '\n nousresearch/hermes-3-llama-3.1-70b:\n max-input-char: 131000\n created: \"2024-08-18\"\n moderated: false\n alias: '[\"hermes-3-llama-3.1-70b\"]'\n description: Hermes 3 is a generalist language model with many improvements over [Hermes 2](/models/nousresearch/nous-hermes-2-mistral-7b-dpo), including advanced agentic capabilities, much better roleplaying, rea\n nousresearch/hermes-3-llama-3.1-405b:\n max-input-char: 131000\n created: \"2024-08-16\"\n moderated: false\n alias: '[\"hermes-3-llama-3.1-405b\"]'\n description: Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coheren\n sao10k/l3-lunaris-8b:\n max-input-char: null\n created: \"2024-08-13\"\n moderated: false\n alias: '[\"l3-lunaris-8b\"]'\n description: Lunaris 8B is a versatile generalist and roleplaying model based on Llama 3. It's a strategic merge of multiple models, designed to balance creativity with improved logic and general knowledge. - - Creat\n aetherwiing/mn-starcannon-12b:\n max-input-char: 4096\n created: \"2024-08-13\"\n moderated: false\n alias: '[\"mn-starcannon-12b\"]'\n description: Starcannon 12B v2 is a creative roleplay and story writing model, based on Mistral Nemo, using [nothingiisreal/mn-celeste-12b](/nothingiisreal/mn-celeste-12b) as a base, with [intervitens/mini-magnum-\n meta-llama/llama-3.1-405b:\n max-input-char: null\n created: \"2024-08-02\"\n moderated: false\n alias: '[\"llama-3.1-405b\"]'\n description: Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This is the base 405B pre-trained version. - - It has demonstrated strong performance compared to leading closed-sourc\n nothingiisreal/mn-celeste-12b:\n max-input-char: 4096\n created: \"2024-08-02\"\n moderated: false\n alias: '[\"mn-celeste-12b\"]'\n description: A specialized story writing and roleplaying model based on Mistral's NeMo 12B Instruct. Fine-tuned on curated datasets including Reddit Writing Prompts and Opus Instruct 25K. - - This model excels at cre\n perplexity/llama-3.1-sonar-small-128k-online:\n max-input-char: null\n created: \"2024-08-01\"\n moderated: false\n alias: '[\"llama-3.1-sonar-small-128k-online\"]'\n description: Llama 3.1 Sonar is Perplexity's latest model family. It surpasses their earlier Sonar models in cost-efficiency, speed, and performance. - - This is the online version of the [offline chat model](/models\n perplexity/llama-3.1-sonar-large-128k-online:\n max-input-char: null\n created: \"2024-08-01\"\n moderated: false\n alias: '[\"llama-3.1-sonar-large-128k-online\"]'\n description: Llama 3.1 Sonar is Perplexity's latest model family. It surpasses their earlier Sonar models in cost-efficiency, speed, and performance. - - This is the online version of the [offline chat model](/models\n meta-llama/llama-3.1-8b-instruct:free:\n max-input-char: 4096\n created: \"2024-07-23\"\n moderated: false\n alias: '[\"llama-3.1-8b-instruct:free\"]'\n description: Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. - - It has demonstrated strong performance compared to leading c\n meta-llama/llama-3.1-8b-instruct:\n max-input-char: 8192\n created: \"2024-07-23\"\n moderated: false\n alias: '[\"llama-3.1-8b-instruct\"]'\n description: Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. - - It has demonstrated strong performance compared to leading c\n meta-llama/llama-3.1-405b-instruct:\n max-input-char: 8192\n created: \"2024-07-23\"\n moderated: false\n alias: '[\"llama-3.1-405b-instruct\"]'\n description: 'The highly anticipated 400B class of Llama3 is here! Clocking in at 128k context with impressive eval scores, the Meta AI team continues to push the frontier of open-source LLMs. - - Meta''s latest class '\n meta-llama/llama-3.1-70b-instruct:\n max-input-char: 8192\n created: \"2024-07-23\"\n moderated: false\n alias: '[\"llama-3.1-70b-instruct\"]'\n description: Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. - - It has demonstrated strong perfor\n alpindale/magnum-72b:\n max-input-char: 1024\n created: \"2024-07-11\"\n moderated: false\n alias: '[\"magnum-72b\"]'\n description: From the maker of [Goliath](https://openrouter.ai/models/alpindale/goliath-120b), Magnum 72B is the first in a new family of models designed to achieve the prose quality of the Claude 3 models, notabl\n 01-ai/yi-large:\n max-input-char: 4096\n created: \"2024-06-25\"\n moderated: false\n alias: '[\"yi-large\"]'\n description: 'The Yi Large model was designed by 01.AI with the following usecases in mind: knowledge search, data classification, human-like chat bots, and customer service. - - It stands out for its multilingual pro'\n ai21/jamba-instruct:\n max-input-char: 4096\n created: \"2024-06-25\"\n moderated: false\n alias: '[\"jamba-instruct\"]'\n description: The Jamba-Instruct model, introduced by AI21 Labs, is an instruction-tuned variant of their hybrid SSM-Transformer Jamba model, specifically optimized for enterprise applications. - - - 256K Context Wind\n anthropic/claude-3.5-sonnet-20240620:beta:\n max-input-char: 8192\n created: \"2024-06-20\"\n moderated: false\n alias: '[\"claude-3.5-sonnet-20240620:beta\"]'\n description: 'Claude 3.5 Sonnet delivers better-than-Opus capabilities, faster-than-Sonnet speeds, at the same Sonnet prices. Sonnet is particularly good at: - - - Coding: Autonomously writes, edits, and runs code wit'\n anthropic/claude-3.5-sonnet-20240620:\n max-input-char: 8192\n created: \"2024-06-20\"\n moderated: true\n alias: '[\"claude-3.5-sonnet-20240620\"]'\n description: '* Claude 3.5 Sonnet delivers better-than-Opus capabilities, faster-than-Sonnet speeds, at the same Sonnet prices. Sonnet is particularly good at: - - - Coding: Autonomously writes, edits, and runs code wit'\n sao10k/l3-euryale-70b:\n max-input-char: 8192\n created: \"2024-06-18\"\n moderated: false\n alias: '[\"l3-euryale-70b\"]'\n description: Euryale 70B v2.1 is a model focused on creative roleplay from [Sao10k](https://ko-fi.com/sao10k). - - - Better prompt adherence. - - Better anatomy / spatial awareness. - - Adapts much better to unique and c\n cognitivecomputations/dolphin-mixtral-8x22b:\n max-input-char: null\n created: \"2024-06-08\"\n moderated: false\n alias: '[\"dolphin-mixtral-8x22b\"]'\n description: Dolphin 2.9 is designed for instruction following, conversational, and coding. This model is a finetune of [Mixtral 8x22B Instruct](/models/mistralai/mixtral-8x22b-instruct). It features a 64k context\n qwen/qwen-2-72b-instruct:\n max-input-char: 4096\n created: \"2024-06-07\"\n moderated: false\n alias: '[\"qwen-2-72b-instruct\"]'\n description: Qwen2 72B is a transformer-based model that excels in language understanding, multilingual capabilities, coding, mathematics, and reasoning. - - It features SwiGLU activation, attention QKV bias, and gro\n nousresearch/hermes-2-pro-llama-3-8b:\n max-input-char: 131000\n created: \"2024-05-27\"\n moderated: false\n alias: '[\"hermes-2-pro-llama-3-8b\"]'\n description: Hermes 2 Pro is an upgraded, retrained version of Nous Hermes 2, consisting of an updated and cleaned version of the OpenHermes 2.5 Dataset, as well as a newly introduced Function Calling and JSON Mod\n microsoft/phi-3-mini-128k-instruct:\n max-input-char: null\n created: \"2024-05-26\"\n moderated: false\n alias: '[\"phi-3-mini-128k-instruct\"]'\n description: Phi-3 Mini is a powerful 3.8B parameter model designed for advanced language understanding, reasoning, and instruction following. Optimized through supervised fine-tuning and preference adjustments, i\n microsoft/phi-3-medium-128k-instruct:\n max-input-char: null\n created: \"2024-05-24\"\n moderated: false\n alias: '[\"phi-3-medium-128k-instruct\"]'\n description: Phi-3 128K Medium is a powerful 14-billion parameter model designed for advanced language understanding, reasoning, and instruction following. Optimized through supervised fine-tuning and preference a\n neversleep/llama-3-lumimaid-70b:\n max-input-char: 2048\n created: \"2024-05-16\"\n moderated: false\n alias: '[\"llama-3-lumimaid-70b\"]'\n description: The NeverSleep team is back, with a Llama 3 70B finetune trained on their curated roleplay data. Striking a balance between eRP and RP, Lumimaid was designed to be serious, yet uncensored when necessa\n meta-llama/llama-guard-2-8b:\n max-input-char: null\n created: \"2024-05-13\"\n moderated: false\n alias: '[\"llama-guard-2-8b\"]'\n description: This safeguard model has 8B parameters and is based on the Llama 3 family. Just like is predecessor, [LlamaGuard 1](https://huggingface.co/meta-llama/LlamaGuard-7b), it can do both prompt and response\n neversleep/llama-3-lumimaid-8b:extended:\n max-input-char: 2048\n created: \"2024-05-04\"\n moderated: false\n alias: '[\"llama-3-lumimaid-8b:extended\"]'\n description: The NeverSleep team is back, with a Llama 3 8B finetune trained on their curated roleplay data. Striking a balance between eRP and RP, Lumimaid was designed to be serious, yet uncensored when necessar\n neversleep/llama-3-lumimaid-8b:\n max-input-char: 2048\n created: \"2024-05-04\"\n moderated: false\n alias: '[\"llama-3-lumimaid-8b\"]'\n description: The NeverSleep team is back, with a Llama 3 8B finetune trained on their curated roleplay data. Striking a balance between eRP and RP, Lumimaid was designed to be serious, yet uncensored when necessar\n sao10k/fimbulvetr-11b-v2:\n max-input-char: 4096\n created: \"2024-04-21\"\n moderated: false\n alias: '[\"fimbulvetr-11b-v2\"]'\n description: Creative writing model, routed with permission. It's fast, it keeps the conversation going, and it stays in character. - - If you submit a raw prompt, you can use Alpaca or Vicuna formats.\n meta-llama/llama-3-8b-instruct:\n max-input-char: 8192\n created: \"2024-04-18\"\n moderated: false\n alias: '[\"llama-3-8b-instruct\"]'\n description: Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases. - - It has demonstrated strong performa\n meta-llama/llama-3-70b-instruct:\n max-input-char: 8192\n created: \"2024-04-18\"\n moderated: false\n alias: '[\"llama-3-70b-instruct\"]'\n description: Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. - - It has demonstrated strong perform\n microsoft/wizardlm-2-8x22b:\n max-input-char: 8192\n created: \"2024-04-16\"\n moderated: false\n alias: '[\"wizardlm-2-8x22b\"]'\n description: WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state\n microsoft/wizardlm-2-7b:\n max-input-char: null\n created: \"2024-04-16\"\n moderated: false\n alias: '[\"wizardlm-2-7b\"]'\n description: WizardLM-2 7B is the smaller variant of Microsoft AI's latest Wizard model. It is the fastest and achieves comparable performance with existing 10x larger opensource leading models - - It is a finetune o\n cohere/command-r-plus:\n max-input-char: 4000\n created: \"2024-04-04\"\n moderated: false\n alias: '[\"command-r-plus\"]'\n description: Command R+ is a new, 104B-parameter LLM from Cohere. It's useful for roleplay, general consumer usecases, and Retrieval Augmented Generation (RAG). - - It offers multilingual support for ten key language\n cohere/command-r-plus-04-2024:\n max-input-char: 4000\n created: \"2024-04-02\"\n moderated: false\n alias: '[\"command-r-plus-04-2024\"]'\n description: Command R+ is a new, 104B-parameter LLM from Cohere. It's useful for roleplay, general consumer usecases, and Retrieval Augmented Generation (RAG). - - It offers multilingual support for ten key language\n sophosympatheia/midnight-rose-70b:\n max-input-char: null\n created: \"2024-03-22\"\n moderated: false\n alias: '[\"midnight-rose-70b\"]'\n description: A merge with a complex family tree, this model was crafted for roleplaying and storytelling. Midnight Rose is a successor to Rogue Rose and Aurora Nights and improves upon them both. It wants to produ\n cohere/command:\n max-input-char: 4000\n created: \"2024-03-14\"\n moderated: false\n alias: '[\"command\"]'\n description: 'Command is an instruction-following conversational model that performs language tasks with high quality, more reliably and with a longer context than our base generative models. - - Use of this model is '\n cohere/command-r:\n max-input-char: 4000\n created: \"2024-03-14\"\n moderated: false\n alias: '[\"command-r\"]'\n description: 'Command-R is a 35B parameter model that performs conversational language tasks at a higher quality, more reliably, and with a longer context than previous models. It can be used for complex workflows '\n anthropic/claude-3-haiku:beta:\n max-input-char: 4096\n created: \"2024-03-13\"\n moderated: false\n alias: '[\"claude-3-haiku:beta\"]'\n description: Claude 3 Haiku is Anthropic's fastest and most compact model for - near-instant responsiveness. Quick and accurate targeted performance. - - See the launch announcement and benchmark results [here](https:/\n anthropic/claude-3-haiku:\n max-input-char: 4096\n created: \"2024-03-13\"\n moderated: true\n alias: '[\"claude-3-haiku\"]'\n description: '* Claude 3 Haiku is Anthropic''s fastest and most compact model for - near-instant responsiveness. Quick and accurate targeted performance. - - See the launch announcement and benchmark results [here](https:/'\n anthropic/claude-3-opus:beta:\n max-input-char: 4096\n created: \"2024-03-05\"\n moderated: false\n alias: '[\"claude-3-opus:beta\"]'\n description: Claude 3 Opus is Anthropic's most powerful model for highly complex tasks. It boasts top-level performance, intelligence, fluency, and understanding. - - See the launch announcement and benchmark results\n anthropic/claude-3-opus:\n max-input-char: 4096\n created: \"2024-03-05\"\n moderated: true\n alias: '[\"claude-3-opus\"]'\n description: '* Claude 3 Opus is Anthropic''s most powerful model for highly complex tasks. It boasts top-level performance, intelligence, fluency, and understanding. - - See the launch announcement and benchmark results'\n anthropic/claude-3-sonnet:beta:\n max-input-char: 4096\n created: \"2024-03-05\"\n moderated: false\n alias: '[\"claude-3-sonnet:beta\"]'\n description: 'Claude 3 Sonnet is an ideal balance of intelligence and speed for enterprise workloads. Maximum utility at a lower price, dependable, balanced for scaled deployments. - - See the launch announcement and '\n anthropic/claude-3-sonnet:\n max-input-char: 4096\n created: \"2024-03-05\"\n moderated: true\n alias: '[\"claude-3-sonnet\"]'\n description: '* Claude 3 Sonnet is an ideal balance of intelligence and speed for enterprise workloads. Maximum utility at a lower price, dependable, balanced for scaled deployments. - - See the launch announcement and '\n cohere/command-r-03-2024:\n max-input-char: 4000\n created: \"2024-03-02\"\n moderated: false\n alias: '[\"command-r-03-2024\"]'\n description: 'Command-R is a 35B parameter model that performs conversational language tasks at a higher quality, more reliably, and with a longer context than previous models. It can be used for complex workflows '\n nousresearch/nous-hermes-2-mixtral-8x7b-dpo:\n max-input-char: 2048\n created: \"2024-01-16\"\n moderated: false\n alias: '[\"nous-hermes-2-mixtral-8x7b-dpo\"]'\n description: Nous Hermes 2 Mixtral 8x7B DPO is the new flagship Nous Research model trained over the [Mixtral 8x7B MoE LLM](/models/mistralai/mixtral-8x7b). - - The model was trained on over 1,000,000 entries of prim\n\n openai:\n base-url: https://api.openai.com/v1\n api-key-env: OPENAI_KEY1\n models:\n gpt-4.1:\n max-input-char: 32768\n created: \"2025-04-14\"\n moderated: true\n alias: '[\"gpt-4.1\"]'\n description: '* GPT-4.1 is a flagship large language model optimized for advanced instruction following, real-world software engineering, and long-context reasoning. It supports a 1 million token context window and o'\n gpt-4.1-mini:\n max-input-char: 32768\n created: \"2025-04-14\"\n moderated: true\n alias: '[\"gpt-4.1-mini\"]'\n description: '* GPT-4.1 Mini is a mid-sized model delivering performance competitive with GPT-4o at substantially lower latency and cost. It retains a 1 million token context window and scores 45.1% on hard instructi'\n gpt-4.1-nano:\n max-input-char: 32768\n created: \"2025-04-14\"\n moderated: true\n alias: '[\"gpt-4.1-nano\"]'\n description: '* For tasks that demand low latency, GPT‑4.1 nano is the fastest and cheapest model in the GPT-4.1 series. It delivers exceptional performance at a small size with its 1 million token context window, an'\n o1-pro:\n max-input-char: 100000\n created: \"2025-03-19\"\n moderated: true\n alias: '[\"o1-pro\"]'\n description: '* The o1 series of models are trained with reinforcement learning to think before they answer and perform complex reasoning. The o1-pro model uses more compute to think harder and provide consistently b'\n gpt-4o-mini-search-preview:\n max-input-char: 16384\n created: \"2025-03-12\"\n moderated: true\n alias: '[\"gpt-4o-mini-search-preview\"]'\n description: '* GPT-4o mini Search Preview is a specialized model for web search in Chat Completions. It is trained to understand and execute web search queries.'\n gpt-4o-search-preview:\n max-input-char: 16384\n created: \"2025-03-12\"\n moderated: true\n alias: '[\"gpt-4o-search-preview\"]'\n description: '* GPT-4o Search Previewis a specialized model for web search in Chat Completions. It is trained to understand and execute web search queries.'\n gpt-4.5-preview:\n max-input-char: 16384\n created: \"2025-02-27\"\n moderated: true\n alias: '[\"gpt-4.5-preview\"]'\n description: '* GPT-4.5 (Preview) is a research preview of OpenAI’s latest language model, designed to advance capabilities in reasoning, creativity, and multi-turn conversation. It builds on previous iterations with'\n o3-mini-high:\n max-input-char: 100000\n created: \"2025-02-12\"\n moderated: true\n alias: '[\"o3-mini-high\"]'\n description: '* OpenAI o3-mini-high is the same model as [o3-mini](/o3-mini) with reasoning_effort set to high. - - o3-mini is a cost-efficient language model optimized for STEM reasoning tasks, particularly exc'\n o3-mini:\n max-input-char: 100000\n created: \"2025-01-31\"\n moderated: true\n alias: '[\"o3-mini\"]'\n description: '* OpenAI o3-mini is a cost-efficient language model optimized for STEM reasoning tasks, particularly excelling in science, mathematics, and coding. - - This model supports the `reasoning_effort` parameter,'\n o1:\n max-input-char: 100000\n created: \"2024-12-17\"\n moderated: true\n alias: '[\"o1\"]'\n description: '* The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. The o1 model series is trained with large-scale reinforcement learning to reason using '\n gpt-4o-2024-11-20:\n max-input-char: 16384\n created: \"2024-11-20\"\n moderated: true\n alias: '[\"gpt-4o-2024-11-20\"]'\n description: '* The 2024-11-20 version of GPT-4o offers a leveled-up creative writing ability with more natural, engaging, and tailored writing to improve relevance & readability. It’s also better at working with upl'\n o1-mini-2024-09-12:\n max-input-char: 65536\n created: \"2024-09-12\"\n moderated: true\n alias: '[\"o1-mini-2024-09-12\"]'\n description: '* The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. - - The o1 models are optimized for math, science, programming, and other STEM-related tas'\n o1-preview:\n max-input-char: 32768\n created: \"2024-09-12\"\n moderated: true\n alias: '[\"o1-preview\"]'\n description: '* The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. - - The o1 models are optimized for math, science, programming, and other STEM-related tas'\n o1-preview-2024-09-12:\n max-input-char: 32768\n created: \"2024-09-12\"\n moderated: true\n alias: '[\"o1-preview-2024-09-12\"]'\n description: '* The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. - - The o1 models are optimized for math, science, programming, and other STEM-related tas'\n o1-mini:\n max-input-char: 65536\n created: \"2024-09-12\"\n moderated: true\n alias: '[\"o1-mini\"]'\n description: '* The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. - - The o1 models are optimized for math, science, programming, and other STEM-related tas'\n chatgpt-4o-latest:\n max-input-char: 16384\n created: \"2024-08-14\"\n moderated: true\n alias: '[\"chatgpt-4o-latest\"]'\n description: '* OpenAI ChatGPT 4o is continually updated by OpenAI to point to the current version of GPT-4o used by ChatGPT. It therefore differs slightly from the API version of [GPT-4o](/models/gpt-4o) in t'\n gpt-4o-2024-08-06:\n max-input-char: 16384\n created: \"2024-08-06\"\n moderated: true\n alias: '[\"gpt-4o-2024-08-06\"]'\n description: '* The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more [here](https://openai.com/index/introducin'\n gpt-4o-mini-2024-07-18:\n max-input-char: 16384\n created: \"2024-07-18\"\n moderated: true\n alias: '[\"gpt-4o-mini-2024-07-18\"]'\n description: '* GPT-4o mini is OpenAI''s newest model after [GPT-4 Omni](/models/gpt-4o), supporting both text and image inputs with text outputs. - - As their most advanced small model, it is many multiples more '\n gpt-4o-mini:\n max-input-char: 16384\n created: \"2024-07-18\"\n moderated: true\n alias: '[\"gpt-4o-mini\"]'\n description: '* GPT-4o mini is OpenAI''s newest model after [GPT-4 Omni](/models/gpt-4o), supporting both text and image inputs with text outputs. - - As their most advanced small model, it is many multiples more '\n gpt-4o-2024-05-13:\n max-input-char: 4096\n created: \"2024-05-13\"\n moderated: true\n alias: '[\"gpt-4o-2024-05-13\"]'\n description: '* GPT-4o (\"o\" for \"omni\") is OpenAI''s latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/gpt-4-turbo) while bei'\n gpt-4o:\n max-input-char: 16384\n created: \"2024-05-13\"\n moderated: true\n alias: '[\"gpt-4o\"]'\n description: '* GPT-4o (\"o\" for \"omni\") is OpenAI''s latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/gpt-4-turbo) while bei'\n gpt-4o:extended:\n max-input-char: 64000\n created: \"2024-05-13\"\n moderated: true\n alias: '[\"gpt-4o:extended\"]'\n description: '* GPT-4o (\"o\" for \"omni\") is OpenAI''s latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/gpt-4-turbo) while bei'\n gpt-4-turbo:\n max-input-char: 4096\n created: \"2024-04-09\"\n moderated: true\n alias: '[\"gpt-4-turbo\"]'\n description: '* The latest GPT-4 Turbo model with vision capabilities. Vision requests can now use JSON mode and function calling. - - Training data: up to December 2023.'\n gpt-3.5-turbo-0613:\n max-input-char: 4096\n created: \"2024-01-25\"\n moderated: false\n alias: '[\"gpt-3.5-turbo-0613\"]'\n description: GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. - - Training data up to Sep 2021.\n gpt-4-turbo-preview:\n max-input-char: 4096\n created: \"2024-01-25\"\n moderated: true\n alias: '[\"gpt-4-turbo-preview\"]'\n description: '* The preview GPT-4 model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more. Training data: up to Dec 2023. - - **Note:** heavily rate limited by Ope'\n gpt-4-1106-preview:\n max-input-char: 4096\n created: \"2023-11-06\"\n moderated: true\n alias: '[\"gpt-4-1106-preview\"]'\n description: '* The latest GPT-4 Turbo model with vision capabilities. Vision requests can now use JSON mode and function calling. - - Training data: up to April 2023.'\n gpt-3.5-turbo-1106:\n max-input-char: 4096\n created: \"2023-11-06\"\n moderated: true\n alias: '[\"gpt-3.5-turbo-1106\"]'\n description: '* An older GPT-3.5 Turbo model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more. Training data: up to Sep 2021.'\n gpt-3.5-turbo-instruct:\n max-input-char: 4096\n created: \"2023-09-28\"\n moderated: true\n alias: '[\"gpt-3.5-turbo-instruct\"]'\n description: '* This model is a variant of GPT-3.5 Turbo tuned for instructional prompts and omitting chat-related optimizations. Training data: up to Sep 2021.'\n gpt-4-32k-0314:\n max-input-char: 4096\n created: \"2023-08-28\"\n moderated: true\n alias: '[\"gpt-4-32k-0314\"]'\n description: '* GPT-4-32k is an extended version of GPT-4, with the same capabilities but quadrupled context length, allowing for processing up to 40 pages of text in a single pass. This is particularly beneficial fo'\n gpt-3.5-turbo-16k:\n max-input-char: 4096\n created: \"2023-08-28\"\n moderated: true\n alias: '[\"gpt-3.5-turbo-16k\"]'\n description: '* This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up to Sep 2021.'\n gpt-4-32k:\n max-input-char: 4096\n created: \"2023-08-28\"\n moderated: true\n alias: '[\"gpt-4-32k\"]'\n description: '* GPT-4-32k is an extended version of GPT-4, with the same capabilities but quadrupled context length, allowing for processing up to 40 pages of text in a single pass. This is particularly beneficial fo'\n gpt-3.5-turbo-0125:\n max-input-char: 4096\n created: \"2023-05-28\"\n moderated: true\n alias: '[\"gpt-3.5-turbo-0125\"]'\n description: '* The latest GPT-3.5 Turbo model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more. Training data: up to Sep 2021. - - This version has a higher accu'\n gpt-4:\n max-input-char: 4096\n created: \"2023-05-28\"\n moderated: true\n alias: '[\"gpt-4\"]'\n description: '* OpenAI''s flagship model, GPT-4 is a large-scale multimodal language model capable of solving difficult problems with greater accuracy than previous models due to its broader general knowledge and adva'\n gpt-3.5-turbo:\n max-input-char: 4096\n created: \"2023-05-28\"\n moderated: true\n alias: '[\"gpt-3.5-turbo\"]'\n description: '* GPT-3.5 Turbo is OpenAI''s fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. - - Training data up to Sep 2021.'\n gpt-4-0314:\n max-input-char: 4096\n created: \"2023-05-28\"\n moderated: true\n alias: '[\"gpt-4-0314\"]'\n description: '* GPT-4-0314 is the first version of GPT-4 released, with a context length of 8,192 tokens, and was supported until June 14. Training data: up to Sep 2021.'\n\n # gpt-4o: \n # aliases: [\"openai:gpt-4o\"]\n # max-input-chars: 124500\n # gpt-4:\n # aliases: [\"openai:gpt-4\"]\n # max-input-chars: 124500\n # gpt-4-0125-preview:\n # aliases: [\"openai:gpt-4-0125-preview\"]\n # max-input-chars: 1392000\n # gpt-4-32k:\n # aliases: [\"openai:gpt-4-32k\"]\n # max-input-chars: 98000\n # gpt-4o-mini:\n # aliases: [\"openai:gpt4-mini\"]\n # max-input-chars: 12250\n # gpt-3.5:\n # aliases: [\"35\"]\n # max-input-chars: 12250\n anthropic:\n base-url: https://api.anthropic.com/v1\n api-key-env: ANTHROPIC_API_KEY\n models:\n claude-3-7-sonnet-20250219:\n description: \"Claude 3.7 Sonnet 2025-02-24T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"3-7-sonnet-20250219\"]\n claude-3-5-sonnet-20241022:\n description: \"Claude 3.5 Sonnet (New) 2024-10-22T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"3-5-sonnet-20241022\"]\n claude-3-5-haiku-20241022:\n description: \"Claude 3.5 Haiku 2024-10-22T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"3-5-haiku-20241022\"]\n claude-3-5-sonnet-20240620:\n description: \"Claude 3.5 Sonnet (Old) 2024-06-20T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"3-5-sonnet-20240620\"]\n claude-3-haiku-20240307:\n description: \"Claude 3 Haiku 2024-03-07T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"3-haiku-20240307\"]\n claude-3-opus-20240229:\n description: \"Claude 3 Opus 2024-02-29T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"3-opus-20240229\"]\n claude-3-sonnet-20240229:\n description: \"Claude 3 Sonnet 2024-02-29T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"3-sonnet-20240229\"]\n claude-2.1:\n description: \"Claude 2.1 2023-11-21T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"2.1\"]\n claude-2.0:\n description: \"Claude 2.0 2023-07-11T00:00:00Z\"\n max-input-chars: 16000\n alias: [\"2.0\"]\n # claude-3-5-sonnet-20240620:\n # aliases: [\"anthropic:claude-3.5\"]\n # max-input-chars: 30000\n # claude-3-haiku-20240307:\n # aliases: [\"anthropic:claude-3-haiku\"]\n # max-input-chars: 16384\n # claude-3-sonnet-20240229:\n # aliases: [\"anthropic:claude-3-sonnet\"]\n # max-input-chars: 16384\n # claude-3-opus-20240229:\t\n # aliases: [\"anthropic:claude-3-opus\"]\n # max-input-chars: 16384\n mistral:\n base-url: https://api.mistral.ai/v1\n api-key-env: MISTRAL_KEY\n models:\n mistral-medium-latest:\n aliases: [\"yoyo\"]\n max-input-chars: 300000\n mistral-large-latest:\n alias: [\"mistral-large\"]\n max-input-chars: 30000\n mistral-small-latest:\n alias: [\"mistral-small\"]\n max-input-chars: 30000\n mistral-tiny-latest:\n alias: [\"mistral-tiny\"]\n max-input-chars: 30000\n codestral-latest:\n alias: [\"codestral-latest\"]\n max-input-chars: 30000\n open-codestral-mamba:\n alias: [\"open-codestral\"]\n max-input-chars: 30000\n open-mixtral-8x22b:\n alias: [\"open-mixtral\"]\n max-input-chars: 30000\n open-mistral-7b:\n alias: [\"mistral-7b\"]\n max-input-chars: 30000\n # xai:\n # base-url: https://api.x.ai/v1\n # api-key-env: XAI_API_KEY\n # models:\n # grok-beta:\n # aliases: [\"xai-grok\"]\n # max-input-chars: 12250\n # groq:\n # base-url: https://api.groq.com/openai/v1\n # api-key-env: GROQ_API_KEY\n # models:\n # mixtral-8x7b-32768:\n # aliases: [\"groq:mixtral-8x32k\"]\n # max-input-chars: 98000\n # gemma-7b-it:\n # aliases: [\"groq:gemma-7b\"]\n # max-input-chars: 98000\n # llama3-70b-8192:\n # aliases: [\"groq:llama3-70b\"] \n # max-input-chars: 98000\n # llama2-70b-4096:\n # aliases: [\"groq:llama2-70b\"]\n # max-input-chars: 12250\n # ollama:\n # base-url: http://localhost:11434/api\n # models:\n # llama3:\n # aliases: [\"ollama3\"]\n # max-input-chars: 650000\n # gemma:\n # aliases: [\"ogemma\"]\n # max-input-chars: 650000\n deepseek:\n base-url: https://api.deepseek.com/\n api-key-env: DEEPSEEK_API_KEY\n models: #https://platform.deepseek.com/api-docs/api/list-models/\n deepseek-chat:\n aliases: [\"ds-chat\"]\n max-input-chars: 384000\n deepseek-code:\n aliases: [\"ds-code\"]\n max-input-chars: 384000\n google:\n api-key-env: GEMINI_API_KEY\n models: # https://ai.google.dev/gemini-api/docs/models/gemini\n gemini-2.5-pro:\n max-input-char: 65535\n created: \"2025-04-04\"\n moderated: false\n alias: '[\"gemini-2.5-pro-preview-03-25\"]'\n description: Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through respo\n gemini-2.5-pro-preview-03-25:\n max-input-char: 65535\n created: \"2025-04-04\"\n moderated: false\n alias: '[\"gemini-2.5-pro-preview-03-25\"]'\n description: Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through respo\n gemini-2.5-pro-exp-03-25:free:\n max-input-char: 65535\n created: \"2025-03-25\"\n moderated: false\n alias: '[\"gemini-2.5-pro-exp-03-25:free\"]'\n description: Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through respo\n gemma-3-1b-it:free:\n max-input-char: 8192\n created: \"2025-03-14\"\n moderated: false\n alias: '[\"gemma-3-1b-it:free\"]'\n description: Gemma 3 1B is the smallest of the new Gemma 3 family. It handles context windows up to 32k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including\n gemma-3-4b-it:free:\n max-input-char: 8192\n created: \"2025-03-13\"\n moderated: false\n alias: '[\"gemma-3-4b-it:free\"]'\n description: 'Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, '\n gemma-3-4b-it:\n max-input-char: null\n created: \"2025-03-13\"\n moderated: false\n alias: '[\"gemma-3-4b-it\"]'\n description: 'Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, '\n gemma-3-12b-it:free:\n max-input-char: 8192\n created: \"2025-03-13\"\n moderated: false\n alias: '[\"gemma-3-12b-it:free\"]'\n description: 'Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, '\n gemma-3-12b-it:\n max-input-char: null\n created: \"2025-03-13\"\n moderated: false\n alias: '[\"gemma-3-12b-it\"]'\n description: 'Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, '\n gemma-3-27b-it:free:\n max-input-char: 8192\n created: \"2025-03-12\"\n moderated: false\n alias: '[\"gemma-3-27b-it:free\"]'\n description: 'Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, '\n gemma-3-27b-it:\n max-input-char: 8192\n created: \"2025-03-12\"\n moderated: false\n alias: '[\"gemma-3-27b-it\"]'\n description: 'Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, '\n gemini-2.0-flash-lite-001:\n max-input-char: 8192\n created: \"2025-02-25\"\n moderated: false\n alias: '[\"gemini-2.0-flash-lite-001\"]'\n description: Gemini 2.0 Flash Lite offers a significantly faster time to first token (TTFT) compared to [Gemini Flash 1.5](/gemini-flash-1.5), while maintaining quality on par with larger models like [Gemin\n gemini-2.0-flash-001:\n max-input-char: 8192\n created: \"2025-02-05\"\n moderated: false\n alias: '[\"gemini-2.0-flash-001\"]'\n description: Gemini Flash 2.0 offers a significantly faster time to first token (TTFT) compared to [Gemini Flash 1.5](/gemini-flash-1.5), while maintaining quality on par with larger models like [Gemini Pro\n gemini-2.0-flash-thinking-exp:free:\n max-input-char: 65536\n created: \"2025-01-22\"\n moderated: false\n alias: '[\"gemini-2.0-flash-thinking-exp:free\"]'\n description: Gemini 2.0 Flash Thinking Experimental (01-21) is a snapshot of Gemini 2.0 Flash Thinking Experimental. - - Gemini 2.0 Flash Thinking Mode is an experimental model that's trained to generate the \"thinkin\n gemini-2.0-flash-thinking-exp-1219:free:\n max-input-char: 8000\n created: \"2024-12-19\"\n moderated: false\n alias: '[\"gemini-2.0-flash-thinking-exp-1219:free\"]'\n description: Gemini 2.0 Flash Thinking Mode is an experimental model that's trained to generate the \"thinking process\" the model goes through as part of its response. As a result, Thinking Mode is capable of stron\n gemini-2.0-flash-exp:free:\n max-input-char: 8192\n created: \"2024-12-11\"\n moderated: false\n alias: '[\"gemini-2.0-flash-exp:free\"]'\n description: Gemini Flash 2.0 offers a significantly faster time to first token (TTFT) compared to [Gemini Flash 1.5](/gemini-flash-1.5), while maintaining quality on par with larger models like [Gemini Pro\n learnlm-1.5-pro-experimental:free:\n max-input-char: 8192\n created: \"2024-11-21\"\n moderated: false\n alias: '[\"learnlm-1.5-pro-experimental:free\"]'\n description: An experimental version of [Gemini 1.5 Pro](/gemini-pro-1.5) from Google.\n gemini-flash-1.5-8b:\n max-input-char: 8192\n created: \"2024-10-03\"\n moderated: false\n alias: '[\"gemini-flash-1.5-8b\"]'\n description: Gemini Flash 1.5 8B is optimized for speed and efficiency, offering enhanced performance in small prompt tasks like chat, transcription, and translation. With reduced latency, it is highly effective f\n gemini-flash-1.5-8b-exp:\n max-input-char: 8192\n created: \"2024-08-28\"\n moderated: false\n alias: '[\"gemini-flash-1.5-8b-exp\"]'\n description: Gemini Flash 1.5 8B Experimental is an experimental, 8B parameter version of the [Gemini Flash 1.5](/models/gemini-flash-1.5) model. - - Usage of Gemini is subject to Google's [Gemini Terms of Use\n gemma-2-27b-it:\n max-input-char: 2048\n created: \"2024-07-13\"\n moderated: false\n alias: '[\"gemma-2-27b-it\"]'\n description: 'Gemma 2 27B by Google is an open model built from the same research and technology used to create the [Gemini models](/models?q=gemini). - - Gemma models are well-suited for a variety of text generation '\n gemma-2-9b-it:free:\n max-input-char: 8192\n created: \"2024-06-28\"\n moderated: false\n alias: '[\"gemma-2-9b-it:free\"]'\n description: Gemma 2 9B by Google is an advanced, open-source language model that sets a new standard for efficiency and performance in its size class. - - Designed for a wide variety of tasks, it empowers developers\n gemma-2-9b-it:\n max-input-char: null\n created: \"2024-06-28\"\n moderated: false\n alias: '[\"gemma-2-9b-it\"]'\n description: Gemma 2 9B by Google is an advanced, open-source language model that sets a new standard for efficiency and performance in its size class. - - Designed for a wide variety of tasks, it empowers developers\n gemini-flash-1.5:\n max-input-char: 8192\n created: \"2024-05-14\"\n moderated: false\n alias: '[\"gemini-flash-1.5\"]'\n description: Gemini 1.5 Flash is a foundation model that performs well at a variety of multimodal tasks such as visual understanding, classification, summarization, and creating content from image, audio and video\n gemini-pro-1.5:\n max-input-char: 8192\n created: \"2024-04-09\"\n moderated: false\n alias: '[\"gemini-pro-1.5\"]'\n description: 'Google''s latest multimodal model, supports image and video[0] in text or chat prompts. - - Optimized for language tasks including: - - - Code generation - - Text generation - - Text editing - - Problem solving - - '\n"}, "8b4dc028f8a65da9536c0951a2a82b02b9f11c56": {"t": 1785762513.530169, "n": 5696, "h": "ba3043463e6a43a6", "c": "# Default model (gpt-3.5-turbo, gpt-4, ggml-gpt4all-j...).\n# default-model: mistralai/mistral-medium #:ixtral-8x7b-32768\n# default-model: smc\n# default-model: mistral-medium-latest\n# default-model: gpt-4\n# default-model: claude-3-5-sonnet-20240620 #llama-3-sonar-small-32k-online\ndefault-model: grok-beta\n\n# Text to append when using the -f flag.\nformat-text:\n markdown: 'Format the response as markdown without enclosing backticks.'\n# json: 'Format the response as json without enclosing backticks.'\n# List of predefined system messages that can be used as roles.\nroles:\n \"default\": []\n# Ask for the response to be formatted as markdown unless otherwise set.\nformat: true\n# System role to use.\nrole: \"default\"\n# Render output as raw text when connected to a TTY.\nraw: false\n# Quiet mode (hide the spinner while loading and stderr messages for success).\nquiet: false\n# Temperature (randomness) of results, from 0.0 to 2.0.\ntemp: 1.0\n# TopP, an alternative to temperature that narrows response, from 0.0 to 1.0.\ntopp: 1.0\n# Turn off the client-side limit on the size of the input into the model.\nno-limit: false\n# Wrap formatted output at specific width (default is 80)\nword-wrap: 100\n# Include the prompt from the arguments in the response.\ninclude-prompt-args: false\n# Include the prompt from the arguments and stdin, truncate stdin to specified number of lines.\ninclude-prompt: 0\n# Maximum number of times to retry API calls.\nmax-retries: 1\n# Your desired level of fanciness.\nfanciness: 500\n# Text to show while generating.\nstatus-text: Generating\n# Default character limit on input to model.\nmax-input-chars: 12250\n# Maximum number of tokens in response.\nmax-tokens: 40000\ntheme: catppuccin\n# Aliases and endpoints for OpenAI compatible REST API.\napis:\n openai:\n base-url: https://api.openai.com/v1\n api-key-env: OPENAI_API_KEY\n models:\n gpt-4o: \n aliases: [\"openai:gpt-4o\"]\n max-input-chars: 124500\n gpt-4:\n aliases: [\"openai:gpt-4\"]\n max-input-chars: 124500\n gpt-4-0125-preview:\n aliases: [\"openai:gpt-4-0125-preview\"]\n max-input-chars: 1392000\n gpt-4-32k:\n aliases: [\"openai:gpt-4-32k\"]\n max-input-chars: 98000\n gpt-4o-mini:\n aliases: [\"openai:gpt4-mini\"]\n max-input-chars: 12250\n gpt-3.5:\n aliases: [\"35\"]\n max-input-chars: 12250\n anthropic:\n base-url: https://api.anthropic.com/v1\n # api-key-env: CLAUDE_KEY\n models:\n claude-3-5-sonnet-20240620:\n aliases: [\"anthropic:claude-3.5\"]\n max-input-chars: 30000\n claude-3-haiku-20240307:\n aliases: [\"anthropic:claude-3-haiku\"]\n max-input-chars: 16384\n claude-3-sonnet-20240229:\n aliases: [\"anthropic:claude-3-sonnet\"]\n max-input-chars: 16384\n claude-3-opus-20240229:\t\n aliases: [\"anthropic:claude-3-opus\"]\n max-input-chars: 16384\n mistral:\n base-url: https://api.mistral.ai/v1\n api-key-env: MISTRAL_KEY\n models:\n mistral-medium-latest:\n alias: [\"mistral-medium\"]\n max-input-chars: 300000\n mistral-large-latest:\n alias: [\"mistral-large\"]\n max-input-chars: 30000\n mistral-small-latest:\n alias: [\"mistral-small\"]\n max-input-chars: 30000\n mistral-tiny-latest:\n alias: [\"mistral-tiny\"]\n max-input-chars: 30000\n codestral-latest:\n alias: [\"codestral-latest\"]\n max-input-chars: 30000\n open-codestral-mamba:\n alias: [\"open-codestral\"]\n max-input-chars: 30000\n open-mixtral-8x22b:\n alias: [\"open-mixtral\"]\n max-input-chars: 30000\n open-mistral-7b:\n alias: [\"mistral-7b\"]\n max-input-chars: 30000\n # perplexity:\n # base-url: https://api.perplexity.ai\n # api-key:\n # api-key-env: PERPLEXITY_API_KEY\n # models:\n # llama-3-sonar-small-32k:\n # max-input-chars: 16384\n # llama-3-sonar-small-32k-online:\n # max-input-chars: 16384\n # fallback: gpt-4o\n # llama-3-sonar-large-32k-chat:\n # max-input-chars: 16384\n # llama-3-sonar-large-32k-online:\n # max-input-chars: 16384\n # llama-3-8b-instruct:\n # max-input-chars: 16384\n # llama-3-70b-instruct:\n # max-input-chars: 16384\n # mixtral-8x7b-instruct:\n # max-input-chars: 16384\n # https://api.groq.com/openai/v1/chat/completion\n xai:\n base-url: https://api.x.ai/v1\n api-key-env: XAI_API_KEY\n models:\n grok-beta:\n aliases: [\"xai-grok\"]\n max-input-chars: 12250\n groq:\n base-url: https://api.groq.com/openai/v1\n api-key-env: GROQ_API_KEY\n models:\n mixtral-8x7b-32768:\n aliases: [\"groq:mixtral-8x32k\"]\n max-input-chars: 98000\n gemma-7b-it:\n aliases: [\"groq:gemma-7b\"]\n max-input-chars: 98000\n llama3-70b-8192:\n aliases: [\"groq:llama3-70b\"] \n max-input-chars: 98000\n llama2-70b-4096:\n aliases: [\"groq:llama2-70b\"]\n max-input-chars: 12250\n ollama:\n base-url: http://localhost:11434/api\n models:\n llama3:\n aliases: [\"ollama3\"]\n max-input-chars: 650000\n gemma:\n aliases: [\"ogemma\"]\n max-input-chars: 650000\n # openrouter:\n # # Set to 'azure-ad' to use Active Directory\n # # Azure OpenAI setup: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/create-resource\n # base-url: https://openrouter.ai/api/v1\n # api-key-env: OPENROUTER_KEY\n # models:\n # mistralai/mistral-large:\n # max-input-chars: 114500\n # mistralai/mistral-medium:\n # max-input-chars: 12250\n # mistralai/mistral-tiny:\n # max-input-chars: 12250\n"}, "b3cf914b4c21ee68b3ebc9df300dbf01167746cf": {"t": 1785762514.6981409, "n": 4404, "h": "bd30711d65a569de", "c": "# Default model (gpt-3.5-turbo, gpt-4, ggml-gpt4all-j...).\n# default-model: mistralai/mistral-medium #:ixtral-8x7b-32768\n# default-model: smc\n#default-model: mixtral-8x7b-32768\ndefault-model: gpt-4o #llama-3-sonar-small-32k-online\n\n# Text to append when using the -f flag.\nformat-text:\n markdown: 'Format the response as markdown without enclosing backticks.'\n json: 'Format the response as json without enclosing backticks.'\n# List of predefined system messages that can be used as roles.\nroles:\n \"default\": []\n# Ask for the response to be formatted as markdown unless otherwise set.\nformat: true\n# System role to use.\nrole: \"default\"\n# Render output as raw text when connected to a TTY.\nraw: false\n# Quiet mode (hide the spinner while loading and stderr messages for success).\nquiet: false\n# Temperature (randomness) of results, from 0.0 to 2.0.\ntemp: 1.0\n# TopP, an alternative to temperature that narrows response, from 0.0 to 1.0.\ntopp: 1.0\n# Turn off the client-side limit on the size of the input into the model.\nno-limit: false\n# Wrap formatted output at specific width (default is 80)\nword-wrap: 80\n# Include the prompt from the arguments in the response.\ninclude-prompt-args: false\n# Include the prompt from the arguments and stdin, truncate stdin to specified number of lines.\ninclude-prompt: 0\n# Maximum number of times to retry API calls.\nmax-retries: 1\n# Your desired level of fanciness.\nfanciness: 10\n# Text to show while generating.\nstatus-text: Generating\n# Default character limit on input to model.\nmax-input-chars: 12250\n# Maximum number of tokens in response.\nmax-tokens: 1000\n# Aliases and endpoints for OpenAI compatible REST API.\napis:\n openai:\n base-url: https://api.openai.com/v1\n api-key-env: OPENAI_API_KEY\n models:\n gpt-4o: \n aliases: [\"openai:gpt-4o\"]\n max-input-chars: 124500\n gpt-4:\n aliases: [\"openai:gpt-4\"]\n max-input-chars: 124500\n gpt-4-0125-preview:\n aliases: [\"openai:gpt-4-0125-preview\"]\n max-input-chars: 1392000\n gpt-4-32k:\n aliases: [\"openai:gpt-4-32k\"]\n max-input-chars: 98000\n gpt-3.5-turbo:\n aliases: [\"openai:gpt-3.5-turbo\"]\n max-input-chars: 12250\n gpt-3.5:\n aliases: [\"35\"]\n max-input-chars: 12250\n anthropic:\n base-url: https://api.anthropic.com/v1\n api-key-env: CLAUDE_KEY\n models:\n claude-3-haiku-20240307:\n aliases: [\"anthropic:claude-3-haiku\"]\n max-input-chars: 16384\n claude-3-sonnet-20240229:\n aliases: [\"anthropic:claude-3-sonnet\"]\n max-input-chars: 16384\n claude-3-opus-20240229:\t\n aliases: [\"anthropic:claude-3-opus\"]\n max-input-chars: 16384\n perplexity:\n base-url: https://api.perplexity.ai\n api-key:\n api-key-env: PERPLEXITY_API_KEY\n models:\n llama-3-sonar-small-32k:\n max-input-chars: 16384\n llama-3-sonar-small-32k-online:\n max-input-chars: 16384\n fallback: gpt-4o\n llama-3-sonar-large-32k-chat:\n max-input-chars: 16384\n llama-3-sonar-large-32k-online:\n max-input-chars: 16384\n llama-3-8b-instruct:\n max-input-chars: 16384\n llama-3-70b-instruct:\n max-input-chars: 16384\n mixtral-8x7b-instruct:\n max-input-chars: 16384\n groq:\n base-url: https://api.groq.com/openai/v1\n api-key-env: GROQ_API_KEY\n models:\n mixtral-8x7b-32768:\n aliases: [\"groq:mixtral-8x32k\"]\n max-input-chars: 98000\n gemma-7b-it:\n aliases: [\"groq:gemma-7b\"]\n max-input-chars: 98000\n llama3-70b-8192:\n aliases: [\"groq:llama3-70b\"] \n max-input-chars: 98000\n llama2-70b-4096:\n aliases: [\"groq:llama2-70b\"]\n max-input-chars: 12250\n ollama:\n base-url: http://localhost:11434/api\n models:\n llama3:\n aliases: [\"ollama3\"]\n max-input-chars: 650000\n gemma:\n aliases: [\"ogemma\"]\n max-input-chars: 650000\n openrouter:\n # Set to 'azure-ad' to use Active Directory\n # Azure OpenAI setup: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/create-resource\n base-url: https://openrouter.ai/api/v1\n api-key-env: OPENROUTER_KEY\n models:\n mistralai/mistral-large:\n max-input-chars: 114500\n mistralai/mistral-medium:\n max-input-chars: 12250\n mistralai/mistral-tiny:\n max-input-chars: 12250\n"}, "8b7d77aa12d12e9840a7fa9e6a894ea49076e113": {"t": 1785762521.2764738, "n": 4174, "h": "790e81cb714ad37a", "c": "# Default model (gpt-3.5-turbo, gpt-4, ggml-gpt4all-j...).\ndefault-model: mixtral-8x7b-32768\n# Text to append when using the -f flag.\nformat-text:\n markdown: 'Format the response as markdown without enclosing backticks.'\n json: 'Format the response as json without enclosing backticks.'\n# List of predefined system messages that can be used as roles.\nroles:\n \"default\": []\n# Ask for the response to be formatted as markdown unless otherwise set.\nformat: true\n# System role to use.\nrole: \"default\"\n# Render output as raw text when connected to a TTY.\nraw: false\n# Quiet mode (hide the spinner while loading and stderr messages for success).\nquiet: false\n# Temperature (randomness) of results, from 0.0 to 2.0.\ntemp: 1.0\n# TopP, an alternative to temperature that narrows response, from 0.0 to 1.0.\ntopp: 1.0\n# Turn off the client-side limit on the size of the input into the model.\nno-limit: false\n# Wrap formatted output at specific width (default is 80)\nword-wrap: 80\n# Include the prompt from the arguments in the response.\ninclude-prompt-args: false\n# Include the prompt from the arguments and stdin, truncate stdin to specified number of lines.\ninclude-prompt: 0\n# Maximum number of times to retry API calls.\nmax-retries: 1\n# Your desired level of fanciness.\nfanciness: 10\n# Text to show while generating.\nstatus-text: Generating\n# Default character limit on input to model.\nmax-input-chars: 12250\n# Maximum number of tokens in response.\nmax-tokens: 1000\n# Aliases and endpoints for OpenAI compatible REST API.\napis:\n openai:\n base-url: https://api.openai.com/v1\n api-key-env: OPENAI_API_KEY\n models:\n gpt-4:\n aliases: [\"4\"]\n max-input-chars: 24500\n fallback: gpt-3.5-turbo\n gpt-4-1106-preview:\n aliases: [\"128k\"]\n max-input-chars: 392000\n fallback: gpt-4\n gpt-4-32k:\n aliases: [\"32k\"]\n max-input-chars: 98000\n fallback: gpt-4\n gpt-3.5-turbo:\n aliases: [\"35t\"]\n max-input-chars: 12250\n fallback: gpt-3.5\n gpt-3.5-turbo-1106:\n aliases: [\"35t-1106\"]\n max-input-chars: 12250\n fallback: gpt-3.5-turbo\n gpt-3.5-turbo-16k:\n aliases: [\"35t16k\"]\n max-input-chars: 44500\n fallback: gpt-3.5\n gpt-3.5:\n aliases: [\"35\"]\n max-input-chars: 12250\n fallback:\n perplexity:\n base-url: https://api.perplexity.ai\n api-key:\n api-key-env: PERPLEXITY_API_KEY\n models:\n codellama-70b-instruct:\n aliases: [\"codellama\"]\n max-input-chars: 16384\n mistral-7b-instruct:\n aliases: [\"mistral\"]\n max-input-chars: 16384\n mixtral-8x7b-instruct:\n aliases: [\"mixtral-8x\"]\n max-input-chars: 16384\n sonar-medium-online:\n aliases: [\"smo\", \"o\"]\n max-input-chars: 1200\n sonar-medium-chat:\n aliases: [\"smc\"]\n max-input-chars: 16384\n sonar-small-chat:\n aliases: [\"ssc\"]\n max-input-chars: 16384\n sonar-small-online:\n aliases: [\"sso\"]\n max-input-chars: 1200\n groq:\n base-url: https://api.groq.com/openai/v1\n api-key-env: GROQ_API_KEY\n models:\n mixtral-8x7b-32768:\n aliases: [\"mixtral\"]\n max-input-chars: 98000\n llama2-70b-4096:\n aliases: [\"llama2\"]\n max-input-chars: 12250\n ollama:\n # LocalAI setup instructions: https://github.com/go-skynet/LocalAI#example-use-gpt4all-j-model\n base-url: http://localhost:11434/v1\n api-key-env: NOPE\n models:\n llama3:\n aliases: [\"lloc3\"]\n max-input-chars: 12250\n fallback:\n azure:\n # Set to 'azure-ad' to use Active Directory\n # Azure OpenAI setup: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/create-resource\n base-url: https://YOUR_RESOURCE_NAME.openai.azure.com\n api-key:\n api-key-env: AZURE_OPENAI_KEY\n models:\n gpt-4:\n aliases: [\"az4\"]\n max-input-chars: 24500\n fallback: gpt-35-turbo\n gpt-35-turbo:\n aliases: [\"az35t\"]\n max-input-chars: 12250\n fallback: gpt-35\n gpt-35:\n aliases: [\"az35\"]\n max-input-chars: 12250\n fallback:\n"}, "c434af96773abc6ebaf9cda6e922ba7392830593": {"t": 1785762522.94624, "n": 4165, "h": "9386f60ef37feb33", "c": "# Default model (gpt-3.5-turbo, gpt-4, ggml-gpt4all-j...).\ndefault-model: mixtral-8x7b-32768\n# Text to append when using the -f flag.\nformat-text:\n markdown: 'Format the response as markdown without enclosing backticks.'\n json: 'Format the response as json without enclosing backticks.'\n# List of predefined system messages that can be used as roles.\nroles:\n \"default\": []\n# Ask for the response to be formatted as markdown unless otherwise set.\nformat: true\n# System role to use.\nrole: \"default\"\n# Render output as raw text when connected to a TTY.\nraw: false\n# Quiet mode (hide the spinner while loading and stderr messages for success).\nquiet: false\n# Temperature (randomness) of results, from 0.0 to 2.0.\ntemp: 1.0\n# TopP, an alternative to temperature that narrows response, from 0.0 to 1.0.\ntopp: 1.0\n# Turn off the client-side limit on the size of the input into the model.\nno-limit: false\n# Wrap formatted output at specific width (default is 80)\nword-wrap: 80\n# Include the prompt from the arguments in the response.\ninclude-prompt-args: false\n# Include the prompt from the arguments and stdin, truncate stdin to specified number of lines.\ninclude-prompt: 0\n# Maximum number of times to retry API calls.\nmax-retries: 1\n# Your desired level of fanciness.\nfanciness: 10\n# Text to show while generating.\nstatus-text: Generating\n# Default character limit on input to model.\nmax-input-chars: 12250\n# Maximum number of tokens in response.\nmax-tokens: 1000\n# Aliases and endpoints for OpenAI compatible REST API.\napis:\n openai:\n base-url: https://api.openai.com/v1\n api-key-env: OPENAI_API_KEY\n models:\n gpt-4:\n aliases: [\"4\"]\n max-input-chars: 24500\n fallback: gpt-3.5-turbo\n gpt-4-1106-preview:\n aliases: [\"128k\"]\n max-input-chars: 392000\n fallback: gpt-4\n gpt-4-32k:\n aliases: [\"32k\"]\n max-input-chars: 98000\n fallback: gpt-4\n gpt-3.5-turbo:\n aliases: [\"35t\"]\n max-input-chars: 12250\n fallback: gpt-3.5\n gpt-3.5-turbo-1106:\n aliases: [\"35t-1106\"]\n max-input-chars: 12250\n fallback: gpt-3.5-turbo\n gpt-3.5-turbo-16k:\n aliases: [\"35t16k\"]\n max-input-chars: 44500\n fallback: gpt-3.5\n gpt-3.5:\n aliases: [\"35\"]\n max-input-chars: 12250\n fallback:\n perplexity:\n base-url: https://api.perplexity.ai\n api-key:\n api-key-env: PERPLEXITY_API_KEY\n models:\n codellama-70b-instruct:\n aliases: [\"codellama\"]\n max-input-chars: 16384\n mistral-7b-instruct:\n aliases: [\"mistral\"]\n max-input-chars: 16384\n mixtral-8x7b-instruct:\n aliases: [\"mixtral-8x\"]\n max-input-chars: 16384\n sonar-medium-online:\n aliases: [\"smo\", \"o\"]\n max-input-chars: 1200\n sonar-medium-chat:\n aliases: [\"smc\"]\n max-input-chars: 16384\n sonar-small-chat:\n aliases: [\"ssc\"]\n max-input-chars: 16384\n sonar-small-online:\n aliases: [\"sso\"]\n max-input-chars: 1200\n groq:\n base-url: https://api.groq.com/openai/v1\n api-key-env: GROQ_API_KEY\n models:\n mixtral-8x7b-32768:\n aliases: [\"mixtral\"]\n max-input-chars: 98000\n llama2-70b-4096:\n aliases: [\"llama2\"]\n max-input-chars: 12250\n localai:\n # LocalAI setup instructions: https://github.com/go-skynet/LocalAI#example-use-gpt4all-j-model\n base-url: http://localhost:8080\n models:\n ggml-gpt4all-j:\n aliases: [\"local\", \"4all\"]\n max-input-chars: 12250\n fallback:\n azure:\n # Set to 'azure-ad' to use Active Directory\n # Azure OpenAI setup: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/create-resource\n base-url: https://YOUR_RESOURCE_NAME.openai.azure.com\n api-key:\n api-key-env: AZURE_OPENAI_KEY\n models:\n gpt-4:\n aliases: [\"az4\"]\n max-input-chars: 24500\n fallback: gpt-35-turbo\n gpt-35-turbo:\n aliases: [\"az35t\"]\n max-input-chars: 12250\n fallback: gpt-35\n gpt-35:\n aliases: [\"az35\"]\n max-input-chars: 12250\n fallback:\n"}}}} |