Supported Models (Gateway)
Models Accessible Through The Gateway
Martian's model router provides access to over 50 models from a single unified interface. This includes both major closed-source providers and open-source models. This page lists the models which are accessible through the model gateway. If you want to specify a subset of models to route to, see Supported Models (Router). The model router may route to a different, larger set of models than those listed either here or in Supported Models (Router) when no models are set.
OpenAI
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
gpt-3.5-turbo-1106 | ✅ | ❌ | ✅ | ✅ | ✅ |
gpt-3.5-turbo | ✅ | ❌ | ✅ | ✅ | ✅ |
gpt-3.5-turbo-0125 | ✅ | ❌ | ✅ | ✅ | ✅ |
gpt-4-0314 | ✅ | ❌ | ❌ | ❌ | ✅ |
gpt-4-0125-preview | ✅ | ❌ | ✅ | ✅ | ✅ |
gpt-4-32k-0613 | ✅ | ❌ | ✅ | ❌ | ✅ |
gpt-4-32k | ✅ | ❌ | ✅ | ❌ | ✅ |
gpt-4-0613 | ✅ | ❌ | ✅ | ❌ | ✅ |
gpt-4 | ✅ | ❌ | ✅ | ❌ | ✅ |
gpt-4-vision-preview | ✅ | ✅ | ❌ | ❌ | ✅ |
gpt-4-1106-preview | ✅ | ❌ | ✅ | ✅ | ✅ |
gpt-4-turbo-preview | ✅ | ❌ | ✅ | ❌ | ✅ |
gpt-4-0125-preview | ✅ | ❌ | ✅ | ✅ | ✅ |
gpt-4-turbo-2024-04-09 | ✅ | ✅ | ✅ | ✅ | ✅ |
gpt-4-turbo | ✅ | ✅ | ✅ | ✅ | ✅ |
gpt-4o-2024-05-13 | ✅ | ✅ | ✅ | ✅ | ✅ |
gpt-4o | ✅ | ✅ | ✅ | ✅ | ✅ |
Anthropic
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
claude-1.0 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-1.1 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-1.2 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-1.3 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-instant-1.1 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-instant-1.2 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-2.0 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-2.1 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-3-sonnet-20240229 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-3-opus-20240229 | ✅ | ❌ | ❌ | ❌ | ✅ |
claude-3-haiku-20240307 | ✅ | ❌ | ❌ | ❌ | ✅ |
Together
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
Yi-34B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
OLMo-7B-Instruct | ✅ | ❌ | ❌ | ❌ | ✅ |
OLMo-7B-Twin-2T | ✅ | ❌ | ❌ | ❌ | ✅ |
OLMo-7B | ✅ | ❌ | ❌ | ❌ | ✅ |
chronos-hermes-13b | ✅ | ❌ | ❌ | ❌ | ✅ |
dolphin-2.5-mixtral-8x7b | ✅ | ❌ | ❌ | ❌ | ✅ |
dbrx-instruct | ✅ | ❌ | ❌ | ❌ | ✅ |
deepseek-coder-33b-instruct | ✅ | ❌ | ❌ | ❌ | ✅ |
deepseek-llm-67b-chat | ✅ | ❌ | ❌ | ❌ | ✅ |
Platypus2-70B-instruct | ✅ | ❌ | ❌ | ❌ | ✅ |
gemma-2b-it | ✅ | ❌ | ❌ | ❌ | ✅ |
gemma-7b-it | ✅ | ❌ | ❌ | ❌ | ✅ |
MythoMax-L2-13b | ✅ | ❌ | ❌ | ❌ | ✅ |
vicuna-13b-v1.5 | ✅ | ❌ | ❌ | ❌ | ✅ |
vicuna-7b-v1.5 | ✅ | ❌ | ❌ | ❌ | ✅ |
CodeLlama-7b-Instruct-hf | ✅ | ❌ | ❌ | ❌ | ✅ |
CodeLlama-13b-Instruct-hf | ✅ | ❌ | ❌ | ❌ | ✅ |
CodeLlama-34b-Instruct-hf | ✅ | ❌ | ❌ | ❌ | ✅ |
Llama-2-7b-chat-hf | ✅ | ❌ | ❌ | ❌ | ✅ |
Llama-2-13b-chat-hf | ✅ | ❌ | ❌ | ❌ | ✅ |
Llama-2-70b-chat-hf | ✅ | ❌ | ❌ | ❌ | ✅ |
Llama-3-8b-chat-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
Llama-3-70b-chat-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
Mistral-7B-Instruct-v0.1 | ✅ | ❌ | ❌ | ❌ | ✅ |
Mixtral-8x7B-Instruct-v0.1 | ✅ | ❌ | ❌ | ✅ | ✅ |
Mixtral-8x22B-Instruct-v0.1 | ✅ | ❌ | ❌ | ❌ | ✅ |
Mistral-7B-Instruct-v0.2 | ✅ | ❌ | ❌ | ❌ | ✅ |
Nous-Capybara-7B-V1p9 | ✅ | ❌ | ❌ | ❌ | ✅ |
Nous-Hermes-2-Mixtral-8x7B-DPO | ✅ | ❌ | ❌ | ❌ | ✅ |
Nous-Hermes-2-Mixtral-8x7B-SFT | ✅ | ❌ | ❌ | ❌ | ✅ |
Nous-Hermes-llama-2-7b | ✅ | ❌ | ❌ | ❌ | ✅ |
Nous-Hermes-Llama2-13b | ✅ | ❌ | ❌ | ❌ | ✅ |
Nous-Hermes-2-Yi-34B | ✅ | ❌ | ❌ | ❌ | ✅ |
openchat-3.5-1210 | ✅ | ❌ | ❌ | ❌ | ✅ |
Mistral-7B-OpenOrca | ✅ | ❌ | ❌ | ❌ | ✅ |
Qwen1.5-0.5B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
Qwen1.5-1.8B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
Qwen1.5-4B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
Qwen1.5-7B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
Qwen1.5-14B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
Qwen1.5-32B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
Qwen1.5-72B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
Snorkel-Mistral-PairRM-DPO | ✅ | ❌ | ❌ | ❌ | ✅ |
alpaca-7b | ✅ | ❌ | ❌ | ❌ | ✅ |
OpenHermes-2-Mistral-7B | ✅ | ❌ | ❌ | ❌ | ✅ |
OpenHermes-2p5-Mistral-7B | ✅ | ❌ | ❌ | ❌ | ✅ |
Llama-2-7B-32K-Instruct | ✅ | ❌ | ❌ | ❌ | ✅ |
RedPajama-INCITE-Chat-3B-v1 | ✅ | ❌ | ❌ | ❌ | ✅ |
RedPajama-INCITE-7B-Chat | ✅ | ❌ | ❌ | ❌ | ✅ |
StripedHyena-Nous-7B | ✅ | ❌ | ❌ | ❌ | ✅ |
ReMM-SLERP-L2-13B | ✅ | ❌ | ❌ | ❌ | ✅ |
Toppy-M-7B | ✅ | ❌ | ❌ | ❌ | ✅ |
WizardLM-13B-V1.2 | ✅ | ❌ | ❌ | ❌ | ✅ |
Gemini
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
gemini/gemini/gemini-1.0-pro | ❌ | ❌ | ❌ | ❌ | ❌ |
gemini/gemini/gemini-1.5-pro-latest | ❌ | ❌ | ❌ | ❌ | ❌ |
Groq
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
groq/mistralai/mixtral-8x7b-32768 | ✅ | ❌ | ❌ | ❌ | ❌ |
groq/meta-llama/llama3-70b-8192 | ✅ | ❌ | ❌ | ❌ | ❌ |
groq/meta-llama/llama3-8b-8192 | ✅ | ❌ | ❌ | ❌ | ❌ |
groq/google/gemma-7b-it | ✅ | ❌ | ❌ | ❌ | ❌ |
Anyscale
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
anyscale/google/gemma-7b-it | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/meta-llama/Llama-2-7b-chat-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/meta-llama/Llama-2-13b-chat-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/meta-llama/Llama-2-70b-chat-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/meta-llama/Meta-Llama-3-70B-Instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/meta-llama/Meta-Llama-3-8B-Instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/Open-Orca/Mistral-7B-OpenOrca | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/codellama/CodeLlama-34b-Instruct-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/codellama/CodeLlama-70b-Instruct-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/HuggingFaceH4/zephyr-7b-beta | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/mistralai/Mistral-7B-Instruct-v0.1 | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/mistralai/Mixtral-8x7B-Instruct-v0.1 | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/mistralai/Mixtral-8x22B-Instruct-v0.1 | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/mlabonne/NeuralHermes-2.5-Mistral-7B | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/meta-llama/Llama-3-8b-chat-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
anyscale/meta-llama/Llama-3-70b-chat-hf | ✅ | ❌ | ❌ | ❌ | ❌ |
Lepton
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
lepton/google/gemma-7b | ✅ | ❌ | ❌ | ❌ | ❌ |
lepton/mistralai/mistral-7b | ✅ | ❌ | ❌ | ❌ | ❌ |
lepton/mistralai/mixtral-8x22b | ✅ | ❌ | ❌ | ❌ | ❌ |
lepton/mistralai/mixtral-8x7b | ✅ | ❌ | ❌ | ❌ | ❌ |
Moonshot
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
moonshot/moonshot/moonshot-v1-8k | ✅ | ❌ | ❌ | ❌ | ❌ |
moonshot/moonshot/moonshot-v1-32k | ✅ | ❌ | ❌ | ❌ | ❌ |
moonshot/moonshot/moonshot-v1-128k | ✅ | ❌ | ❌ | ❌ | ❌ |
Perplexity
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
perplexity/perplexity/llama-3-70b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
perplexity/perplexity/llama-3-8b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
perplexity/perplexity/sonar-small-chat | ✅ | ❌ | ❌ | ❌ | ❌ |
perplexity/perplexity/sonar-small-online | ✅ | ❌ | ❌ | ❌ | ❌ |
perplexity/perplexity/sonar-medium-chat | ✅ | ❌ | ❌ | ❌ | ❌ |
perplexity/perplexity/sonar-medium-online | ✅ | ❌ | ❌ | ❌ | ❌ |
perplexity/perplexity/codellama-70b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
perplexity/perplexity/mistral-7b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
perplexity/perplexity/mixtral-8x7b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
Cohere
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
cohere/cohere/command-r | ✅ | ❌ | ❌ | ❌ | ✅ |
cohere/cohere/command-r-plus | ✅ | ❌ | ❌ | ❌ | ✅ |
OpenRouter
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
openrouter/databricks/dbrx-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
openrouter/google/gemma-7b-it | ✅ | ❌ | ❌ | ❌ | ❌ |
openrouter/meta-llama/llama-3-70b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
openrouter/meta-llama/llama-3-8b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
openrouter/mistralai/mistral-7b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
openrouter/mistralai/mixtral-8x7b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
openrouter/mistralai/mixtral-8x22b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
openrouter/pygmalionai/mythalion-13b | ✅ | ❌ | ❌ | ❌ | ❌ |
DeepInfra
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
deepinfra/google/gemma-1.1-7b-it | ✅ | ❌ | ❌ | ❌ | ❌ |
deepinfra/mistralai/Mistral-7B-Instruct-v0.2 | ✅ | ❌ | ❌ | ❌ | ❌ |
deepinfra/mistralai/Mixtral-8x7B-Instruct-v0.1 | ✅ | ❌ | ❌ | ❌ | ❌ |
deepinfra/mistralai/Mixtral-8x22B-Instruct-v0.1 | ✅ | ❌ | ❌ | ❌ | ❌ |
deepinfra/databricks/dbrx-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
deepinfra/meta-llama/Meta-Llama-3-70B-Instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
deepinfra/meta-llama/Meta-Llama-3-8B-Instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
Fireworks
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
fireworks/accounts/fireworks/models/gemma-7b-it | ✅ | ❌ | ❌ | ❌ | ❌ |
fireworks/accounts/fireworks/models/dbrx-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
fireworks/accounts/fireworks/models/llama-v3-8b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
fireworks/accounts/fireworks/models/llama-v3-70b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
fireworks/accounts/fireworks/models/mistral-7b-instruct-4k | ✅ | ❌ | ❌ | ❌ | ❌ |
fireworks/accounts/fireworks/models/mistral-7b-instruct-v0p2 | ✅ | ❌ | ❌ | ❌ | ❌ |
fireworks/accounts/fireworks/models/mixtral-8x22b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
fireworks/accounts/fireworks/models/mixtral-8x7b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
Octoai
Model | Streaming | Vision | Tools | Json Output | Json Content |
---|---|---|---|---|---|
octoai/meta-llama/meta-llama-3-8b-instruct | ✅ | ❌ | ❌ | ❌ | ❌ |
Last updated