Supported Models (Gateway)

Models Accessible Through The Gateway

Martian's model router provides access to over 50 models from a single unified interface. This includes both major closed-source providers and open-source models. This page lists the models which are accessible through the model gateway. If you want to specify a subset of models to route to, see Supported Models (Router). The model router may route to a different, larger set of models than those listed either here or in Supported Models (Router) when no models are set.

OpenAI

Model	Streaming	Vision	Tools	Json Output	Json Content
gpt-3.5-turbo-1106	✅	❌	✅	✅	✅
gpt-3.5-turbo	✅	❌	✅	✅	✅
gpt-3.5-turbo-0125	✅	❌	✅	✅	✅
gpt-4-0314	✅	❌	❌	❌	✅
gpt-4-0125-preview	✅	❌	✅	✅	✅
gpt-4-32k-0613	✅	❌	✅	❌	✅
gpt-4-32k	✅	❌	✅	❌	✅
gpt-4-0613	✅	❌	✅	❌	✅
gpt-4	✅	❌	✅	❌	✅
gpt-4-vision-preview	✅	✅	❌	❌	✅
gpt-4-1106-preview	✅	❌	✅	✅	✅
gpt-4-turbo-preview	✅	❌	✅	❌	✅
gpt-4-0125-preview	✅	❌	✅	✅	✅
gpt-4-turbo-2024-04-09	✅	✅	✅	✅	✅
gpt-4-turbo	✅	✅	✅	✅	✅
gpt-4o-2024-05-13	✅	✅	✅	✅	✅
gpt-4o	✅	✅	✅	✅	✅

Anthropic

Model	Streaming	Vision	Tools	Json Output	Json Content
claude-1.0	✅	❌	❌	❌	✅
claude-1.1	✅	❌	❌	❌	✅
claude-1.2	✅	❌	❌	❌	✅
claude-1.3	✅	❌	❌	❌	✅
claude-instant-1.1	✅	❌	❌	❌	✅
claude-instant-1.2	✅	❌	❌	❌	✅
claude-2.0	✅	❌	❌	❌	✅
claude-2.1	✅	❌	❌	❌	✅
claude-3-sonnet-20240229	✅	❌	❌	❌	✅
claude-3-opus-20240229	✅	❌	❌	❌	✅
claude-3-haiku-20240307	✅	❌	❌	❌	✅

Together

Model	Streaming	Vision	Tools	Json Output	Json Content
Yi-34B-Chat	✅	❌	❌	❌	✅
OLMo-7B-Instruct	✅	❌	❌	❌	✅
OLMo-7B-Twin-2T	✅	❌	❌	❌	✅
OLMo-7B	✅	❌	❌	❌	✅
chronos-hermes-13b	✅	❌	❌	❌	✅
dolphin-2.5-mixtral-8x7b	✅	❌	❌	❌	✅
dbrx-instruct	✅	❌	❌	❌	✅
deepseek-coder-33b-instruct	✅	❌	❌	❌	✅
deepseek-llm-67b-chat	✅	❌	❌	❌	✅
Platypus2-70B-instruct	✅	❌	❌	❌	✅
gemma-2b-it	✅	❌	❌	❌	✅
gemma-7b-it	✅	❌	❌	❌	✅
MythoMax-L2-13b	✅	❌	❌	❌	✅
vicuna-13b-v1.5	✅	❌	❌	❌	✅
vicuna-7b-v1.5	✅	❌	❌	❌	✅
CodeLlama-7b-Instruct-hf	✅	❌	❌	❌	✅
CodeLlama-13b-Instruct-hf	✅	❌	❌	❌	✅
CodeLlama-34b-Instruct-hf	✅	❌	❌	❌	✅
Llama-2-7b-chat-hf	✅	❌	❌	❌	✅
Llama-2-13b-chat-hf	✅	❌	❌	❌	✅
Llama-2-70b-chat-hf	✅	❌	❌	❌	✅
Llama-3-8b-chat-hf	✅	❌	❌	❌	❌
Llama-3-70b-chat-hf	✅	❌	❌	❌	❌
Mistral-7B-Instruct-v0.1	✅	❌	❌	❌	✅
Mixtral-8x7B-Instruct-v0.1	✅	❌	❌	✅	✅
Mixtral-8x22B-Instruct-v0.1	✅	❌	❌	❌	✅
Mistral-7B-Instruct-v0.2	✅	❌	❌	❌	✅
Nous-Capybara-7B-V1p9	✅	❌	❌	❌	✅
Nous-Hermes-2-Mixtral-8x7B-DPO	✅	❌	❌	❌	✅
Nous-Hermes-2-Mixtral-8x7B-SFT	✅	❌	❌	❌	✅
Nous-Hermes-llama-2-7b	✅	❌	❌	❌	✅
Nous-Hermes-Llama2-13b	✅	❌	❌	❌	✅
Nous-Hermes-2-Yi-34B	✅	❌	❌	❌	✅
openchat-3.5-1210	✅	❌	❌	❌	✅
Mistral-7B-OpenOrca	✅	❌	❌	❌	✅
Qwen1.5-0.5B-Chat	✅	❌	❌	❌	✅
Qwen1.5-1.8B-Chat	✅	❌	❌	❌	✅
Qwen1.5-4B-Chat	✅	❌	❌	❌	✅
Qwen1.5-7B-Chat	✅	❌	❌	❌	✅
Qwen1.5-14B-Chat	✅	❌	❌	❌	✅
Qwen1.5-32B-Chat	✅	❌	❌	❌	✅
Qwen1.5-72B-Chat	✅	❌	❌	❌	✅
Snorkel-Mistral-PairRM-DPO	✅	❌	❌	❌	✅
alpaca-7b	✅	❌	❌	❌	✅
OpenHermes-2-Mistral-7B	✅	❌	❌	❌	✅
OpenHermes-2p5-Mistral-7B	✅	❌	❌	❌	✅
Llama-2-7B-32K-Instruct	✅	❌	❌	❌	✅
RedPajama-INCITE-Chat-3B-v1	✅	❌	❌	❌	✅
RedPajama-INCITE-7B-Chat	✅	❌	❌	❌	✅
StripedHyena-Nous-7B	✅	❌	❌	❌	✅
ReMM-SLERP-L2-13B	✅	❌	❌	❌	✅
Toppy-M-7B	✅	❌	❌	❌	✅
WizardLM-13B-V1.2	✅	❌	❌	❌	✅

Gemini

Model	Streaming	Vision	Tools	Json Output	Json Content
gemini/gemini/gemini-1.0-pro	❌	❌	❌	❌	❌
gemini/gemini/gemini-1.5-pro-latest	❌	❌	❌	❌	❌

Groq

Model	Streaming	Vision	Tools	Json Output	Json Content
groq/mistralai/mixtral-8x7b-32768	✅	❌	❌	❌	❌
groq/meta-llama/llama3-70b-8192	✅	❌	❌	❌	❌
groq/meta-llama/llama3-8b-8192	✅	❌	❌	❌	❌
groq/google/gemma-7b-it	✅	❌	❌	❌	❌

Anyscale

Model	Streaming	Vision	Tools	Json Output	Json Content
anyscale/google/gemma-7b-it	✅	❌	❌	❌	❌
anyscale/meta-llama/Llama-2-7b-chat-hf	✅	❌	❌	❌	❌
anyscale/meta-llama/Llama-2-13b-chat-hf	✅	❌	❌	❌	❌
anyscale/meta-llama/Llama-2-70b-chat-hf	✅	❌	❌	❌	❌
anyscale/meta-llama/Meta-Llama-3-70B-Instruct	✅	❌	❌	❌	❌
anyscale/meta-llama/Meta-Llama-3-8B-Instruct	✅	❌	❌	❌	❌
anyscale/Open-Orca/Mistral-7B-OpenOrca	✅	❌	❌	❌	❌
anyscale/codellama/CodeLlama-34b-Instruct-hf	✅	❌	❌	❌	❌
anyscale/codellama/CodeLlama-70b-Instruct-hf	✅	❌	❌	❌	❌
anyscale/HuggingFaceH4/zephyr-7b-beta	✅	❌	❌	❌	❌
anyscale/mistralai/Mistral-7B-Instruct-v0.1	✅	❌	❌	❌	❌
anyscale/mistralai/Mixtral-8x7B-Instruct-v0.1	✅	❌	❌	❌	❌
anyscale/mistralai/Mixtral-8x22B-Instruct-v0.1	✅	❌	❌	❌	❌
anyscale/mlabonne/NeuralHermes-2.5-Mistral-7B	✅	❌	❌	❌	❌
anyscale/meta-llama/Llama-3-8b-chat-hf	✅	❌	❌	❌	❌
anyscale/meta-llama/Llama-3-70b-chat-hf	✅	❌	❌	❌	❌

Lepton

Model	Streaming	Vision	Tools	Json Output	Json Content
lepton/google/gemma-7b	✅	❌	❌	❌	❌
lepton/mistralai/mistral-7b	✅	❌	❌	❌	❌
lepton/mistralai/mixtral-8x22b	✅	❌	❌	❌	❌
lepton/mistralai/mixtral-8x7b	✅	❌	❌	❌	❌

Moonshot

Model	Streaming	Vision	Tools	Json Output	Json Content
moonshot/moonshot/moonshot-v1-8k	✅	❌	❌	❌	❌
moonshot/moonshot/moonshot-v1-32k	✅	❌	❌	❌	❌
moonshot/moonshot/moonshot-v1-128k	✅	❌	❌	❌	❌

Perplexity

Model	Streaming	Vision	Tools	Json Output	Json Content
perplexity/perplexity/llama-3-70b-instruct	✅	❌	❌	❌	❌
perplexity/perplexity/llama-3-8b-instruct	✅	❌	❌	❌	❌
perplexity/perplexity/sonar-small-chat	✅	❌	❌	❌	❌
perplexity/perplexity/sonar-small-online	✅	❌	❌	❌	❌
perplexity/perplexity/sonar-medium-chat	✅	❌	❌	❌	❌
perplexity/perplexity/sonar-medium-online	✅	❌	❌	❌	❌
perplexity/perplexity/codellama-70b-instruct	✅	❌	❌	❌	❌
perplexity/perplexity/mistral-7b-instruct	✅	❌	❌	❌	❌
perplexity/perplexity/mixtral-8x7b-instruct	✅	❌	❌	❌	❌

Cohere

Model	Streaming	Vision	Tools	Json Output	Json Content
cohere/cohere/command-r	✅	❌	❌	❌	✅
cohere/cohere/command-r-plus	✅	❌	❌	❌	✅

OpenRouter

Model	Streaming	Vision	Tools	Json Output	Json Content
openrouter/databricks/dbrx-instruct	✅	❌	❌	❌	❌
openrouter/google/gemma-7b-it	✅	❌	❌	❌	❌
openrouter/meta-llama/llama-3-70b-instruct	✅	❌	❌	❌	❌
openrouter/meta-llama/llama-3-8b-instruct	✅	❌	❌	❌	❌
openrouter/mistralai/mistral-7b-instruct	✅	❌	❌	❌	❌
openrouter/mistralai/mixtral-8x7b-instruct	✅	❌	❌	❌	❌
openrouter/mistralai/mixtral-8x22b-instruct	✅	❌	❌	❌	❌
openrouter/pygmalionai/mythalion-13b	✅	❌	❌	❌	❌

DeepInfra

Model	Streaming	Vision	Tools	Json Output	Json Content
deepinfra/google/gemma-1.1-7b-it	✅	❌	❌	❌	❌
deepinfra/mistralai/Mistral-7B-Instruct-v0.2	✅	❌	❌	❌	❌
deepinfra/mistralai/Mixtral-8x7B-Instruct-v0.1	✅	❌	❌	❌	❌
deepinfra/mistralai/Mixtral-8x22B-Instruct-v0.1	✅	❌	❌	❌	❌
deepinfra/databricks/dbrx-instruct	✅	❌	❌	❌	❌
deepinfra/meta-llama/Meta-Llama-3-70B-Instruct	✅	❌	❌	❌	❌
deepinfra/meta-llama/Meta-Llama-3-8B-Instruct	✅	❌	❌	❌	❌

Fireworks

Model	Streaming	Vision	Tools	Json Output	Json Content
fireworks/accounts/fireworks/models/gemma-7b-it	✅	❌	❌	❌	❌
fireworks/accounts/fireworks/models/dbrx-instruct	✅	❌	❌	❌	❌
fireworks/accounts/fireworks/models/llama-v3-8b-instruct	✅	❌	❌	❌	❌
fireworks/accounts/fireworks/models/llama-v3-70b-instruct	✅	❌	❌	❌	❌
fireworks/accounts/fireworks/models/mistral-7b-instruct-4k	✅	❌	❌	❌	❌
fireworks/accounts/fireworks/models/mistral-7b-instruct-v0p2	✅	❌	❌	❌	❌
fireworks/accounts/fireworks/models/mixtral-8x22b-instruct	✅	❌	❌	❌	❌
fireworks/accounts/fireworks/models/mixtral-8x7b-instruct	✅	❌	❌	❌	❌

Octoai

Model	Streaming	Vision	Tools	Json Output	Json Content
octoai/meta-llama/meta-llama-3-8b-instruct	✅	❌	❌	❌	❌