Choose a model - Writer AI Studio
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
This guide helps you choose between Writer’s Palmyra models and external provider models when building agents in AI Studio. Both options are available through the Models page in AI Studio.
Palmyra models
Writer’s Palmyra models are pre-configured and immediately available in AI Studio. The Palmyra family includes:
| Model | Best for |
|---|---|
| Palmyra X5 | General-purpose tasks with advanced reasoning, including financial, medical, and creative use cases |
| Palmyra X4 | Complex tasks requiring extended context |
For detailed capabilities, context windows, and use cases, see Palmyra models. For pricing, see Palmyra pricing.
External models
You can also add models from external providers like AWS Bedrock or Microsoft Azure (Azure OpenAI) to use alongside Palmyra models. External models require credential configuration but provide access to models like Claude, Llama, Mistral, and Azure-hosted OpenAI models.
| Provider | Status | Setup guide |
|---|---|---|
| AWS Bedrock | Available | Configure AWS Bedrock |
| Microsoft Azure | Available | Configure Microsoft Azure |
| NVIDIA NIM | Available | Configure NVIDIA NIM |
| Baseten | Coming soon | — |
For information about adding and managing external models, see Add external models.
Compare Palmyra and external models
Consider the following factors when selecting models for your agents:
| Consideration | Palmyra models | External models |
|---|---|---|
| Setup | Pre-configured, immediately available | Requires credential configuration |
| Optimization | Optimized for Writer platform | Varies by provider |
| Specialized domains | Palmyra X5 covers general-purpose, financial, medical, and creative use cases | General-purpose models |
| Compliance | Writer-managed compliance | You manage provider compliance |
| Billing | Unified billing through Writer | Billed by provider (for example, AWS) |
| Cost visibility | Included in Writer dashboard | Tracked in Writer + provider billing |
When to use Palmyra models
Palmyra models are the best choice when you need:
- Domain-specific capabilities: Palmyra X5 covers general-purpose, financial, medical, and creative use cases
- Simplified billing: All usage appears on your Writer invoice
- Writer platform features: Optimized integration with Knowledge Graphs and other Writer capabilities
- Compliance simplicity: Writer manages model compliance and security
When to use external models
External models are the best choice when you need:
- Existing provider agreements: You have AWS credits or enterprise agreements with cloud providers
- Specific model access: You need a particular model not available through Writer (for example, Claude, Llama, or Mistral on Bedrock)
- Provider-specific compliance: Your organization mandates specific cloud providers for AI workloads
- Model comparison: You want to evaluate performance across different model providers
For information about adding and managing external models, see Add external models.
Use models in your applications
Once models are available in AI Studio, you can use them in Agent Builder, no-code apps, or via the API.
Agent Builder and no-code agents
In Agent Builder and no-code chat apps, select any available model from the Model dropdown. Both Palmyra models and any external models your team has access to appear in the list.
API usage
Use the List models endpoint to see all models available to your organization. You can then pass the model ID in any request that supports the model parameter.
curl https://api.writer.com/v1/models \
-H "Authorization: Bearer $WRITER_API_KEY"
from writerai import Writer
client = Writer()
models = client.models.list()
for model in models.models:
print(model.id)
import Writer from "writer-sdk";
const client = new Writer();
const models = await client.models.list();
models.models.forEach(model => console.log(model.id));
To use a model, pass its ID to any completion endpoint. External models use the same API as Palmyra models—just swap the model ID:
curl https://api.writer.com/v1/chat/completions \
-H "Authorization: Bearer $WRITER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "anthropic.claude-3-sonnet-20240229-v1:0",
"messages": [{"role": "user", "content": "Hello!"}]
}'
from writerai import Writer
client = Writer()
response = client.chat.chat(
model="anthropic.claude-3-sonnet-20240229-v1:0",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)
import Writer from "writer-sdk";
const client = new Writer();
const response = await client.chat.chat({
model: "anthropic.claude-3-sonnet-20240229-v1:0",
messages: [{ role: "user", content: "Hello!" }]
});
console.log(response.choices[0].message.content);
Next steps
- Add external models: Configure external models from providers like AWS Bedrock
- Palmyra models: Explore Writer’s Palmyra model capabilities