Skip to content

Commit 9356a7a

Browse files
patch: add mode support
1 parent bf3ea7f commit 9356a7a

17 files changed

+29
-327
lines changed

README.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ This Terraform provider allows you to manage LiteLLM resources through Infrastru
99
- Configure team members and their permissions
1010
- Set usage limits and budgets
1111
- Control access to specific models
12+
- Specify model modes (e.g., completion, embeddings, image generation)
1213

1314
## Requirements
1415

@@ -38,6 +39,7 @@ resource "litellm_model" "claude_aws_bedrock" {
3839
custom_llm_provider = "bedrock"
3940
base_model = "anthropic.claude-3-5-sonnet-20241022-v2:0"
4041
tier = "paid"
42+
mode = "completion" # Specify the model mode
4143
aws_access_key_id = var.aws_access_key_id
4244
aws_secret_access_key = var.aws_secret_access_key
4345
aws_region_name = var.aws_region
@@ -47,6 +49,18 @@ resource "litellm_model" "claude_aws_bedrock" {
4749
}
4850
```
4951

52+
### Model Mode
53+
54+
The `mode` attribute in the `litellm_model` resource allows you to specify the intended use of the model. Available options are:
55+
56+
- `completion`
57+
- `embeddings`
58+
- `image_generation`
59+
- `moderation`
60+
- `audio_transcription`
61+
62+
This attribute is optional. If not specified, it will not be included in the API request.
63+
5064
## Development
5165

5266
### Building the Provider

examples/basic/README.md

Lines changed: 0 additions & 34 deletions
This file was deleted.

examples/basic/main.tf

Lines changed: 0 additions & 27 deletions
This file was deleted.

examples/basic/terraform.tfvars.example

Lines changed: 0 additions & 3 deletions
This file was deleted.

examples/basic/variables.tf

Lines changed: 0 additions & 16 deletions
This file was deleted.

examples/complete/README.md

Lines changed: 0 additions & 37 deletions
This file was deleted.

examples/complete/main.tf

Lines changed: 0 additions & 65 deletions
This file was deleted.

examples/complete/terraform.tfvars.example

Lines changed: 0 additions & 2 deletions
This file was deleted.

examples/complete/variables.tf

Lines changed: 0 additions & 10 deletions
This file was deleted.

examples/cost-test/.terraform.lock.hcl

Lines changed: 0 additions & 10 deletions
This file was deleted.

0 commit comments

Comments
 (0)