Issues with specifying Amazon Bedrock Guardrails

[robert-hanuschke]

Hi,

I'm trying to use litellm with Amazon Bedrock. However, I seem to do something wrong specifying Bedrock Guardrails.

In my code, I use the bedrock client of boto3 to list_guardrails and have my desired one here:

{'ResponseMetadata': {..., 'guardrails': [{'id': 'mts5z4bj1570', 'arn': 'arn:aws:bedrock:us-east-1:xxxxxxxxxxx:guardrail/mts5z4bj1570', 'status': 'READY', 'name': 'test', 'version': 'DRAFT', ...]}

However, when I try to use it, I get

{"message":"The model returned the following errors: The guardrail identifier or version provided in the request does not exist."}

The prompt works when I remove the guardrailConfig. The completion call:

            litellm_result = completion(
                model=f"bedrock/{os.environ['MODEL_ID']}",
                messages=[
                    {
                        "role": "system",
                        "content": RATING_PROMPT
                    },
                    {
                        "role": "user",
                        "content": "\n".join(
                            [
                                "Rate this story:",
                                f"Title: {db_article.title}",
                                f"Text: {db_article.text}",
                            ]
                        ),
                    },
                ],
                guardrailConfig={
                    "trace": "enabled",
                    "guardrailIdentifier": "mts5z4bj1570",
                    "guardrailVersion": "DRAFT",
                },
            )

I'm using highly privileged credentials here - in fact the same ones that I used to create the Guardrail in the first place. Should not be a permission error.

Any idea what my issue might be here and how to resolve it?

[montanapayne]

I'm experiencing a similar issue with bedrock guardrail config - but the error is slightly different.

Guardrail 'prompt-injection-guardrail' not found. Please ensure the guardrail is configured in your LiteLLM proxy.

[ishaan-jaff]

Hi,

I'm trying to use litellm with Amazon Bedrock. However, I seem to do something wrong specifying Bedrock Guardrails.

In my code, I use the bedrock client of boto3 to list_guardrails and have my desired one here:

{'ResponseMetadata': {..., 'guardrails': [{'id': 'mts5z4bj1570', 'arn': 'arn:aws:bedrock:us-east-1:xxxxxxxxxxx:guardrail/mts5z4bj1570', 'status': 'READY', 'name': 'test', 'version': 'DRAFT', ...]}

However, when I try to use it, I get

{"message":"The model returned the following errors: The guardrail identifier or version provided in the request does not exist."}

The prompt works when I remove the guardrailConfig. The completion call:

            litellm_result = completion(
                model=f"bedrock/{os.environ['MODEL_ID']}",
                messages=[
                    {
                        "role": "system",
                        "content": RATING_PROMPT
                    },
                    {
                        "role": "user",
                        "content": "\n".join(
                            [
                                "Rate this story:",
                                f"Title: {db_article.title}",
                                f"Text: {db_article.text}",
                            ]
                        ),
                    },
                ],
                guardrailConfig={
                    "trace": "enabled",
                    "guardrailIdentifier": "mts5z4bj1570",
                    "guardrailVersion": "DRAFT",
                },
            )

I'm using highly privileged credentials here - in fact the same ones that I used to create the Guardrail in the first place. Should not be a permission error.

Any idea what my issue might be here and how to resolve it?

This looks like it's from bedrock API "{"message":"The model returned the following errors: The guardrail identifier or version provided in the request does not exist."}"

Are you sure you are specifying the right ID and version ?

[darfaz]

A couple of things to check with Bedrock Guardrails:

1. Version string — When using DRAFT, make sure you're passing the version as the string "DRAFT" not a numeric version. If you've published a version, use the version number (e.g., "1").

2. Region mismatch — The guardrail must be in the same region as the model endpoint. If LiteLLM is routing to a different region than where you created the guardrail, you'll get this error.

3. LiteLLM guardrailConfig format — The config needs to be passed in the metadata or as an extra param. Check if you're passing it as:

guardrailConfig={"guardrailIdentifier": "mts5z4bj1570", "guardrailVersion": "DRAFT", "trace": "enabled"}

vs the ARN format. Try both the short ID and full ARN.

4. IAM permissions — The IAM role used by LiteLLM needs bedrock:ApplyGuardrail permission in addition to the model invocation permissions.

If you're still hitting issues, try calling the Bedrock API directly (bypassing LiteLLM) with the same guardrail config to isolate whether it's a LiteLLM formatting issue or an AWS-side config problem.