Why use Bedrock?
- Use existing AWS billing and cost management
- Keep model traffic inside your AWS network when the instance runs in a VPC with a Bedrock VPC endpoint (PrivateLink)
- Comply with enterprise AWS-only policies
- Use AWS IAM for access control
Prerequisites
- An AWS account with Bedrock access
- IAM permissions to create users and policies
- Claude models enabled in your Bedrock region
Step 1: Verify Claude model access
Claude models on Bedrock are enabled automatically when first invoked. However, first-time Anthropic users may need to submit use case details before access is granted.- Open the Amazon Bedrock console
- Select your preferred region (for example
us-east-1orus-west-2) - Go to Model catalog in the left sidebar
- Search for “Claude” and select a current model (for example Claude Sonnet 5.5)
- Click Open in playground to test access
- If prompted, submit the use case details for Anthropic models (see below)
Compiler uses Claude through Bedrock inference profiles (for example
us.anthropic.…, au.anthropic.… or global.anthropic.…). Models that AWS offers only as in-region on-demand models, without an inference profile, won’t appear in Compiler.Anthropic use case submission
First-time users see a form asking for use case details. Here’s what to enter:
Example use case description:
Internal tool for analyzing and understanding how codebases work. Used by our team to explore software projects and get answers to questions about functionality.
Step 2: Create an IAM policy
- Go to the IAM console > Policies > Create policy
-
Select the JSON tab and paste:
- Click Next
-
Name the policy (for example
CompilerBedrockAccess) - Click Create policy
Step 3: Create an IAM user
- Go to IAM > Users > Create user
- Enter a username (for example
compiler-bedrock) - Click Next
- Select Attach policies directly
- Search for and select your policy (
CompilerBedrockAccess) - Click Next > Create user
Step 4: Create access keys
- Click the user you just created
- Go to the Security credentials tab
- Under Access keys, click Create access key
-
Select Application running outside AWS
Compiler takes access keys even when it runs on AWS. It doesn’t use EC2 instance roles or ECS task roles for Bedrock.
- Click Next > Create access key
-
Save these credentials securely:
- Access key ID:
AKIA... - Secret access key:
wJalrXUtnFEMI...
- Access key ID:
Step 5: Configure your instance
- Log in to your self-hosted instance as an admin
- Go to Settings > AI > Provider (or choose AWS Bedrock during onboarding)
- Select AWS Bedrock as the service
-
Enter your credentials:
-
Click Save
Compiler validates your credentials by calling the Bedrock
ListFoundationModelsAPI, then loads the available models withListInferenceProfiles. - Open Settings > AI > Models to choose which models people can use and how much effort each one puts in. When a model has more than one inference profile, it has a Routing choice: a geography profile (for example Australia, United States or Europe) or Global. Compiler starts each model on the most local geography profile AWS offers in your region, and uses Global only when nothing else is available. New models appear tagged New and stay off until you turn them on.
Troubleshooting
"Unsupported model or your request did not allow prompt caching"
"Unsupported model or your request did not allow prompt caching"
Prompt caching is on by default. If the model or region you use doesn’t support it on Bedrock, turn it off in Settings > AI > Context > Prompt caching, or switch the model’s Routing in Settings > AI > Models.
No models listed
No models listed
- Confirm the IAM policy allows
bedrock:ListInferenceProfiles - Confirm your region offers Claude inference profiles (check Cross-region inference in the Bedrock console)
Organization SCP blocking cross-region access
Organization SCP blocking cross-region access
If your AWS Organization has Service Control Policies (SCPs) that restrict Bedrock to specific regions:
- Use a region where your organization allows Bedrock access (check with your AWS administrator)
- In Settings > AI > Models, choose a route your SCPs allow for each model
- Cross-region inference profiles (
apac.*,global.*,us.*) won’t work if SCPs block those regions