Reviewer evals failed (2026-10-29) #362

live run eval failures:
informational_jira_comment_no_run.json: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "8a539258-e583-46df-b006-6efd71e7df83"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("8a539258-e583-46df-b006-6efd71e7df83") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
status_only_jira_comment_no_run.json: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "215977b4-7029-4c08-9263-33c1dc0c4d3b"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("215977b4-7029-4c08-9263-33c1dc0c4d3b") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
test passes::review_eval::review_eval_live_ticket_comments ... FAILED

thread 'passes::review_eval::review_eval_live_diff_reviews' (9382) panicked at worker/src/passes/review_eval.rs:1325:5:
live diff eval failures:
existing_exclusion_list_is_not_an_override.json: the review call failed: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "ce830032-b9c9-4169-aeae-292c59882fbd"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("371") }, "x-amzn-requestid": HeaderValue { _private: H1("ce830032-b9c9-4169-aeae-292c59882fbd") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
existing_exclusion_list_is_not_an_override.json after the reply: the review call failed: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "c782120f-23f4-4c79-ab1c-3353a1f2c19b"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("371") }, "x-amzn-requestid": HeaderValue { _private: H1("c782120f-23f4-4c79-ab1c-3353a1f2c19b") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
hardcoded_record_override.json: the review call failed: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "04876c63-8f5a-4a12-bc0b-1aaed2bba2e5"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("371") }, "x-amzn-requestid": HeaderValue { _private: H1("04876c63-8f5a-4a12-bc0b-1aaed2bba2e5") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
staging_gaps_approve_with_notes.json: the review call failed: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "9ae4f7f0-1bf4-4157-8b0e-dd3b6cae1203"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("371") }, "x-amzn-requestid": HeaderValue { _private: H1("9ae4f7f0-1bf4-4157-8b0e-dd3b6cae1203") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-opus-5-5 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
test passes::review_eval::review_eval_live_diff_reviews ... FAILED

thread 'passes::review_eval::review_eval_live_classification' (9381) panicked at worker/src/passes/review_eval.rs:932:5:
live reviewer eval failures:
blocking_fix_outage_then_approval_ask.json comment 101: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "add5d636-30a6-4d08-98ab-8b91a797956b"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("add5d636-30a6-4d08-98ab-8b91a797956b") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
blocking_fix_outage_then_approval_ask.json reply 101: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "d0ada443-3330-468e-ae3a-e532dc2b0fd5"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("d0ada443-3330-468e-ae3a-e532dc2b0fd5") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
blocking_fix_outage_then_approval_ask.json comment 102: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "30d02156-d36b-44f3-b37b-80b6e9b7fe7f"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("30d02156-d36b-44f3-b37b-80b6e9b7fe7f") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
error_review_then_approval_ask.json comment 201: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "c1577e92-2940-40ab-a035-7a1343c120e5"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("c1577e92-2940-40ab-a035-7a1343c120e5") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
existing_exclusion_list_is_not_an_override.json comment 401: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "0930d132-de9e-42c3-9a0d-bc5da88ddad0"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("0930d132-de9e-42c3-9a0d-bc5da88ddad0") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
existing_exclusion_list_is_not_an_override.json reply 401: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "8a5f6391-2044-4b31-a66f-28799c22b5a4"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:29 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("8a5f6391-2044-4b31-a66f-28799c22b5a4") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
merge_gate_dismissed_approval_disarms.json comment 501: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "e90e9ad5-d410-47f5-be23-6049427dbb3f"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:30 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("e90e9ad5-d410-47f5-be23-6049427dbb3f") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
merge_gate_draft_protection.json comment 601: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "aa77ef87-d2d9-4d24-a784-28ee146f1eeb"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:30 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("aa77ef87-d2d9-4d24-a784-28ee146f1eeb") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
unverified_confirm_then_checked.json comment 301: Anthropic API error (403): service error: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action: AccessDeniedException: User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action (ServiceError(ServiceError { source: AccessDeniedException(AccessDeniedException { message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), meta: ErrorMetadata { code: Some("AccessDeniedException"), message: Some("User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action"), extras: Some({"aws_request_id": "be14b107-6950-480a-8785-c08d32a2a9d0"}) } }), raw: Response { status: StatusCode(403), headers: Headers { headers: {"date": HeaderValue { _private: H1("Thu, 29 Oct 2026 13:59:30 GMT") }, "content-type": HeaderValue { _private: H1("application/json") }, "content-length": HeaderValue { _private: H1("386") }, "x-amzn-requestid": HeaderValue { _private: H1("be14b107-6950-480a-8785-c08d32a2a9d0") }, "x-amzn-errortype": HeaderValue { _private: H1("AccessDeniedException:http://internal.amazon.com/coral/com.amazon.coral.service/") }} }, body: SdkBody { inner: Once(Some(b"{\"Message\":\"User: arn:aws:sts::654654210434:assumed-role/coderhelm-prod-reviewer-evals/reviewer-evals-40886107541 is not authorized to perform: bedrock:InvokeModelWithResponseStream on resource: arn:aws:bedrock:us-east-1:654654210434:inference-profile/us.anthropic.claude-haiku-4-5-20251001-v1:0 because no identity-based policy allows the bedrock:InvokeModelWithResponseStream action\"}")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: {hyper_util::client::legacy::connect::http::HttpInfo} } } }))
test passes::review_eval::review_eval_live_classification ... FAILED

failures:

failures:
    passes::review_eval::review_eval_live_classification
    passes::review_eval::review_eval_live_diff_reviews
    passes::review_eval::review_eval_live_ticket_comments

test result: FAILED. 0 passed; 3 failed; 0 ignored; 0 measured; 1059 filtered out; finished in 1.30s

�[1m�[91merror�[0m: test failed, to rerun pass `-p worker --bin worker`