litellm-e2e · build #362
1278 passed, 0 failed, 62 skipped
1.103.3stableAll 1340 tests
✓test_a_route_no_replica_serves_is_refused_rather_than_read_back_vacuously TestReplicasFortest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_actor_key_cleanup_reports_failure_and_continues TestBoundManagementCallertest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_control_and_data_replica_readers_keep_the_caller TestSplitCallerPropagationtest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_credentials_are_absent_from_binding_and_header_diagnostics TestBoundManagementCallertest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_direct_delegated_and_replica_reads_keep_the_bound_caller[dashboard_session] TestBoundManagementCallertest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_direct_delegated_and_replica_reads_keep_the_bound_caller[direct_jwt] TestBoundManagementCallertest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_direct_delegated_and_replica_reads_keep_the_bound_caller[virtual_key] TestBoundManagementCallertest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_each_replica_gets_its_own_full_budget TestAwaitConvergedEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_expired_shaped_token_is_sent_once_without_renewal TestSplitCallerPropagationtest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_explicit_override_wins_without_rebinding_or_changing_master TestBoundManagementCallertest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_fails_on_the_replica_that_never_lists_the_model[gateway-1] TestAwaitServableEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_fails_on_the_replica_that_never_lists_the_model[gateway-2] TestAwaitServableEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_falls_back_to_the_data_plane_address_when_unset TestParseReplicaUrlstest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-add_team_member]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-block_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-connection_test]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-create_customer]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-create_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-create_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-create_tag]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-create_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-create_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-customer_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_customer]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_key_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_model_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_tag]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_team_member]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_user_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-delete_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-generate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-key_alias_count]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-key_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-key_list]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-llm_only_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-org_info_status]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-org_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.create_credential]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.create_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.create_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.create_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.delete_credential]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.delete_customers]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.delete_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.delete_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.delete_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.delete_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.delete_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.generate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.key_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.memory_summary]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.model_cost_map]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.model_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.probe]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.spend_logs]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.update_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-proxy.update_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-regenerate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-reset_key_spend]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-tag_list]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-team_info_status]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-team_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-team_list_ids]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-update_key_models]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-update_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-update_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-update_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-update_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-update_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-user_count]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-user_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[dashboard_session-user_list_ids]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-add_team_member]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-block_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-connection_test]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-create_customer]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-create_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-create_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-create_tag]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-create_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-create_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-customer_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_customer]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_key_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_model_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_tag]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_team_member]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_user_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-delete_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-generate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-key_alias_count]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-key_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-key_list]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-llm_only_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-org_info_status]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-org_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.create_credential]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.create_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.create_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.create_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.delete_credential]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.delete_customers]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.delete_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.delete_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.delete_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.delete_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.delete_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.generate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.key_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.memory_summary]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.model_cost_map]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.model_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.probe]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.spend_logs]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.update_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-proxy.update_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-regenerate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-reset_key_spend]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-tag_list]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-team_info_status]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-team_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-team_list_ids]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-update_key_models]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-update_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-update_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-update_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-update_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-update_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-user_count]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-user_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[direct_jwt-user_list_ids]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-add_team_member]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-block_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-connection_test]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-create_customer]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-create_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-create_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-create_tag]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-create_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-create_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-customer_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_customer]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_key_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_model_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_tag]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_team_member]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_user_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-delete_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-generate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-key_alias_count]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-key_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-key_list]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-llm_only_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-org_info_status]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-org_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.create_credential]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.create_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.create_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.create_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.delete_credential]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.delete_customers]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.delete_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.delete_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.delete_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.delete_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.delete_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.generate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.key_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.memory_summary]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.model_cost_map]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.model_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.probe]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.spend_logs]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.update_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-proxy.update_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-regenerate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-reset_key_spend]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-tag_list]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-team_info_status]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-team_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-team_list_ids]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-update_key_models]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-update_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-update_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-update_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-update_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-update_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-user_count]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-user_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[master-user_list_ids]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-add_team_member]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-block_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-connection_test]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-create_customer]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-create_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-create_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-create_tag]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-create_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-create_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-customer_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_customer]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_key_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_model_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_tag]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_team_member]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_user_strict]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-delete_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-generate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-key_alias_count]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-key_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-key_list]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-llm_only_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-org_info_status]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-org_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.create_credential]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.create_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.create_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.create_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.delete_credential]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.delete_customers]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.delete_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.delete_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.delete_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.delete_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.delete_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.generate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.key_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.memory_summary]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.model_cost_map]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.model_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.probe]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.spend_logs]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.update_model]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-proxy.update_toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-regenerate_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-reset_key_spend]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-tag_list]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-team_info_status]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-team_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-team_list_ids]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-update_key_models]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-update_key]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-update_mcp_server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-update_org]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-update_team]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-update_user]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-user_count]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-user_info]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_management_operations_send_the_selected_credential[virtual_key-user_list_ids]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_mcp_admin_routes_read_back_from_every_data_plane_replica TestReplicasFortest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_monolith_reads_management_routes_back_from_every_replica TestReplicasFortest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_names_the_replica_that_never_converges_with_its_last_read TestAwaitConvergedEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_names_the_replica_that_never_converges_with_what_it_last_served TestAwaitEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_partial_updates_preserve_explicit_null_at_the_http_boundary[server]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_partial_updates_preserve_explicit_null_at_the_http_boundary[toolset]test_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_passes_once_every_replica_lists_the_model TestAwaitServableEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_polls_until_the_deadline_before_giving_up TestAwaitEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_split_deployment_reads_management_routes_back_from_the_control_plane TestReplicasFortest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_splits_and_trims_the_gateway_addresses TestParseReplicaUrlstest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_strict_key_cleanup_accepts_missing_only_when_requested TestBoundManagementCallertest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_successful_team_and_model_polling_uses_the_bound_caller TestSplitCallerPropagationtest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_waits_for_the_lagging_replica_and_returns_every_settled_answer TestAwaitEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_waits_for_the_replica_that_lags_behind_the_write TestAwaitConvergedEverywheretest_proxy_client.py›
No steps recorded
View test on GitHub ↗✓test_anthropic_chat_returns_tool_call TestAnthropicChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_anthropic_chat_streams_real_content TestAnthropicChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_anthropic_chat_streams_tool_call TestAnthropicChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_anthropic_passthrough_nonstreaming_logs_costtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_anthropic_passthrough_streaming_logs_costtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_anthropic_passthrough_tool_call_logs_costtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_anthropic_prompt_caching_reads_cache TestCacheControltest_cache_control.py›
No steps recorded
View test on GitHub ↗✓test_array_input_returns_vectors TestEmbeddingsEndpointtest_embeddings_endpoint_e2e.py›
No steps recorded
View test on GitHub ↗✓test_audio_speech_returns_audio TestAudioSpeechtest_audio_speech_e2e.py›
No steps recorded
View test on GitHub ↗✓test_audio_speech_streams_audio_chunks TestAudioSpeechtest_audio_speech_e2e.py›
No steps recorded
View test on GitHub ↗✓test_audio_transcriptions_returns_text TestAudioTranscriptionstest_audio_transcriptions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_basic_nonstream TestAzureFoundryMessagestest_messages_azure_foundry_e2e.py›
No steps recorded
View test on GitHub ↗✓test_basic_stream TestAzureFoundryMessagestest_messages_azure_foundry_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_converse_chat_returns_content TestBedrockConverseChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_converse_chat_returns_reasoning TestBedrockConverseChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_converse_chat_returns_tool_call TestBedrockConverseChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_converse_chat_streams_real_content TestBedrockConverseChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_converse_chat_vision_describes_image TestBedrockConverseChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_embeddings_returns_vector TestEmbeddingsEndpointtest_embeddings_endpoint_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_image_generation_returns_image TestImageGenerationtest_image_generation_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_prompt_caching_reads_cache TestCacheControltest_cache_control.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_request_id_header_surfaces TestBedrockResponseHeaderstest_bedrock_provider_matrix_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_request_id_header_surfaces_on_stream TestBedrockResponseHeaderstest_bedrock_provider_matrix_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_rerank_scores_top_n TestReranktest_rerank_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bridged_stream_delivers_content_finish_reason_and_done TestResponsesBridgeChatCompletionsStreamingtest_responses_bridge_streaming_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bridged_stream_reassembles_tool_call TestResponsesBridgeChatCompletionsStreamingtest_responses_bridge_streaming_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bridged_stream_shares_one_chunk_id TestResponsesBridgeChatCompletionsStreamingtest_responses_bridge_streaming_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cache_read_tokens_bill_at_the_cache_read_rate TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_calls_without_auth_is_denied TestRealtimeHttptest_realtime_http_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_returns_real_completion[claude-haiku-4-5-anthropic] TestChatCompletionsRegressiontest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_returns_real_completion[gemini-2.5-flash-gemini] TestChatCompletionsRegressiontest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_returns_real_completion[gpt-5.5-openai] TestChatCompletionsRegressiontest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_stream_is_sse_and_ends_with_done TestChatStreamContracttest_chat_stream_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_template_kwargs_reach_together TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_client_secret_missing_auth_is_denied TestRealtimeHttptest_realtime_http_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cohere_chat_returns_content TestCohereChattest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cohere_embeddings_returns_vector TestEmbeddingsEndpointtest_embeddings_endpoint_e2e.py›
No steps recorded
View test on GitHub ↗✓test_converse_empty_messages_returns_client_error TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_converse_invalid_model_returns_error TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_converse_missing_messages_returns_error TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_converse_returns_assistant TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_converse_stream_returns_chunks TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cost_header_and_spend_row_match_the_registry_price TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_create_batch_missing_input_file_id_returns_error TestFilesBatchesContracttest_files_batches_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_create_client_secret TestRealtimeHttptest_realtime_http_e2e.py›
No steps recorded
View test on GitHub ↗✓test_create_list_retrieve_delete_lifecycle TestVectorStorestest_vector_stores_e2e.py›
No steps recorded
View test on GitHub ↗✓test_credential_backed_messages TestCredentialBackedMessagestest_credential_messages_e2e.py›
No steps recorded
View test on GitHub ↗✓test_custom_pricing_is_billed_at_configured_rate TestCustomPricingtest_custom_pricing_e2e.py›
No steps recorded
View test on GitHub ↗✓test_custom_pricing_is_isolated_from_sibling_deployment TestCustomPricingtest_custom_pricing_e2e.py›
No steps recorded
View test on GitHub ↗✓test_embeddings_call_logs_its_cost TestOpenAIPassthroughSpendtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_embeddings_returns_vector TestEmbeddingsEndpointtest_embeddings_endpoint_e2e.py›
No steps recorded
View test on GitHub ↗✓test_empty_image_returns_error TestImageEdittest_image_edits_e2e.py›
No steps recorded
View test on GitHub ↗✓test_empty_input_returns_client_error TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_empty_messages_returns_client_error TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_empty_prompt_returns_client_error TestImageGenerationtest_image_generation_e2e.py›
No steps recorded
View test on GitHub ↗✓test_empty_prompt_returns_error TestImageEdittest_image_edits_e2e.py›
No steps recorded
View test on GitHub ↗✓test_file_attach_poll_and_search TestVectorStorestest_vector_stores_e2e.py›
No steps recorded
View test on GitHub ↗✓test_gemini_chat_returns_content_and_logs_cost TestGeminiChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_gemini_passthrough_nonstreaming_logs_costtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_gemini_passthrough_streaming_logs_costtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_gemini_passthrough_tool_call_logs_costtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_generate_content_returns_response_cost_header TestGoogleNativeGenerateContenttest_google_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_image_edit_returns_image TestImageEdittest_image_edits_e2e.py›
No steps recorded
View test on GitHub ↗✓test_image_generation_returns_image TestImageGenerationtest_image_generation_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invalid_chunking_returns_error TestVectorStorestest_vector_stores_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invalid_max_completion_tokens_return_client_errors TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invalid_n_returns_client_error TestImageGenerationtest_image_generation_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invalid_role_returns_client_error TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invalid_size_returns_client_error TestImageGenerationtest_image_generation_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invalid_temperatures_return_client_errors TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invoke_invalid_temperature_returns_client_error TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invoke_missing_max_tokens_returns_error TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invoke_missing_messages_returns_error TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invoke_regional_id_completes TestBedrockInvokeRegionalModelIdstest_bedrock_provider_matrix_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invoke_regional_id_streams TestBedrockInvokeRegionalModelIdstest_bedrock_provider_matrix_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invoke_returns_message TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_invoke_stream_returns_chunks TestBedrockNativetest_bedrock_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_logs_cost_matching_the_response_header TestAnthropicMessagestest_messages_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_returns_completion TestAnthropicMessagestest_messages_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_streams_completion TestAnthropicMessagestest_messages_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_tool_use TestAnthropicMessagestest_messages_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_file_returns_error TestAudioTranscriptionstest_audio_transcriptions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_input_returns_error TestEmbeddingsEndpointtest_embeddings_endpoint_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_messages_returns_error TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_model_returns_client_error TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_model_returns_client_error TestEmbeddingsEndpointtest_embeddings_endpoint_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_model_returns_client_error TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_model_returns_error TestAudioTranscriptionstest_audio_transcriptions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_model_returns_error TestAnthropicMessagestest_messages_e2e.py›
No steps recorded
View test on GitHub ↗✓test_model_info_reports_custom_pricing TestCustomPricingtest_custom_pricing_e2e.py›
No steps recorded
View test on GitHub ↗✓test_moderations_flags_violent_content TestModerationstest_moderations_e2e.py›
No steps recorded
View test on GitHub ↗✓test_moderations_passes_benign_content TestModerationstest_moderations_e2e.py›
No steps recorded
View test on GitHub ↗✓test_multi_turn_history_is_honored TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_nova_sonic_response_create_completes TestNovaSonicRealtimerealtime/test_realtime_bedrock_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_chat_logs_cost TestOpenAIChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_chat_reasoning_reports_reasoning_tokens TestOpenAIChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_chat_returns_tool_call TestOpenAIChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_chat_streams_real_content TestOpenAIChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_chat_streams_tool_call TestOpenAIChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_chat_structured_output_conforms_to_schema TestOpenAIChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_chat_vision_describes_image TestOpenAIChatCompletionstest_chat_completions_regression_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_prefix_chat_returns_completion_and_logs_its_cost TestOpenAIProviderPrefixChattest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_openai_prompt_caching_reads_cache TestCacheControltest_cache_control.py›
No steps recorded
View test on GitHub ↗✓test_openai_service_tier_is_echoed TestServiceTiertest_provider_features_e2e.py›
No steps recorded
View test on GitHub ↗✓test_passthrough_denies_model_outside_key_allowlist TestPassthroughModelAllowlisttest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_passthrough_prefix_lists_batches_from_openai TestOpenAIPassthroughPrefixtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_passthrough_prefix_uploads_a_file_to_openai TestOpenAIPassthroughPrefixtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pipecat_tool_smoke[azure]realtime/test_realtime_pipecat_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pipecat_tool_smoke[gemini]realtime/test_realtime_pipecat_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pipecat_tool_smoke[openai]realtime/test_realtime_pipecat_e2e.py›
No steps recorded
View test on GitHub ↗✓test_realtime_upgrade_reaches_openai_through_the_passthrough_prefix TestOpenAIPassthroughWebsockettest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_reasoner_returns_reasoning_by_default TestDeepSeekReasoningDisabletest_deepseek_reasoning_e2e.py›
No steps recorded
View test on GitHub ↗✓test_reasoning_effort_none_disables_reasoning TestDeepSeekReasoningDisabletest_deepseek_reasoning_e2e.py›
No steps recorded
View test on GitHub ↗✓test_reasoning_effort_none_reaches_together TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_reasoning_streams_as_reasoning_content_deltas TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_reasoning_surfaces_as_reasoning_content TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_replayed_reasoning_content_reaches_together TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_required_tool_arguments_and_correlated_result[nonstream] TestOpenAIMessagesToolContinuationtest_messages_e2e.py›
No steps recorded
View test on GitHub ↗✓test_required_tool_arguments_and_correlated_result[stream] TestOpenAIMessagesToolContinuationtest_messages_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rerank_scores_top_n TestReranktest_rerank_e2e.py›
No steps recorded
View test on GitHub ↗✓test_response_format_json_schema_shapes_the_reply TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_anthropic_returns_completion TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_anthropic_returns_function_call TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_bedrock_returns_completion TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_bedrock_returns_function_call TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_logs_cost TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_returns_completion TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_returns_function_call TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_streaming_returns_completion TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_upgrade_is_accepted_on_the_openai_prefix TestOpenAIPassthroughWebsockettest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_vision_describes_image TestResponsestest_responses_e2e.py›
No steps recorded
View test on GitHub ↗✓test_retrieve_invalid_batch_id_returns_error TestFilesBatchesContracttest_files_batches_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rust_ocr_response[azure-ai] TestRustOcrGatewaytest_ocr_rust_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rust_ocr_response[azure-document-intelligence] TestRustOcrGatewaytest_ocr_rust_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rust_ocr_response[mistral] TestRustOcrGatewaytest_ocr_rust_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rust_ocr_response[vertex-mistral] TestRustOcrGatewaytest_ocr_rust_e2e.py›
No steps recorded
View test on GitHub ↗✓test_stream_generate_content_frames_sse_the_way_google_sdks_expect TestGoogleNativeGenerateContenttest_google_native_e2e.py›
No steps recorded
View test on GitHub ↗✓test_streamed_responses_call_logs_its_cost TestOpenAIPassthroughSpendtest_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_streams_text_deltas TestTogetherMessagestest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_success_response_matches_chat_completion_contract TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_temperature_boundaries_succeed TestChatCompletionsContracttest_chat_completions_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_text_completion_returns_text TestCompletionsEndpointtest_completions_endpoint_e2e.py›
No steps recorded
View test on GitHub ↗✓test_text_conversation[azure]realtime/test_realtime_e2e.py›
No steps recorded
View test on GitHub ↗✓test_text_conversation[gemini]realtime/test_realtime_e2e.py›
No steps recorded
View test on GitHub ↗✓test_text_conversation[openai]realtime/test_realtime_e2e.py›
No steps recorded
View test on GitHub ↗✓test_text_conversation[vertex_ai]realtime/test_realtime_e2e.py›
No steps recorded
View test on GitHub ↗✓test_thinking_disabled_disables_reasoning TestDeepSeekReasoningDisabletest_deepseek_reasoning_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_call_is_returned TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_call_is_streamed TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_call_round_trip[azure]realtime/test_realtime_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_call_round_trip[gemini]realtime/test_realtime_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_call_round_trip[openai]realtime/test_realtime_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_call_round_trip[vertex_ai]realtime/test_realtime_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_result_round_trip TestTogetherChatCompletionstest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_result_round_trip TestTogetherMessagestest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_block_is_returned TestTogetherMessagestest_together_ai_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_nonstream TestAzureFoundryMessagestest_messages_azure_foundry_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_stream TestAzureFoundryMessagestest_messages_azure_foundry_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unflagged_model_converts_system_reminder_and_succeeds TestBedrockInvokeMidConversationSystemtest_messages_mid_conversation_system_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unflagged_model_converts_system_reminder_and_succeeds TestAzureFoundryMidConversationSystemtest_messages_mid_conversation_system_native_providers_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unflagged_model_converts_system_reminder_and_succeeds TestVertexMidConversationSystemtest_messages_mid_conversation_system_native_providers_e2e.py›
No steps recorded
View test on GitHub ↗✓test_upload_without_purpose_returns_error TestFilesBatchesContracttest_files_batches_contract_e2e.py›
No steps recorded
View test on GitHub ↗✓test_vertex_embeddings_returns_vector TestEmbeddingsEndpointtest_embeddings_endpoint_e2e.py›
No steps recorded
View test on GitHub ↗✓test_vertex_passthrough_via_managed_model_logs_cost TestVertexPassthroughSpendTrackingtest_vertex_passthrough_e2e.py›
No steps recorded
View test on GitHub ↗✓test_vertex_prompt_caching_reads_cache TestCacheControltest_cache_control.py›
No steps recorded
View test on GitHub ↗−test_empty_input_returns_error TestAudioSpeechtest_audio_speech_e2e.py›
No steps recorded
stage red: product gap, /v1/audio/speech 500s on empty input instead of surfacing the provider 4xx
View test on GitHub ↗−test_flagged_model_keeps_prompt_cache_across_system_reminder TestBedrockInvokeMidConversationSystemtest_messages_mid_conversation_system_e2e.py›
No steps recorded
LIT-4873: a mid-conversation role='system' reminder invalidates the prompt cache on the vertex_ai / azure_ai / bedrock_invoke Messages paths, while the same request preserves it both direct to Anthropic and through litellm's first-party anthropic path. Product bug, not a test defect: the assertion here is correct and must be restored unchanged with the fix
View test on GitHub ↗−test_flagged_model_keeps_prompt_cache_across_system_reminder TestAzureFoundryMidConversationSystemtest_messages_mid_conversation_system_native_providers_e2e.py›
No steps recorded
LIT-4873: a mid-conversation role='system' reminder invalidates the prompt cache on the vertex_ai / azure_ai / bedrock_invoke Messages paths, while the same request preserves it both direct to Anthropic and through litellm's first-party anthropic path. Product bug, not a test defect: the assertion here is correct and must be restored unchanged with the fix
View test on GitHub ↗−test_flagged_model_keeps_prompt_cache_across_system_reminder TestVertexMidConversationSystemtest_messages_mid_conversation_system_native_providers_e2e.py›
No steps recorded
LIT-4873: a mid-conversation role='system' reminder invalidates the prompt cache on the vertex_ai / azure_ai / bedrock_invoke Messages paths, while the same request preserves it both direct to Anthropic and through litellm's first-party anthropic path. Product bug, not a test defect: the assertion here is correct and must be restored unchanged with the fix
View test on GitHub ↗−test_gemini_passthrough_returns_the_same_header_contract_as_the_managed_routetest_passthrough_e2e.py›
No steps recorded
stage red: product gap, native passthrough returns no x-litellm-response-cost or x-ratelimit-* headers
View test on GitHub ↗−test_hosted_vllm_chat_returns_content TestHostedVllmChattest_chat_completions_regression_e2e.py›
No steps recorded
set HOSTED_VLLM_API_BASE (the live vLLM server this deployment targets)
View test on GitHub ↗−test_invalid_response_id_returns_error TestResponsesRetrievetest_responses_retrieve_e2e.py›
No steps recorded
stage red: product gap (LIT-5447), retrieving an unknown response id returns 400 (model=None) instead of 404
View test on GitHub ↗−test_invalid_voice_returns_error TestAudioSpeechtest_audio_speech_e2e.py›
No steps recorded
stage red: product gap, /v1/audio/speech 500s on invalid voice instead of surfacing the provider 4xx
View test on GitHub ↗−test_missing_document_returns_error TestRustOcrGatewaytest_ocr_rust_e2e.py›
No steps recorded
stage red: product gap, /v1/ocr 500s (aocr TypeError) on missing document instead of 400
View test on GitHub ↗−test_missing_input_returns_error TestAudioSpeechtest_audio_speech_e2e.py›
No steps recorded
stage red: product gap, /v1/audio/speech 500s on missing input instead of 400
View test on GitHub ↗−test_missing_input_returns_error TestModerationstest_moderations_e2e.py›
No steps recorded
stage red: product gap, /v1/moderations 500s (KeyError 'input') on missing input instead of 400
View test on GitHub ↗−test_missing_input_returns_error TestResponsestest_responses_e2e.py›
No steps recorded
stage red: product gap, /v1/responses 500s (aresponses TypeError) on missing input instead of 400
View test on GitHub ↗−test_missing_max_tokens_returns_error TestAnthropicMessagestest_messages_e2e.py›
No steps recorded
stage red: product gap, /v1/messages 500s (anthropic_messages TypeError) on missing max_tokens instead of 400
View test on GitHub ↗−test_missing_messages_returns_error TestAnthropicMessagestest_messages_e2e.py›
No steps recorded
stage red: product gap, /v1/messages 500s (anthropic_messages TypeError) on missing messages instead of 400
View test on GitHub ↗−test_missing_model_returns_error TestAudioSpeechtest_audio_speech_e2e.py›
No steps recorded
stage red: product gap, /v1/audio/speech 500s on missing model instead of 400
View test on GitHub ↗−test_missing_prompt_returns_error TestImageGenerationtest_image_generation_e2e.py›
No steps recorded
stage red: product gap, /v1/images/generations 500s (aimage_generation TypeError) on missing prompt instead of 400
View test on GitHub ↗−test_retrieve_invalid_id_returns_error TestVectorStorestest_vector_stores_e2e.py›
No steps recorded
stage red: product gap, retrieving a nonexistent vector store returns 2xx with an error envelope in the body instead of 404
View test on GitHub ↗−test_search_missing_query_returns_error TestVectorStorestest_vector_stores_e2e.py›
No steps recorded
stage red: product gap, vector store search 500s (asearch TypeError) on missing query instead of 400
View test on GitHub ↗−test_static_and_x_pass_headers_reach_upstream TestPassthroughHeaderstest_passthrough_headers_e2e.py›
No steps recorded
stage red: ALB sends custom passthrough paths to backend pods, which lack ANTHROPIC_API_KEY, so the os.environ header forwards unresolved and Anthropic 401s; routing user-defined paths to the gateway needs a product/infra decision (fixed path namespace or dynamic ingress)
View test on GitHub ↗−test_store_and_retrieve_by_id TestResponsesRetrievetest_responses_retrieve_e2e.py›
No steps recorded
stage red: product gap (LIT-5446), retrieve returns a different id than the stored response (non-idempotent response-id re-encryption)
View test on GitHub ↗−test_web_search_server_tool_is_served TestBedrockWebSearchServerTooltest_bedrock_web_search_server_tool_e2e.py›
No steps recorded
stage red: environment gap, the e2e stack neither enables the websearch_interception callback nor declares a search backend, so the request reaches bedrock's transformation and takes its by-design 400. Unskip once the ephemeral stack ships the config in this module's docstring.
View test on GitHub ↗✓test_a_failed_first_turn_is_reported_as_the_first_turn_probe_unit_tests/test_http_probe.py›
No steps recorded
View test on GitHub ↗✓test_a_history_with_no_server_tool_block_is_not_a_pass_probe_unit_tests/test_http_probe.py›
No steps recorded
View test on GitHub ↗✓test_a_pending_tool_use_is_answered_with_the_id_the_model_returned_probe_unit_tests/test_http_probe.py›
No steps recorded
View test on GitHub ↗✓test_a_turn_truncated_before_the_result_block_is_not_a_pass_probe_unit_tests/test_http_probe.py›
No steps recorded
View test on GitHub ↗✓test_a_turn_with_no_pending_tool_use_gets_a_plain_follow_up_probe_unit_tests/test_http_probe.py›
No steps recorded
View test on GitHub ↗✓test_accepts_a_replayed_server_tool_pair_probe_unit_tests/test_http_probe.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_non_streaming_anthropicbasic_messaging_non_streaming/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_non_streaming_azurebasic_messaging_non_streaming/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_non_streaming_azure_openaibasic_messaging_non_streaming/test_azure_openai.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_non_streaming_bedrock_conversebasic_messaging_non_streaming/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_non_streaming_bedrock_invokebasic_messaging_non_streaming/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_non_streaming_vertex_aibasic_messaging_non_streaming/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_non_streaming_vertex_ai_gptbasic_messaging_non_streaming/test_vertex_ai_gpt.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_streaming_anthropicbasic_messaging_streaming/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_streaming_azurebasic_messaging_streaming/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_streaming_azure_openaibasic_messaging_streaming/test_azure_openai.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_streaming_bedrock_conversebasic_messaging_streaming/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_streaming_bedrock_invokebasic_messaging_streaming/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_streaming_vertex_aibasic_messaging_streaming/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_basic_messaging_streaming_vertex_ai_gptbasic_messaging_streaming/test_vertex_ai_gpt.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_503_is_retryable_but_not_rate_limit_shaped_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_count_tokens_anthropiccount_tokens/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_count_tokens_azurecount_tokens/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_count_tokens_bedrock_conversecount_tokens/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_count_tokens_bedrock_invokecount_tokens/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_driver_error_message_is_classified_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_find_regressions_empty_old_matrix_is_safe_builder_unit_tests/test_matrix_builder.py›
No steps recorded
View test on GitHub ↗✓test_find_regressions_flags_pass_to_fail_builder_unit_tests/test_matrix_builder.py›
No steps recorded
View test on GitHub ↗✓test_find_regressions_ignores_green_to_grey_builder_unit_tests/test_matrix_builder.py›
No steps recorded
View test on GitHub ↗✓test_find_regressions_ignores_improvements_and_steady_green_builder_unit_tests/test_matrix_builder.py›
No steps recorded
View test on GitHub ↗✓test_find_regressions_ignores_new_cells_without_baseline_builder_unit_tests/test_matrix_builder.py›
No steps recorded
View test on GitHub ↗✓test_find_regressions_ignores_red_to_red_builder_unit_tests/test_matrix_builder.py›
No steps recorded
View test on GitHub ↗✓test_find_regressions_matches_by_id_not_name_builder_unit_tests/test_matrix_builder.py›
No steps recorded
View test on GitHub ↗✓test_find_regressions_reports_multiple_sorted_builder_unit_tests/test_matrix_builder.py›
No steps recorded
View test on GitHub ↗✓test_passing_outcome_is_never_retryable_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_passthrough_anthropicpassthrough/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_passthrough_bedrock_conversepassthrough/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_passthrough_bedrock_invokepassthrough/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_passthrough_vertex_aipassthrough/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_pdf_input_anthropicpdf_input/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_pdf_input_azurepdf_input/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_pdf_input_bedrock_conversepdf_input/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_pdf_input_bedrock_invokepdf_input/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_pdf_input_vertex_aipdf_input/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_1h_anthropicprompt_caching_1h/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_1h_azureprompt_caching_1h/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_1h_bedrock_converseprompt_caching_1h/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_1h_bedrock_invokeprompt_caching_1h/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_1h_vertex_aiprompt_caching_1h/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_5m_anthropicprompt_caching_5m/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_5m_azureprompt_caching_5m/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_5m_bedrock_converseprompt_caching_5m/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_5m_bedrock_invokeprompt_caching_5m/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_prompt_caching_5m_vertex_aiprompt_caching_5m/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_reports_the_status_when_the_replayed_history_is_rejected_probe_unit_tests/test_http_probe.py›
No steps recorded
View test on GitHub ↗✓test_shapes_are_classified_independently[[claude-opus-4-7-bedrock-converse] tool_search probe failed: status 503: {"error":{"message":"litellm.ServiceUnavailableError: BedrockException - {\\"message\\":\\"Bedrock is unable to process your request.\\"}"}}-False-True]_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_shapes_are_classified_independently[claude CLI timed out after 120s-True-False]_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_shapes_are_classified_independently[status 400: {"error":"bad request"}-False-False]_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_shapes_are_classified_independently[status 429: {"error":{"message":"Rate limit reached"}}-True-False]_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_shapes_are_classified_independently[status 503 service unavailable-False-True]_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_shapes_are_classified_independently[status 529: {"type":"overloaded_error"}-False-True]_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_shapes_are_classified_independently[throttling exception from provider-True-False]_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_shapes_are_classified_independently[upstream overloaded, try again later-False-True]_driver_unit_tests/test_retry_classification.py›
No steps recorded
View test on GitHub ↗✓test_structured_outputs_anthropicstructured_outputs/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_structured_outputs_azurestructured_outputs/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_structured_outputs_bedrock_conversestructured_outputs/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_structured_outputs_bedrock_invokestructured_outputs/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_structured_outputs_vertex_aistructured_outputs/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_thinking_anthropicthinking/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_thinking_azurethinking/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_thinking_bedrock_conversethinking/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_thinking_bedrock_invokethinking/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_thinking_vertex_aithinking/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_thinking_with_tool_use_anthropicthinking_with_tool_use/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_thinking_with_tool_use_azurethinking_with_tool_use/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_thinking_with_tool_use_bedrock_conversethinking_with_tool_use/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_thinking_with_tool_use_bedrock_invokethinking_with_tool_use/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_thinking_with_tool_use_vertex_aithinking_with_tool_use/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_tool_search_anthropictool_search/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_tool_search_bedrock_conversetool_search/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_tool_search_bedrock_invoketool_search/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_tool_search_history_bedrock_invoketool_search/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_anthropictool_use/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_azuretool_use/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_azure_openaitool_use/test_azure_openai.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_bedrock_conversetool_use/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_bedrock_invoketool_use/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_streaming_anthropictool_use_streaming/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_streaming_azuretool_use_streaming/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_streaming_azure_openaitool_use_streaming/test_azure_openai.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_streaming_bedrock_conversetool_use_streaming/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_streaming_bedrock_invoketool_use_streaming/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_streaming_vertex_aitool_use_streaming/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_streaming_vertex_ai_gpttool_use_streaming/test_vertex_ai_gpt.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_vertex_aitool_use/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_tool_use_vertex_ai_gpttool_use/test_vertex_ai_gpt.py›
No steps recorded
View test on GitHub ↗✓test_vision_anthropicvision/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_vision_azurevision/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_vision_bedrock_conversevision/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_vision_bedrock_invokevision/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_vision_vertex_aivision/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗✓test_web_search_anthropicweb_search/test_anthropic.py›
No steps recorded
View test on GitHub ↗✓test_web_search_azureweb_search/test_azure.py›
No steps recorded
View test on GitHub ↗✓test_web_search_bedrock_converseweb_search/test_bedrock_converse.py›
No steps recorded
View test on GitHub ↗✓test_web_search_bedrock_invokeweb_search/test_bedrock_invoke.py›
No steps recorded
View test on GitHub ↗✓test_web_search_vertex_aiweb_search/test_vertex_ai.py›
No steps recorded
View test on GitHub ↗−test_basic_messaging_non_streaming_bedrock_mantlebasic_messaging_non_streaming/test_bedrock_mantle.py›
No steps recorded
Bedrock Mantle GPT-5.6 cells are opt-in; set COMPAT_MANTLE_CELLS=1 once the AWS account is allowlisted for the openai.gpt-5.6-* models
View test on GitHub ↗−test_basic_messaging_non_streaming_openaibasic_messaging_non_streaming/test_openai.py›
No steps recorded
OpenAI GPT-5.6 cells are opt-in; set COMPAT_OPENAI_GPT_CELLS=1 to run them (stage suite timeouts under concurrent load)
View test on GitHub ↗−test_basic_messaging_streaming_bedrock_mantlebasic_messaging_streaming/test_bedrock_mantle.py›
No steps recorded
Bedrock Mantle GPT-5.6 cells are opt-in; set COMPAT_MANTLE_CELLS=1 once the AWS account is allowlisted for the openai.gpt-5.6-* models
View test on GitHub ↗−test_basic_messaging_streaming_openaibasic_messaging_streaming/test_openai.py›
No steps recorded
OpenAI GPT-5.6 cells are opt-in; set COMPAT_OPENAI_GPT_CELLS=1 to run them (stage suite timeouts under concurrent load)
View test on GitHub ↗−test_count_tokens_vertex_aicount_tokens/test_vertex_ai.py›
No steps recorded
stage red: Vertex returns not supported for token counting for Claude aliases
View test on GitHub ↗−test_long_context_1m_anthropiclong_context_1m/test_anthropic.py›
No steps recorded
stage red: 1M long_context not green on stage Anthropic path yet (200k sonnet / model alias)
View test on GitHub ↗−test_long_context_1m_azurelong_context_1m/test_azure.py›
No steps recorded
stage red: 1M long_context not green on stage Azure Foundry deployments yet
View test on GitHub ↗−test_long_context_1m_bedrock_converselong_context_1m/test_bedrock_converse.py›
No steps recorded
stage red: 1M long_context not green on stage Bedrock Converse deployments yet
View test on GitHub ↗−test_long_context_1m_bedrock_invokelong_context_1m/test_bedrock_invoke.py›
No steps recorded
stage red: 1M long_context not green on stage Bedrock Invoke deployments yet
View test on GitHub ↗−test_long_context_1m_vertex_ailong_context_1m/test_vertex_ai.py›
No steps recorded
stage red: 1M long_context not green on stage Vertex deployments yet
View test on GitHub ↗−test_passthrough_azurepassthrough/test_azure.py›
No steps recorded
stage red: /azure passthrough drops client headers (e.g. anthropic-version); product gap
View test on GitHub ↗−test_tool_search_azuretool_search/test_azure.py›
No steps recorded
stage red: Azure Foundry tool_search_server not supported in workspace for probed models
View test on GitHub ↗−test_tool_search_vertex_aitool_search/test_vertex_ai.py›
No steps recorded
stage red: Vertex rejects tool_search when deployment extra_headers inject context-1m beta; product/config
View test on GitHub ↗−test_tool_use_bedrock_mantletool_use/test_bedrock_mantle.py›
No steps recorded
Bedrock Mantle GPT-5.6 cells are opt-in; set COMPAT_MANTLE_CELLS=1 once the AWS account is allowlisted for the openai.gpt-5.6-* models
View test on GitHub ↗−test_tool_use_openaitool_use/test_openai.py›
No steps recorded
OpenAI GPT-5.6 cells are opt-in; set COMPAT_OPENAI_GPT_CELLS=1 to run them (stage suite timeouts under concurrent load)
View test on GitHub ↗−test_tool_use_streaming_bedrock_mantletool_use_streaming/test_bedrock_mantle.py›
No steps recorded
Bedrock Mantle GPT-5.6 cells are opt-in; set COMPAT_MANTLE_CELLS=1 once the AWS account is allowlisted for the openai.gpt-5.6-* models
View test on GitHub ↗−test_tool_use_streaming_openaitool_use_streaming/test_openai.py›
No steps recorded
OpenAI GPT-5.6 cells are opt-in; set COMPAT_OPENAI_GPT_CELLS=1 to run them (stage suite timeouts under concurrent load)
View test on GitHub ↗✓test_access_group_info_reports_membership TestModelAccessGroupRoutestest_model_tag_accessgroup_e2e.py›
No steps recorded
View test on GitHub ↗✓test_actor_subject_and_database_role[internal_user_viewer] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_actor_subject_and_database_role[internal_user] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_actor_subject_and_database_role[organization_admin] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_actor_subject_and_database_role[proxy_admin_viewer] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_actor_subject_and_database_role[proxy_admin] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_actor_subject_and_database_role[team_admin] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_actor_subject_and_database_role[team_member] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_actor_subject_and_database_role[unrelated_user] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_admin_creates_reads_updates_clears_and_deletes_a_key[direct_jwt] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_admin_creates_reads_updates_clears_and_deletes_a_key[virtual_key] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_admin_viewer_reads_but_cannot_update TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_approve_activates_submission_and_persists TestMcpServerSubmissiontest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_mantle_responses_connection_succeeds TestModelTestConnectiontest_model_test_connection_e2e.py›
No steps recorded
View test on GitHub ↗✓test_block_persists_to_key_info TestKeyRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_block_then_unblock_persists_to_model_info TestModelRoutestest_model_tag_accessgroup_e2e.py›
No steps recorded
View test on GitHub ↗✓test_block_then_unblock_persists_to_team_info TestTeamManagementRoutestest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bulk_update_applies_max_budget_to_target_key TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_callbacks_list_reports_active_logging_callbacks TestInventoryRoutestest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_clearing_the_description_with_null_reads_back_null TestMcpServerLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_clearing_the_description_with_null_reads_back_null TestMcpToolsetLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_config_update_persists_router_setting_to_get TestRouterSettingstest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_create_echoes_every_field_written TestKeyLifecycletest_key_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_create_persists_and_is_read_back TestFallbackManagementtest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_create_persists_both_tools_under_the_exact_names_written TestMcpToolsetLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_create_persists_every_field_on_every_replica TestMcpServerLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_created_budget_appears_in_budget_list TestBudgetManagementtest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_created_key_appears_in_key_list_inventory TestKeyRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_created_team_appears_in_team_list TestTeamRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_created_users_appear_in_user_list TestUserRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_creating_a_key_from_the_dashboard_persists_and_works TestDashboardKeyRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_credential_migration_check_reports_residual_scan TestInventoryRoutestest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_customer_create_persists_to_info TestCustomertest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_forbidden_for_non_admin_key TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_persists_and_revokes_team_bound_key TestTeamRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_removes_from_model_info_catalog TestModelRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_removes_from_organization_info TestOrganizationRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_removes_the_customer TestCustomerManagementtest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_removes_the_server_from_every_replica TestMcpServerLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_removes_the_toolset_from_every_replica TestMcpToolsetLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_removes_the_user_from_inventory TestUserRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_revokes_info_and_chat_on_every_replica TestKeyLifecycletest_key_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_delete_revokes_the_key_on_chat TestKeyRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_editing_a_key_from_the_dashboard_persists_and_is_enforced TestDashboardKeyRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_end_user_new_persists_to_end_user_info TestCustomerManagementtest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_estimate_computes_cost_from_token_counts TestCostEstimatetest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_explicit_null_clears_the_budget_and_its_reset_time TestKeyLifecycletest_key_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_gdpr_check_derives_verdict_from_the_request TestComplianceRoutestest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_generate_forbidden_for_non_admin_key TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_generate_persists_to_key_info_and_scopes_chat TestKeyRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_health_reports_the_calling_key_healthy TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_info_reflects_the_fields_the_key_was_created_with TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_info_returns_created_team_fields TestTeamManagementRoutestest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_is_null_finds_the_budget_left_uncapped TestBudgetListV1test_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_is_refused_for_a_non_admin_key TestBudgetListV1test_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_key_serves_its_model_and_is_denied_others TestKeyLifecycletest_key_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_llm_only_key_forbidden_from_management_writes TestManagementRoutePermissionstest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_add_and_delete_persist_to_team_info TestTeamRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_add_forbidden_to_plain_member TestTeamManagementRoutestest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_add_records_membership TestOrganizationMembershiptest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_cannot_write_and_another_team_cannot_read_the_key TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_delete_forbidden_to_plain_member TestTeamManagementRoutestest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_delete_persists_to_team_info TestTeamManagementRoutestest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_update_persists_role_and_budget TestTeamManagementRoutestest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_multi_group_actor_keeps_exact_memberships TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_access_group_tags_the_deployment TestModelAccessGroupRoutestest_model_tag_accessgroup_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_is_denied_to_non_admin_keys TestTeamManagementRoutestest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_is_refused_for_a_non_admin_key TestBudgetManagementtest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_persists_mapping_and_is_read_back TestJwtKeyMappingtest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_persists_to_customer_info TestCustomerManagementtest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_persists_to_model_info_catalog TestModelRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_persists_to_organization_info TestOrganizationRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_persists_to_tag_list TestTagRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_persists_to_team_info_and_binds_keys TestTeamRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_persists_to_user_info TestUserRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_new_user_is_readable_via_user_info TestUserManagementtest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_non_admin_key_cannot_add_global_model TestModelRoutestest_model_tag_accessgroup_e2e.py›
No steps recorded
View test on GitHub ↗✓test_oidc_browser_profile_identity_mapping TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_partial_setup_removes_previously_created_identities[group] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_partial_setup_removes_previously_created_identities[user] TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_partial_update_changes_only_the_named_field TestKeyLifecycletest_key_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_project_detachment_preserves_key_scope_and_refreshes_auth TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_read_reflects_the_create_on_every_replica TestKeyLifecycletest_key_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_refuses_a_sort_field_and_a_parameter_it_does_not_support TestBudgetListV1test_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_regenerate_rotates_to_a_working_new_key TestKeyRegenerationtest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_regenerate_with_grace_period_keeps_old_key_until_revoked TestKeyRegenerationtest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_register_submits_pending_server TestMcpServerSubmissiontest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_reset_spend_zeroes_recorded_spend_and_lifts_the_budget_block TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_sorts_pages_and_filters_the_budgets_it_created TestBudgetListV1test_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_successful_actor_cleanup_removes_owned_state TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tag_delete_removes_from_list TestTagRoutestest_model_tag_accessgroup_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tag_list_reports_created_tag TestTagRoutestest_model_tag_accessgroup_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_change_a_setting_that_is_not_enabled[budget_duration] TestTeamAdminWithTpmLimitEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_change_a_setting_that_is_not_enabled[max_budget] TestTeamAdminWithTpmLimitEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_change_a_setting_that_is_not_enabled[metadata] TestTeamAdminWithTpmLimitEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_change_a_setting_that_is_not_enabled[models] TestTeamAdminWithTpmLimitEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_change_a_setting_that_is_not_enabled[rpm_limit] TestTeamAdminWithTpmLimitEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_change_a_setting_that_is_not_enabled[team_alias] TestTeamAdminWithTpmLimitEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_change_any_team_setting TestTeamAdminWithNoEditableFieldstest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_raise_an_org_team_budget_under_the_org_cap TestTeamAdminWithRpmLimitAndMaxBudgetEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_raise_or_remove_the_budget[raise] TestTeamAdminWithRpmLimitAndMaxBudgetEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_cannot_raise_or_remove_the_budget[remove] TestTeamAdminWithRpmLimitAndMaxBudgetEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_resending_the_budget_settings_keeps_the_next_budget_reset TestTeamAdminWithTpmLimitEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_saves_a_new_rpm_limit_and_a_tighter_budget[first-budget] TestTeamAdminWithRpmLimitAndMaxBudgetEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_saves_a_new_rpm_limit_and_a_tighter_budget[lower] TestTeamAdminWithRpmLimitAndMaxBudgetEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_admin_saves_the_settings_form_with_a_new_tpm_limit TestTeamAdminWithTpmLimitEnabledtest_team_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tool_list_returns_catalog_with_consistent_total TestInventoryRoutestest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗✓test_two_actor_sets_keep_tenants_and_keys_isolated TestJwtManagementtest_jwt_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unblock_flips_key_info_blocked_back TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_update_accepts_per_model_budgets_including_punctuated_names TestBudgetManagementtest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_update_alias_persists_to_organization_info TestOrganizationRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_update_forbidden_for_non_admin_key TestKeyManagementRoutestest_key_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_update_max_budget_persists_to_budget_info TestBudgetManagementtest_budget_customer_user_org_e2e.py›
No steps recorded
View test on GitHub ↗✓test_update_models_persists_and_flips_enforcement TestKeyRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_update_persists_input_cost_to_model_info TestModelRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_update_persists_to_team_info TestTeamRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_update_persists_to_user_info TestUserRoutestest_management_e2e.py›
No steps recorded
View test on GitHub ↗✓test_updating_only_the_alias_keeps_every_other_field_on_every_replica TestMcpServerLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_updating_only_the_description_keeps_the_tools_and_name TestMcpToolsetLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_updating_the_tools_to_one_entry_reads_back_exactly_that_entry TestMcpToolsetLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_workflow_runs_list_returns_consistent_count TestInventoryRoutestest_config_misc_endpoints_e2e.py›
No steps recorded
View test on GitHub ↗−test_created_server_is_listed_with_every_field TestMcpServerLifecycletest_mcp_lifecycle_e2e.py›
No steps recorded
product gap: GET /v1/mcp/server builds each row from the in-memory registry, whose _build_mcp_server_table sets description from mcp_info['description'], so the list reports the mcp_info description while GET /v1/mcp/server/{server_id} reports the stored description column. A server created with both set to different text reads back with two different descriptions depending on the route
View test on GitHub ↗✓test_a_drained_group_does_not_block_a_different_group TestModelAccessGroupBudgetbudgets/test_model_access_group_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_a_key_that_spent_nothing_is_blocked_by_the_shared_pool TestModelAccessGroupBudgetbudgets/test_model_access_group_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bare_key_blocks_over_its_own_budget TestBudgetBlocksPerLevelbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bare_key_budget_resets_after_window TestBudgetResetPerLevelbudgets/test_budget_reset_e2e.py›
No steps recorded
View test on GitHub ↗✓test_blocked_member_does_not_block_peer TestTeamMemberBudgetIsolationbudgets/test_team_member_budget_isolation_e2e.py›
No steps recorded
View test on GitHub ↗✓test_budget_crud_roundtripbudgets/test_budget_crud_e2e.py›
No steps recorded
View test on GitHub ↗✓test_budget_delete_removes_itbudgets/test_budget_crud_e2e.py›
No steps recorded
View test on GitHub ↗✓test_budget_duration_schedules_reset_on_keybudgets/test_budget_crud_e2e.py›
No steps recorded
View test on GitHub ↗✓test_budget_fallback_reroutes_anthropic_messages_to_openaibudgets/test_budget_fallback_e2e.py›
No steps recorded
View test on GitHub ↗✓test_burst_of_concurrent_calls_loses_no_spendspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_burst_rate_limit_does_not_freeze_fresh_key TestRedisCircuitBreakerPathratelimit/test_redis_circuit_breaker_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cache_hit_is_zero_cost_and_suffixedspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cache_hit_reduces_tpm_by_non_cached_only TestTpmExcludesCachedTokensratelimit/test_tpm_excludes_cached_tokens_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cache_write_tokens_billed_at_cache_creation_rate TestCacheCostAccountingspend_tracking/test_cache_cost_accounting_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_completion_writes_nonzero_spend_rowspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cold_counter_reseed_keeps_counter_equal_to_db_spendbudgets/test_spend_counter_reseed_e2e.py›
No steps recorded
View test on GitHub ↗✓test_component_cost_headers_sum_to_total TestCostHeadersspend_tracking/test_cost_headers_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cost_breakdown_reports_component_costs TestCacheCostAccountingspend_tracking/test_cache_cost_accounting_e2e.py›
No steps recorded
View test on GitHub ↗✓test_each_model_on_a_shared_key_gets_its_own_rowspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_edge_wired_chat_writes_nonzero_spend_rowspend_tracking/test_provider_edge_spend_e2e.py›
No steps recorded
View test on GitHub ↗✓test_embedding_writes_nonzero_spend_rowspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_end_user_budget_blocks_attributed_calls TestBudgetBlocksPerLevelbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_end_user_spend_attributed_on_rowspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_every_write_path_row_joins_the_key TestKeyAttributionspend_tracking/test_key_attribution_e2e.py›
No steps recorded
View test on GitHub ↗✓test_failure_call_writes_failure_status_rowspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_generous_mode_lets_priority_borrow_past_reservation TestDynamicRateLimitPriorityratelimit/test_dynamic_rate_limit_priority_e2e.py›
No steps recorded
View test on GitHub ↗✓test_headers_report_limit_and_remaining TestKeyRateLimitsratelimit/test_rate_limit_e2e.py›
No steps recorded
View test on GitHub ↗✓test_health_check_rows_keep_the_service_account_key TestKeyAttributionspend_tracking/test_key_attribution_e2e.py›
No steps recorded
View test on GitHub ↗✓test_key_budget_reset_at_advances_after_windowbudgets/test_budget_reset_advances_e2e.py›
No steps recorded
View test on GitHub ↗✓test_key_spend_blocks_at_capbudgets/test_budget_reset_advances_e2e.py›
No steps recorded
View test on GitHub ↗✓test_key_spend_equals_sum_of_logsspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_key_with_budget_duration_schedules_reset_at_creationbudgets/test_budget_reset_advances_e2e.py›
No steps recorded
View test on GitHub ↗✓test_long_window_blocks_after_short_window_resetsbudgets/test_multi_window_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_budget_blocks_without_touching_teammates TestBudgetBlocksPerLevelbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_spend_attributed_to_team_and_user TestTeamMemberBudgetbudgets/test_team_member_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_member_spend_over_budget_is_blocked TestTeamMemberBudgetbudgets/test_team_member_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_bridge_keeps_cache_tokens TestCacheCostAccountingspend_tracking/test_cache_cost_accounting_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_end_date_is_rejected TestTeamDailyActivityspend_tracking/test_team_daily_activity_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_start_date_is_rejected TestTeamDailyActivityspend_tracking/test_team_daily_activity_e2e.py›
No steps recorded
View test on GitHub ↗✓test_model_max_budget_isolates_per_modelbudgets/test_model_max_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_multi_window_key_resets_each_window_independentlybudgets/test_budget_reset_advances_e2e.py›
No steps recorded
View test on GitHub ↗✓test_org_budget_blocks_keys_under_it TestBudgetBlocksPerLevelbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_org_budget_resets_after_window TestBudgetResetPerLevelbudgets/test_budget_reset_e2e.py›
No steps recorded
View test on GitHub ↗✓test_personal_key_blocks_over_its_own_budget TestKeyBudgetBlocksAcrossKeyKindsbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_personal_key_resets_after_window TestKeyBudgetResetAcrossKeyKindsbudgets/test_budget_reset_e2e.py›
No steps recorded
View test on GitHub ↗✓test_personal_key_user_budget_resets_after_window TestBudgetResetPerLevelbudgets/test_budget_reset_e2e.py›
No steps recorded
View test on GitHub ↗✓test_priority_tier_bills_priority_rates TestServiceTierPricingspend_tracking/test_service_tier_pricing_e2e.py›
No steps recorded
View test on GitHub ↗✓test_request_tags_round_tripspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_reset_wait_never_yields_non_budget_errorbudgets/test_budget_reset_advances_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rpm_limit_blocks_over_limit TestKeyRateLimitsratelimit/test_rate_limit_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rpm_limit_one_blocks_second_call TestRedisBackedRateLimitratelimit/test_redis_backed_ratelimit_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rpm_limit_resets_after_window TestKeyRateLimitsratelimit/test_rate_limit_e2e.py›
No steps recorded
View test on GitHub ↗✓test_schema_listed_spend_routes_are_responsivespend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_short_window_blocks_then_resetsbudgets/test_multi_window_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_soft_budget_does_not_blockbudgets/test_soft_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_spend_calculate_returns_nonzero_costspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_spend_logs_by_key_return_every_row_with_the_alias TestKeyAttributionspend_tracking/test_key_attribution_e2e.py›
No steps recorded
View test on GitHub ↗✓test_spend_logs_endpoint_returns_spendspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_spend_logs_v2_pagination_caps_pages_and_keeps_totalspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/customer/daily/activity]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/customer/list]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/end_user/daily/activity]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/activity]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/activity/exceptions]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/activity/exceptions/deployment]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/activity/model]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/all_end_users]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/spend/all_tag_names]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/spend/provider]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/spend/report]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/global/spend/teams]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/key/list]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/organization/daily/activity]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/organization/list]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/spend/keys]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/spend/logs]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/spend/logs/session/ui]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/spend/logs/ui]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/spend/logs/v2]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/spend/tags]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/spend/users]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/tag/daily/activity]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/team/daily/activity]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/team/list]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/user/daily/activity]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/user/daily/activity/aggregated]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_spend_route_responsive[/user/list]spend_tracking/test_spend_routes.py›
No steps recorded
View test on GitHub ↗✓test_streaming_cache_read_billed_at_cache_read_rate TestCacheCostAccountingspend_tracking/test_cache_cost_accounting_e2e.py›
No steps recorded
View test on GitHub ↗✓test_streaming_chat_completion_tracks_spendspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_streaming_messages_via_responses_bridge_tracks_spendspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tag_budget_blocks_tagged_requestsbudgets/test_tag_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tag_spend_matches_sum_of_tagged_logsspend_tracking/test_spend_tracking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_budget_blocks_every_team_key TestBudgetBlocksPerLevelbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_budget_resets_after_window TestBudgetResetPerLevelbudgets/test_budget_reset_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_key_blocks_over_its_own_budget TestKeyBudgetBlocksAcrossKeyKindsbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_key_resets_after_window TestKeyBudgetResetAcrossKeyKindsbudgets/test_budget_reset_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_long_window_blocks_after_short_window_resetsbudgets/test_team_multi_window_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_member_budget_reset_at_advancesbudgets/test_budget_reset_advances_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_member_budget_reset_keeps_advancingbudgets/test_team_member_budget_reset_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_member_key_blocks_over_its_own_budget TestKeyBudgetBlocksAcrossKeyKindsbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_member_key_resets_after_window TestKeyBudgetResetAcrossKeyKindsbudgets/test_budget_reset_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_short_window_blocks_then_resetsbudgets/test_team_multi_window_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_terminal_batch_cost_row_joins_the_retrieving_key TestKeyAttributionspend_tracking/test_key_attribution_e2e.py›
No steps recorded
View test on GitHub ↗✓test_the_budget_read_reports_the_spend_drawn_against_the_pool TestModelAccessGroupBudgetbudgets/test_model_access_group_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_the_key_that_drained_the_pool_stays_blocked TestModelAccessGroupBudgetbudgets/test_model_access_group_budget_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tpm_limit_blocks_over_limit TestKeyRateLimitsratelimit/test_rate_limit_e2e.py›
No steps recorded
View test on GitHub ↗✓test_user_budget_blocks_a_second_key TestUserBudgetAcrossKeysbudgets/test_user_budget_across_keys_e2e.py›
No steps recorded
View test on GitHub ↗✓test_user_budget_enforced_across_their_personal_keys TestBudgetBlocksPerLevelbudgets/test_budget_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_user_daily_activity_reports_alias_and_email TestKeyAttributionspend_tracking/test_key_attribution_e2e.py›
No steps recorded
View test on GitHub ↗✓test_valid_date_range_returns_results_and_metadata TestTeamDailyActivityspend_tracking/test_team_daily_activity_e2e.py›
No steps recorded
View test on GitHub ↗−test_end_user_model_max_budget_enforces_per_model_rpmbudgets/test_model_max_budget_e2e.py›
No steps recorded
stage red: product gap, end-user model_max_budget rpm_limit is stored but never enforced
View test on GitHub ↗−test_spend_route_responsive[/global/spend]spend_tracking/test_spend_routes.py›
No steps recorded
LIT-5211: on a fresh database the proxy's startup view creation can lose the race against schema migrations, leaving MonthlyGlobalSpend/DailyTagSpend/Last30d* views missing and these routes 500ing until the views exist
View test on GitHub ↗−test_spend_route_responsive[/global/spend/keys]spend_tracking/test_spend_routes.py›
No steps recorded
LIT-5211: on a fresh database the proxy's startup view creation can lose the race against schema migrations, leaving MonthlyGlobalSpend/DailyTagSpend/Last30d* views missing and these routes 500ing until the views exist
View test on GitHub ↗−test_spend_route_responsive[/global/spend/logs]spend_tracking/test_spend_routes.py›
No steps recorded
LIT-5211: on a fresh database the proxy's startup view creation can lose the race against schema migrations, leaving MonthlyGlobalSpend/DailyTagSpend/Last30d* views missing and these routes 500ing until the views exist
View test on GitHub ↗−test_spend_route_responsive[/global/spend/models]spend_tracking/test_spend_routes.py›
No steps recorded
LIT-5211: on a fresh database the proxy's startup view creation can lose the race against schema migrations, leaving MonthlyGlobalSpend/DailyTagSpend/Last30d* views missing and these routes 500ing until the views exist
View test on GitHub ↗−test_spend_route_responsive[/global/spend/tags]spend_tracking/test_spend_routes.py›
No steps recorded
LIT-5211: on a fresh database the proxy's startup view creation can lose the race against schema migrations, leaving MonthlyGlobalSpend/DailyTagSpend/Last30d* views missing and these routes 500ing until the views exist
View test on GitHub ↗−test_strict_mode_blocks_saturated_priority_but_serves_the_other TestDynamicRateLimitPriorityratelimit/test_dynamic_rate_limit_priority_e2e.py›
No steps recorded
LIT-5118: the stage proxy does not run the dynamic_rate_limiter_v3 callbacks + priority_reservation config this module's docstring requires (zero limiter log lines on any pod during the 2026-08-02 run), so strict enforcement can never engage there
View test on GitHub ↗✓test_a_success_status_without_a_deletion_confirmation_is_rejected[bGl0ZWxsbV9wcm94eTtmaWxlLTE=] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_a_success_status_without_a_deletion_confirmation_is_rejected[file-1] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_accepted_cancellation_waits_through_stale_provider_status[in_progress-batch-1] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_accepted_cancellation_waits_through_stale_provider_status[in_progress-bGl0ZWxsbV9wcm94eTtiYXRjaC0x] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_accepted_cancellation_waits_through_stale_provider_status[validating-batch-1] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_accepted_cancellation_waits_through_stale_provider_status[validating-bGl0ZWxsbV9wcm94eTtiYXRjaC0x] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_active_batch_is_cancelled_through_its_provider TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_any_other_delete_failure_still_raises[failure0] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_any_other_delete_failure_still_raises[failure1] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_any_other_delete_failure_still_raises[failure2] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_anything_but_still_cancelling_at_the_deadline_still_fails[last0-did not finish within 120.0s, last status in_progress] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_anything_but_still_cancelling_at_the_deadline_still_fails[last1-after cancellation failed: HTTP 403] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_azure_form_serializes_native_expiry_for_the_proxy TestAzureFileExpirytest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_batch_create_over_rpm_returns_mapped_429 TestBatchRateLimitErrorMappingtest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_key_model_access_deniedtest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[azure-encoded]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[azure-model_param]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[azure-provider_fallback]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[azure-unified]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[bedrock-unified]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[openai-encoded]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[openai-model_param]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[openai-provider_fallback]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[openai-unified]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[vertex_ai-encoded]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[vertex_ai-model_param]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[vertex_ai-provider_fallback]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_lifecycle[vertex_ai-unified]test_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_batch_still_cancelling_at_the_deadline_and_its_input_file_are_left_and_reported TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_batch_that_completed_before_cleanup_deletes_output_and_error_files[False] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_batch_that_completed_before_cleanup_deletes_output_and_error_files[True] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_cancellation_conflict_is_accepted_only_when_batch_became_inactive[completed] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_cancellation_conflict_is_accepted_only_when_batch_became_inactive[in_progress] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_cancelling_batch_is_polled_until_terminal_without_cancelling_again TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_cleanup_is_idempotent_when_file_is_already_deleted TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_completed_batch_downloads_output_and_books_cost TestBatchTerminalStatetest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_default_resource_cleanup_keeps_existing_best_effort_behavior TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_delete_refused_because_a_batch_still_references_the_file_is_left_and_reported TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[azure-encoded] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[azure-model_param] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[azure-provider_fallback] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[azure-unified] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[bedrock-unified] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[openai-encoded] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[openai-model_param] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[openai-provider_fallback] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[openai-unified] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[vertex_ai-encoded] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[vertex_ai-model_param] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[vertex_ai-provider_fallback] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_deletes_raw_files_through_the_upload_provider[vertex_ai-unified] TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_endpoint_mismatch_fails_batch_and_cancel_conflicts TestBatchFailurePathstest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_enqueued_allowance_accepts_batch_over_key_rpm TestBatchEnqueuedTokenLimittest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_exhausted_allowance_blocks_until_cancel_refunds TestBatchEnqueuedTokenLimittest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_failed_delete_is_reported_after_remaining_resources_are_cleaned TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_file_content_matches_upload TestBatchFileContenttest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_file_upload_and_delete_outputstest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_foreign_encoded_file_id_routes_by_file_model TestBatchFailurePathstest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_gemini_file_upload TestGeminiFilestest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_inactive_batch_needs_no_cancellation[cancelled] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_inactive_batch_needs_no_cancellation[completed] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_inactive_batch_needs_no_cancellation[expired] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_inactive_batch_needs_no_cancellation[failed] TestBatchCancellationtest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_list_page_cursors_address_only_the_callers_own_files TestOpenAIFilestest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_malformed_jsonl_upload_rejected TestBatchFailurePathstest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_managed_delete_accepts_the_deleted_file_object TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_other_providers_keep_their_existing_upload_fields[bedrock] TestAzureFileExpirytest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_other_providers_keep_their_existing_upload_fields[openai] TestAzureFileExpirytest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_other_providers_keep_their_existing_upload_fields[vertex_ai] TestAzureFileExpirytest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_permanent_error_is_not_retried TestCleanupRetriestest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_persistent_error_has_bounded_retries TestCleanupRetriestest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_retrieve_round_trips_metadata TestOpenAIFilestest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_success_response_must_confirm_deletion TestFileCleanuptest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_transient_error_retries_and_returns_success[failure0] TestCleanupRetriestest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_transient_error_retries_and_returns_success[failure1] TestCleanupRetriestest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_transient_error_retries_and_returns_success[failure2] TestCleanupRetriestest_batch_cleanup.py›
No steps recorded
View test on GitHub ↗✓test_unified_batch_create_with_assume_role TestBedrockBatchAssumeRoletest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unified_create_and_retrieve_via_chained_gateway TestBatchSecondHoptest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unified_file_content_downloads[azure] TestBatchFileContenttest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unified_file_content_downloads[bedrock] TestBatchFileContenttest_batches_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unified_file_content_downloads[vertex_ai] TestBatchFileContenttest_batches_e2e.py›
No steps recorded
View test on GitHub ↗−test_batch_runs_to_completion_with_a_downloadable_output[model_query] TestHostedVllmBatchtest_batches_e2e.py›
No steps recorded
set HOSTED_VLLM_API_BASE (the live vLLM server this deployment targets)
View test on GitHub ↗−test_batch_runs_to_completion_with_a_downloadable_output[target_model_names] TestHostedVllmBatchtest_batches_e2e.py›
No steps recorded
set HOSTED_VLLM_API_BASE (the live vLLM server this deployment targets)
View test on GitHub ↗−test_failing_line_lands_in_the_error_file_not_the_batch_status TestHostedVllmBatchtest_batches_e2e.py›
No steps recorded
set HOSTED_VLLM_API_BASE (the live vLLM server this deployment targets)
View test on GitHub ↗−test_rate_limited_batch_create_leaves_no_unattributed_spend_rowtest_batches_e2e.py›
No steps recorded
LIT-5027: the path under test hangs. The batch rate limiter reads the input file to count tokens by awaiting litellm.afile_content with no timeout, so a slow Files API holds POST /v1/batches open past any client deadline (63.6s observed on stage against a 60s read timeout). The unattributed-spend-row contract below is never reached, so the test reports a timeout rather than the behavior it guards. Unskip once the fetch is bounded.
View test on GitHub ↗−test_unified_file_upload_and_batch_create_in_govcloud TestBedrockBatchGovCloudtest_batches_e2e.py›
No steps recorded
The GovCloud credentials this test resolves are not provisioned in the e2e lane, so it fails on configuration rather than on the partition behavior it guards: the upload returns 500 'S3 bucket_name is required' because os.environ/AWS_GOVCLOUD_BATCH_S3_BUCKET resolves to nothing. None of AWS_GOVCLOUD_ACCESS_KEY_ID, AWS_GOVCLOUD_SECRET_ACCESS_KEY, AWS_GOVCLOUD_BATCH_S3_BUCKET or AWS_GOVCLOUD_BATCH_ROLE_ARN is injected into the stack: the runner podSpec mounts 29 individual secretKeyRef entries from litellm-provider-keys and no envFrom, and the string 'govcloud' appears nowhere in project-releaser. The commercial-partition Bedrock batch tests resolve their own os.environ/ bucket and pass, so the reference syntax is sound and only the GovCloud secrets are absent. Skipped rather than weakened because the assertions below are the correct contract. Remove this marker once the four secrets are provisioned and injected; do not relax the assertions to make it pass.
View test on GitHub ↗−test_uploaded_file_appears_in_list TestOpenAIFilestest_batches_e2e.py›
No steps recorded
LIT-4820 (https://linear.app/litellm-ai/issue/LIT-4820): GET /v1/files omits newly uploaded files. The upload succeeds and GET /v1/files/{id} returns the file, but it never appears in the listing; the returned set is stable with its newest entry ~10h old, on both the managed (/v1/files?model=) and provider-scoped (/openai/v1/files) routes. Skipped rather than weakened because the assertion below is the correct contract. Remove this marker when LIT-4820 is fixed; do not relax the assertion to make it pass.
View test on GitHub ↗✓test_a_body_that_does_not_match_its_declared_boundary_stays_opaque TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_chunk_split_inside_an_event_survives_replay TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_chunked_non_sse_response_stays_buffered TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_declared_part_content_type_separates_otherwise_identical_uploads TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_downstream_disconnect_mid_relay_records_only_the_delivered_chunks TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_file_part_without_a_filename_is_not_mistaken_for_a_plain_field TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_filename_carrying_a_per_run_marker_keys_the_same_next_run TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_fresh_boundary_replays_the_same_upload TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_length_change_the_canonicalizer_absorbs_does_not_move_the_key TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_mid_stream_upstream_failure_records_the_delivered_chunks_and_the_truncation TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_non_streamed_response_keeps_the_buffered_shape TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_redacted_field_still_matches_the_live_request_that_carried_the_secret TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_repeated_field_cannot_collide_with_a_literal_indexed_name TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_secret_named_field_never_reaches_the_stored_request TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_separator_inside_a_filename_cannot_forge_a_different_split TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_streamed_response_records_its_chunk_boundaries TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_structurally_different_upload_misses[extra-file-part] TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_structurally_different_upload_misses[file-content] TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_structurally_different_upload_misses[file-name] TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_structurally_different_upload_misses[form-field] TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_structurally_different_upload_misses[repeated-form-field] TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_a_truncated_recording_replays_as_a_truncated_stream TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_an_empty_declared_boundary_falls_back_instead_of_splitting_on_dashes TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_never_wires_a_bundle_because_the_edge_cannot_sign_into_one[record] TestApiBaseSeamtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_never_wires_a_bundle_because_the_edge_cannot_sign_into_one[replay] TestApiBaseSeamtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_concurrent_streams_each_record_their_own_chunks TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_content_drift_returns_the_miss_status_naming_both_keys TestReplayModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_exhausted_key_returns_the_miss_status TestReplayModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_failed_provider_attempt_is_counted TestProviderRequestObservationtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_forwards_to_the_provider_and_writes_one_interaction_file TestRecordModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_fully_consumed_recording_leaves_nothing TestReplayLeftovertest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_identical_requests_replay_their_responses_in_recorded_order TestReplayModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_inert_outside_replay_mode TestReplayLeftovertest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_invalid_mode_raises_naming_the_value TestApiBaseSeamtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_live_counts_repeated_marker_calls_without_recording TestProviderRequestObservationtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_live_mode_returns_none TestApiBaseSeamtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_never_stores_headers_so_credentials_never_touch_disk TestRecordModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_non_json_bodies_match_by_canonical_digest_without_storing_them TestReplayModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_parallel_identical_calls_serve_each_recording_exactly_once TestConcurrentReplaytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_partially_consumed_recording_names_the_leftover TestReplayLeftovertest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_query_params_are_part_of_the_identity TestReplayModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_record_and_replay_count_each_matching_call TestProviderRequestObservationtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_record_mode_boots_one_shared_edge_and_prepares_the_bundle TestApiBaseSeamtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_record_mode_relays_the_stream_chunked_like_replay_will TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_replay_of_a_stream_makes_no_provider_connection TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_replay_reproduces_the_recorded_split_points TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_replay_serves_a_directly_recorded_interaction TestHandleEdgeRequestPuretest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_request_identity_ignores_auth_headers TestReplayModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_serves_recorded_bytes_with_zero_provider_hits TestReplayModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_several_file_parts_separate_when_their_contents_swap TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_strips_volatile_response_headers_and_serves_the_filtered_copy TestRecordModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_test_without_recordings_has_no_leftover TestReplayLeftovertest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_the_boundary_parameter_is_read_the_way_the_client_meant_it[lookalike-parameter] TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_the_boundary_parameter_is_read_the_way_the_client_meant_it[uppercase-parameter] TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_the_stored_request_carries_fields_and_file_identity_but_no_secrets TestMultipartIdentitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_the_usage_chunk_replays_in_its_recorded_position TestStreamingFidelitytest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_two_binary_field_values_of_one_length_stay_apart TestMultipartIdentityEdgestest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_unknown_mount_404s_naming_the_known_mounts TestHandleEdgeRequestPuretest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_unknown_mount_raises_naming_the_known_mounts TestApiBaseSeamtest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_unreachable_provider_records_and_serves_a_502 TestRecordModetest_provider_edge.py›
No steps recorded
View test on GitHub ↗✓test_429_honors_server_reset_and_preserves_duplicate_eventstest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_all_attempts_failed_is_a_failure_not_a_passtest_span_selection.py›
No steps recorded
View test on GitHub ↗✓test_chat_completions_emits_one_log_event TestDataDogLogDeliverytest_datadog_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_completions_exports_complete_trace TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_completions_failure_writes_one_object TestS3LogDeliverytest_s3_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_completions_stream_emits_one_log_event TestDataDogLogDeliverytest_datadog_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_completions_stream_exports_complete_trace TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_completions_stream_records_real_ttft TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_completions_writes_one_success_object TestS3LogDeliverytest_s3_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_completions_writes_one_success_record TestGcsLogDeliverytest_gcs_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_distinct_key_aliases_produce_distinct_series TestPrometheusPerKeyCardinalitytest_prometheus_cardinality_e2e.py›
No steps recorded
View test on GitHub ↗✓test_empty_polling_does_not_start_a_final_search_after_its_deadlinetest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_failed_chat_completions_emits_one_error_event TestDataDogFailureDeliverytest_datadog_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_failed_chat_completions_error_span_attributes TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_failed_messages_error_span_attributes TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_failure_diagnostics_hide_credentials_without_changing_auth_headerstest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_invalid_reset_uses_search_interval[-1]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_invalid_reset_uses_search_interval[]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_invalid_reset_uses_search_interval[inf]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_invalid_reset_uses_search_interval[invalid]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_invalid_reset_uses_search_interval[nan]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_late_delivery_cannot_pass_without_a_complete_settle_windowtest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_late_retry_cannot_receive_a_fresh_request_timeouttest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_messages_emits_one_log_event TestDataDogLogDeliverytest_datadog_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_exports_complete_trace TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_stream_emits_one_log_event TestDataDogLogDeliverytest_datadog_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_stream_exports_complete_trace TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_stream_records_real_ttft TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_non_quota_failures_are_not_retried_or_treated_as_empty_results[-1]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_non_quota_failures_are_not_retried_or_treated_as_empty_results[401]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_non_quota_failures_are_not_retried_or_treated_as_empty_results[403]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_non_quota_failures_are_not_retried_or_treated_as_empty_results[500]test_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_other_operations_are_not_countedtest_span_selection.py›
No steps recorded
View test on GitHub ↗✓test_polling_quota_retries_share_the_original_deadlinetest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_queue_time_histogram_records_an_observation TestPrometheusRequestQueueTimetest_prometheus_queue_time_e2e.py›
No steps recorded
View test on GitHub ↗✓test_rate_limit_wait_stops_at_deadline_without_issuing_another_requesttest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_responses_emits_one_log_event TestDataDogLogDeliverytest_datadog_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_exports_complete_trace TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_stream_emits_one_log_event TestDataDogLogDeliverytest_datadog_log_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_stream_exports_complete_trace TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_stream_records_real_ttft TestOtelTraceCompletenesstest_otel_trace_e2e.py›
No steps recorded
View test on GitHub ↗✓test_retried_attempt_span_is_excludedtest_span_selection.py›
No steps recorded
View test on GitHub ↗✓test_retry_after_is_not_shortened_by_an_earlier_resettest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_served_span_is_the_only_one_when_nothing_was_retriedtest_span_selection.py›
No steps recorded
View test on GitHub ↗✓test_settlement_detects_a_duplicate_on_the_final_searchtest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_settlement_keeps_confirmed_events_through_empty_searchestest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_settlement_quota_retries_keep_the_remaining_readback_budgettest_datadog_reader.py›
No steps recorded
View test on GitHub ↗✓test_several_failed_attempts_still_leave_one_served_spantest_span_selection.py›
No steps recorded
View test on GitHub ↗✓test_team_callback_delivers_and_isolates TestTeamLangfuseCallbacktest_team_langfuse_callback_e2e.py›
No steps recorded
View test on GitHub ↗✓test_two_served_spans_still_failtest_span_selection.py›
No steps recorded
View test on GitHub ↗✓test_zero_reset_cannot_create_a_busy_retry_looptest_datadog_reader.py›
No steps recorded
View test on GitHub ↗−test_chat_completions_delivers_one_call_with_spend TestWeaveLogDeliverytest_weave_log_e2e.py›
No steps recorded
stage red: product gap, key-scoped weave_otel spans are not delivered when the OTEL v2 callback is active
View test on GitHub ↗−test_failed_chat_completions_delivers_one_error_call TestWeaveLogDeliverytest_weave_log_e2e.py›
No steps recorded
stage red: product gap, key-scoped weave_otel spans are not delivered when the OTEL v2 callback is active
View test on GitHub ↗✓test_a_flat_ceiling_fails_a_degraded_phase_that_is_cheaper_than_its_baseline TestAbsoluteBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_a_missing_baseline_is_a_violation_rather_than_a_silent_pass TestRatioBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_a_route_that_never_ran_is_absent_so_a_one_sided_run_cannot_pass_unnoticed TestPerEndpointtest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_a_run_inside_every_budget_reports_nothing TestViolationstest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_a_run_that_drove_no_traffic_reports_a_total_failure_ratio TestAggregatetest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_a_run_with_no_failures_writes_no_csv_and_reports_no_errors TestErrorBreakdowntest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_a_single_sample_has_no_interval_and_reports_zero TestCpuUtilizationtest_proxy_usage.py›
No steps recorded
View test on GitHub ↗✓test_a_value_exactly_at_the_ceiling_is_allowed TestAbsoluteBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_a_value_past_the_ceiling_reports_the_measurement_and_the_ceiling TestAbsoluteBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_a_value_under_the_ceiling_is_not_a_violation TestAbsoluteBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_a_zero_measurement_is_not_a_violation TestAbsoluteBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_all_planned_turns_completing_reports_zero_failures TestSummarizePlannedTurnstest_session_anomaly.py›
No steps recorded
View test on GitHub ↗✓test_an_empty_window_reports_zero_rather_than_indexing_nothing TestRssPercentilestest_proxy_usage.py›
No steps recorded
View test on GitHub ↗✓test_an_even_split_takes_the_lower_middle_sample_as_locust_itself_does TestPercentilestest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_both_budget_shapes_report_together TestViolationstest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_cost_per_request_separates_runs_that_cores_busy_reports_identically TestCpuUtilizationtest_proxy_usage.py›
No steps recorded
View test on GitHub ↗✓test_diagnosis_caps_the_list_and_says_how_many_it_left_out TestErrorBreakdowntest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_diagnosis_leads_with_the_most_common_error TestErrorBreakdowntest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_diagnosis_says_so_when_locust_recorded_nothing TestErrorBreakdowntest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_each_route_keeps_its_own_requests_failures_and_median TestPerEndpointtest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_every_blown_budget_is_reported_not_just_the_first TestViolationstest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_exhausted_attempts_return_the_last_failure TestRetriedtest_session_anomaly.py›
No steps recorded
View test on GitHub ↗✓test_first_try_success_never_sleeps TestRetriedtest_session_anomaly.py›
No steps recorded
View test on GitHub ↗✓test_growth_exactly_at_the_ceiling_is_allowed TestRatioBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_growth_past_the_ceiling_reports_both_values_and_the_ratio TestRatioBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_growth_within_the_ceiling_is_not_a_violation TestRatioBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_locust_failure_rows_become_the_error_breakdown TestErrorBreakdowntest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_median_is_the_middle_sample_not_the_mean_a_slow_tail_would_drag TestPercentilestest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_no_requests_reports_zero_cost_rather_than_dividing_by_zero TestCpuUtilizationtest_proxy_usage.py›
No steps recorded
View test on GitHub ↗✓test_no_samples_reports_zero_rather_than_dividing_by_an_empty_histogram TestPercentilestest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_ordinary_locust_chatter_is_not_reported_as_a_warning TestGeneratorSaturationtest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_partial_total_between_batch_flushes_is_not_accepted_as_final TestSettledSpendtest_session_anomaly.py›
No steps recorded
View test on GitHub ↗✓test_percentiles_merge_the_histograms_of_every_stats_entry TestPercentilestest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_repeated_cpu_warnings_collapse_to_one_and_reach_the_diagnosis TestGeneratorSaturationtest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_session_aborted_on_first_turn_counts_all_its_planned_turns_as_failed TestSummarizePlannedTurnstest_session_anomaly.py›
No steps recorded
View test on GitHub ↗✓test_several_stats_entries_for_one_route_fold_into_a_single_row TestPerEndpointtest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_shrinking_is_never_a_violation TestRatioBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_spend_that_never_becomes_nonzero_raises TestSettledSpendtest_session_anomaly.py›
No steps recorded
View test on GitHub ↗✓test_spend_that_never_stabilizes_raises TestSettledSpendtest_session_anomaly.py›
No steps recorded
View test on GitHub ↗✓test_summary_reports_every_percentile_in_human_units TestCpuUtilizationtest_proxy_usage.py›
No steps recorded
View test on GitHub ↗✓test_tail_percentiles_come_from_the_slow_end_of_the_histogram TestAggregatetest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_the_summary_names_every_route_with_its_counts TestPerEndpointtest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_the_tail_percentiles_reach_the_peak_the_median_hides TestRssPercentilestest_proxy_usage.py›
No steps recorded
View test on GitHub ↗✓test_the_tail_percentiles_reach_the_slow_samples_the_median_hides TestPercentilestest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_the_unit_and_decimals_carry_into_the_message TestRatioBudgettest_phase_budget.py›
No steps recorded
View test on GitHub ↗✓test_throughput_spans_from_the_earliest_start_when_locust_reports_several_entries TestAggregatetest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_throughput_spans_the_whole_window_and_latency_comes_from_the_histogram TestAggregatetest_locust_load.py›
No steps recorded
View test on GitHub ↗✓test_transient_failures_then_success_returns_the_success TestRetriedtest_session_anomaly.py›
No steps recorded
View test on GitHub ↗✓test_utilization_is_the_counter_delta_over_the_interval_not_the_counter_itself TestCpuUtilizationtest_proxy_usage.py›
No steps recorded
View test on GitHub ↗✓test_429_on_first_deployment_succeeds_on_retry TestReliabilityRetriestest_reliability_retries_e2e.py›
No steps recorded
View test on GitHub ↗✓test_429_trips_cooldown_then_recovers TestReliabilityCooldownstest_reliability_cooldowns_e2e.py›
No steps recorded
View test on GitHub ↗✓test_5xx_on_first_deployment_succeeds_on_retry TestReliabilityRetriestest_reliability_retries_e2e.py›
No steps recorded
View test on GitHub ↗✓test_5xx_routes_to_fallback TestReliabilityFallbackstest_reliability_fallbacks_e2e.py›
No steps recorded
View test on GitHub ↗✓test_5xx_trips_cooldown_then_recovers TestReliabilityCooldownstest_reliability_cooldowns_e2e.py›
No steps recorded
View test on GitHub ↗✓test_alias_api_key_never_overrides_the_tier_credential TestAliasParamForwardingtest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_auth_failure_on_first_deployment_succeeds_on_retry TestReliabilityRetriestest_reliability_retries_e2e.py›
No steps recorded
View test on GitHub ↗✓test_auth_failure_trips_cooldown_then_recovers TestReliabilityCooldownstest_reliability_cooldowns_e2e.py›
No steps recorded
View test on GitHub ↗✓test_body_tagged_chat_reaches_the_untagged_tier_after_marker_rewrite TestUntaggedTierDeploymentstest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_body_tagged_chat_routes_through_the_marker_to_its_tier TestTagSplitRoutingtest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_body_tagged_responses_with_list_input_routes_to_the_tier TestResponsesApiTagRoutingtest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cached_conversation_stays_on_deployment_holding_its_cache TestReliabilityPromptCachingAffinitytest_reliability_prompt_caching_e2e.py›
No steps recorded
View test on GitHub ↗✓test_content_policy_routes_to_fallback TestReliabilityFallbackstest_reliability_fallbacks_e2e.py›
No steps recorded
View test on GitHub ↗✓test_context_window_refusal_on_first_deployment_succeeds_on_retry TestReliabilityRetriestest_reliability_retries_e2e.py›
No steps recorded
View test on GitHub ↗✓test_context_window_routes_to_fallback TestReliabilityFallbackstest_reliability_fallbacks_e2e.py›
No steps recorded
View test on GitHub ↗✓test_cost_based_picks_cheapest_deployment TestReliabilityRoutingStrategiestest_reliability_routing_strategies_e2e.py›
No steps recorded
View test on GitHub ↗✓test_exact_cache_returns_cached TestReliabilityCachetest_reliability_cache_e2e.py›
No steps recorded
View test on GitHub ↗✓test_failing_requests_do_not_grow_rss_or_stored_request TestReliabilityMemorytest_reliability_memory_e2e.py›
No steps recorded
View test on GitHub ↗✓test_header_tagged_messages_routes_through_the_marker_to_an_untagged_tier TestUntaggedTierDeploymentstest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_header_tagged_responses_with_string_input_routes_to_the_tier TestResponsesApiTagRoutingtest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_request_timeout_exceeds_deadline TestReliabilityTimeoutstest_reliability_timeouts_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_input_reaches_the_semantic_auto_router TestSemanticAutoRouterResponsestest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_simple_shuffle_honors_weights TestReliabilityRoutingStrategiestest_reliability_routing_strategies_e2e.py›
No steps recorded
View test on GitHub ↗✓test_stream_timeout_exceeds_deadline TestReliabilityTimeoutstest_reliability_timeouts_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tagged_call_straight_at_an_untagged_deployment_stays_denied TestUntaggedTierDeploymentstest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_timeout_on_first_deployment_succeeds_on_retry TestReliabilityRetriestest_reliability_retries_e2e.py›
No steps recorded
View test on GitHub ↗✓test_timeout_routes_to_fallback TestReliabilityFallbackstest_reliability_fallbacks_e2e.py›
No steps recorded
View test on GitHub ↗✓test_timeout_trips_cooldown_then_recovers TestReliabilityCooldownstest_reliability_cooldowns_e2e.py›
No steps recorded
View test on GitHub ↗✓test_trivial_ask_behind_keyword_heavy_system_prompt_stays_on_the_cheap_tier TestComplexityHeuristicScopetest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_untagged_chat_is_always_served_by_the_plain_deployment TestTagSplitRoutingtest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_untagged_messages_is_served_by_the_plain_deployment TestTagSplitRoutingtest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_untagged_responses_is_served_by_the_plain_deployment TestResponsesApiTagRoutingtest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗✓test_usage_based_picks_deployment_with_tpm_headroom TestReliabilityRoutingStrategiestest_reliability_routing_strategies_e2e.py›
No steps recorded
View test on GitHub ↗✓test_zero_priced_alias_still_logs_spend_at_the_tier_rate TestStrategyAliasPricingtest_auto_router_regressions_e2e.py›
No steps recorded
View test on GitHub ↗−test_latency_based_routes_around_deployment_that_times_out TestReliabilityRoutingStrategiestest_reliability_routing_strategies_e2e.py›
No steps recorded
LIT-7682: since #40229 the per-request routing_strategy override runs without the latency sampler, so latency-based has no signal to route on
View test on GitHub ↗−test_least_busy_avoids_deployment_with_request_in_flight TestReliabilityRoutingStrategiestest_reliability_routing_strategies_e2e.py›
No steps recorded
LIT-7682: since #40229 the per-request routing_strategy override runs without the in-flight counter, so least-busy has no signal to route on
View test on GitHub ↗−test_llm_classifier_runs_and_routes_by_semantic_tier TestComplexityRouterLlmClassifiertest_complexity_router_e2e.py›
No steps recorded
product bug LIT-4521: LLM classifier returns SIMPLE for short hard prompts (e.g. Is P equal to NP?); re-enable when classifier tier quality is fixed
View test on GitHub ↗✓test_a_kept_header_is_identity TestKeyDistinctnesstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_a_volatile_header_is_not_identity TestKeyDistinctnesstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_file_content_is_identity TestKeyDistinctnesstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_form_fields_are_identity TestKeyDistinctnesstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_generated_ids_in_the_path_do_not_change_the_key TestKeyStabilitytest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_key_names_method_path_and_digest TestKeyShapetest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[api_base-False] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[api_key-True] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[aws_secret_access_key-True] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[aws_session_token-True] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[langfuse_secret_key-True] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[max_completion_tokens-False] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[model-False] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[openai_api_key-True] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[static_headers-True] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_names_that_carry_credentials[vertex_credentials-True] TestSecretFieldstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_query_params_are_identity TestKeyDistinctnesstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_requests_differing_only_inside_canonicalized_fields_stay_distinct TestKeyDistinctnesstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef-<sha256>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[2026-08-19-<date>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[2026-08-19T20:57:13.363499+00:00-<timestamp>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[9f1c8a2e-4b3d-4f6a-8f2f-0a1b2c3d4e5f-<uuid>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[batch_688a8b7f9a08819096e0f7c88fcd07c5-<id>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[chatcmpl-C0LO6rRkfJlpJ2mqW9BHYo4Sm8FWl-<id>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[e2e-chat-stream-4d5152a995b7-e2e-chat-stream-<marker>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[file-XyZ12345abc-<id>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[gpt-4o-mini-gpt-4o-mini] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[max_tokens-max_tokens] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[Reply ok. 4d5152a995b7-Reply ok. <marker>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[sk-1234-sk-1234] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[sk-3mCXCTGmYuEEIU2i2qmVE3Xq6tSK1O0X6ZIRP1Lpw8ZlbNjt-<key>] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_rewrites_exactly_the_volatile_shapes[zzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz-zzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz] TestPlaceholderstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_secret_set_versus_unset_stays_distinct TestKeyDistinctnesstest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_serialization_order_is_not_identity TestKeyStabilitytest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_volatile_material_does_not_change_the_key TestKeyStabilitytest_fixture_canonical.py›
No steps recorded
View test on GitHub ↗✓test_apply_guardrail_blocks_banned_and_allows_clean TestApplyGuardrailEndpointtest_apply_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_post_call_blocks_denied_model_output TestBedrockGuardrailtest_bedrock_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bedrock_pre_call_blocks_harmful_prompt TestBedrockGuardrailtest_bedrock_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_blocks_execution_request_but_allows_explanation TestBlockCodeExecutionGuardrailtest_block_code_execution_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_chat_blocks_category TestOpenAIModerationCategoryMatrixtest_openai_moderation_category_matrix_e2e.py›
No steps recorded
View test on GitHub ↗✓test_during_call_blocks_stream_before_first_chunk TestBedrockDuringCallStreamingtest_streaming_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_global_guardrail_blocks_key_without_team_opt_out TestTeamDisableGlobalGuardrailtest_team_disable_global_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_http_failure_is_not_hidden_by_a_later_success[400]test_guardrails_client.py›
No steps recorded
View test on GitHub ↗✓test_http_failure_is_not_hidden_by_a_later_success[401]test_guardrails_client.py›
No steps recorded
View test on GitHub ↗✓test_http_failure_is_not_hidden_by_a_later_success[429]test_guardrails_client.py›
No steps recorded
View test on GitHub ↗✓test_http_failure_is_not_hidden_by_a_later_success[500]test_guardrails_client.py›
No steps recorded
View test on GitHub ↗✓test_masking_run_is_recorded_on_the_spend_log TestPresidioSpendLogRecordtest_presidio_masking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_messages_blocks_category TestOpenAIModerationCategoryMatrixtest_openai_moderation_category_matrix_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_exact_guardrail_returns_failure_evidence_at_deadline[]test_guardrails_client.py›
No steps recorded
View test on GitHub ↗✓test_missing_exact_guardrail_returns_failure_evidence_at_deadline[global-filter]test_guardrails_client.py›
No steps recorded
View test on GitHub ↗✓test_missing_exact_guardrail_returns_failure_evidence_at_deadline[tool-permission-sibling]test_guardrails_client.py›
No steps recorded
View test on GitHub ↗✓test_moderation_blocks_flagged_input TestOpenAIModerationGuardrailtest_openai_moderation_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_moderation_blocks_flagged_input_on_messages TestOpenAIModerationGuardrailtest_openai_moderation_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_post_call_masks_pii_in_model_output TestPresidioPostCallMaskingtest_presidio_masking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pre_call_allows_permitted_tool TestToolPermissionPreCalltest_tool_permission_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pre_call_blocks_tool_outside_the_allow_list TestToolPermissionPreCalltest_tool_permission_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pre_call_masks_pii_on_chat_completions TestPresidioPreCallMaskingtest_presidio_masking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pre_call_masks_pii_on_messages TestPresidioPreCallMaskingtest_presidio_masking_e2e.py›
No steps recorded
View test on GitHub ↗✓test_responses_blocks_category TestOpenAIModerationCategoryMatrixtest_openai_moderation_category_matrix_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_with_disable_flag_bypasses_global_guardrail TestTeamDisableGlobalGuardrailtest_team_disable_global_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_waits_for_requested_guardrail_after_an_unrelated_global_guardrailtest_guardrails_client.py›
No steps recorded
View test on GitHub ↗−test_request_naming_an_unknown_guardrail_fails_closedtest_guardrail_dispatch_e2e.py›
No steps recorded
stage red: product gap, a request naming a guardrail the proxy does not serve is silently served unguarded (200) instead of failing closed
View test on GitHub ↗✓test_attach_is_idempotent TestResultPropertiestest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_bar-logging] TestPackageFromNodeid::test_package_is_the_first_dir_under_the_suite_root[logging/test_x.py::TestFootest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_bar-logging] TestPackageFromNodeid::test_package_is_the_first_dir_under_the_suite_root[tests/e2e/logging/test_x.py::TestFootest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_bar-quota_management] TestPackageFromNodeid::test_package_is_the_first_dir_under_the_suite_root[quota_management/spend_tracking/test_x.pytest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_bar-root] TestPackageFromNodeid::test_package_is_the_first_dir_under_the_suite_root[tests/e2e/test_fixture_mode.pytest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_both_invocation_shapes_collapse_to_the_same_components[./logging/test_x.py] TestSuitePartstest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_both_invocation_shapes_collapse_to_the_same_components[logging/test_x.py] TestSuitePartstest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_both_invocation_shapes_collapse_to_the_same_components[tests/e2e/logging/test_x.py] TestSuitePartstest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_both_invocation_shapes_collapse_to_the_same_components[tests\\e2e\\logging\\test_x.py] TestSuitePartstest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_every_test_carries_package_covers_and_source TestResultPropertiestest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_ids_are_unique_order_preserving_and_non_empty_strings TestDedupeCoverstest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_known_values_normalize-root] TestPackageFromNodeid::test_package_is_the_first_dir_under_the_suite_root[test_fixture_mode.py::TestParseFixtureModetest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_line_is_emitted_one_based TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_nothing_linkable_yields_empty_rather_than_a_guess[-40] TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_nothing_linkable_yields_empty_rather_than_a_guess[../conftest.py-40] TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_nothing_linkable_yields_empty_rather_than_a_guess[/app/e2e/a2a/test_x.py-40] TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_nothing_linkable_yields_empty_rather_than_a_guess[a2a/test_x.py-None] TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_nothing_linkable_yields_empty_rather_than_a_guess[C:\\app\\e2e\\a2a\\test_x.py-40] TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_path_is_repo_relative_however_pytest_was_started[a2a/test_a2a_agent_e2e.py] TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_path_is_repo_relative_however_pytest_was_started[tests/e2e/a2a/test_a2a_agent_e2e.py] TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_top_level_suite_file_keeps_its_single_component TestSuitePartstest_junit_properties.py›
No steps recorded
View test on GitHub ↗✓test_top_level_suite_file_sits_directly_under_the_suite_root TestSourceFromLocationtest_junit_properties.py›
No steps recorded
View test on GitHub ↗−test_suite_root_names_this_file_s_real_home TestSuiteRoottest_junit_properties.py›
No steps recorded
no checkout above this file (the runner image copies tests/e2e/ to /app/e2e)
View test on GitHub ↗✓test_429_is_never_retried TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_a_non_streaming_outcome_carries_no_arrivals TestStreamEventArrivalstest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_body_that_is_not_json_is_still_a_validation_failure TestClassifyEmptyBodytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_each_event_is_stamped_at_the_moment_its_line_arrives TestStreamEventArrivalstest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_empty_2xx_body_is_a_success TestClassifyEmptyBodytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[200] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[201] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[400] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[401] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[404] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[422] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[500] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[502] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[503] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_non_transient_status_returns_immediately[504] TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_overloaded_529_retries_with_backoff_then_returns_the_success TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_partial_body_omits_unset_fields_and_sends_explicit_none_as_null TestWireBodytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_persistent_transient_is_bounded_and_returns_the_last_response TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_plain_body_drops_none_fields TestWireBodytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_qualification_disables_retries_and_restores_the_default TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_transient_set_is_only_statuses_the_proxy_cannot_emit TestTransientRetryPolicytest_e2e_http.py›
No steps recorded
View test on GitHub ↗✓test_a_missing_admin_credential_fails_loudly_instead_of_skipping[ ]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_a_missing_admin_credential_fails_loudly_instead_of_skipping[]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_a_refused_create_fails_the_test_with_the_idps_own_wordstest_idp.py›
No steps recorded
View test on GitHub ↗✓test_cleanup_failure_is_visibletest_idp.py›
No steps recorded
View test on GitHub ↗✓test_connection_details_come_from_the_environmenttest_idp.py›
No steps recorded
View test on GitHub ↗✓test_create_without_a_resource_id_fails[]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_create_without_a_resource_id_fails[http://keycloak/groups/]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_created_id_is_the_last_segment_of_the_location_headertest_idp.py›
No steps recorded
View test on GitHub ↗✓test_expired_admin_credentials_do_not_abort_remaining_cleanupstest_idp.py›
No steps recorded
View test on GitHub ↗✓test_new_users_are_born_fully_set_uptest_idp.py›
No steps recorded
View test on GitHub ↗✓test_oidc_launcher_removes_client_on_exit_and_termination[group-False]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_oidc_launcher_removes_client_on_exit_and_termination[normal-False]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_oidc_launcher_removes_client_on_exit_and_termination[parent-False]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_oidc_launcher_removes_client_on_exit_and_termination[parent-True]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_partial_provisioning_removes_the_group_when_user_creation_failstest_idp.py›
No steps recorded
View test on GitHub ↗✓test_provisioning_records_zero_one_or_multiple_groups[groups0]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_provisioning_records_zero_one_or_multiple_groups[groups1]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_provisioning_records_zero_one_or_multiple_groups[groups2]test_idp.py›
No steps recorded
View test on GitHub ↗✓test_realm_urls_match_keycloaks_own_layouttest_idp.py›
No steps recorded
View test on GitHub ↗✓test_strict_cleanup_reports_each_failure_and_continuestest_idp.py›
No steps recorded
View test on GitHub ↗✓test_successful_provisioning_cleans_up_user_before_grouptest_idp.py›
No steps recorded
View test on GitHub ↗✓test_allowed_model_is_permitted TestAccessControltest_access_control_e2e.py›
No steps recorded
View test on GitHub ↗✓test_bearer_invalid_token_is_denied TestChatAuthHeaderstest_chat_auth_headers_e2e.py›
No steps recorded
View test on GitHub ↗✓test_disallowed_model_is_denied_403 TestAccessControltest_access_control_e2e.py›
No steps recorded
View test on GitHub ↗✓test_empty_bearer_token_is_denied TestChatAuthHeaderstest_chat_auth_headers_e2e.py›
No steps recorded
View test on GitHub ↗✓test_group_grants_every_deployment_in_it[bare name the group's wildcard covers-<lambda>] TestKeyScopedToAccessGrouptest_model_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_group_grants_every_deployment_in_it[exactly-named deployment in the group-<lambda>] TestKeyScopedToAccessGrouptest_model_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_group_grants_every_deployment_in_it[provider-prefixed name the group's wildcard covers-<lambda>] TestKeyScopedToAccessGrouptest_model_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_group_grants_nothing_outside_it[deployment outside the group-<lambda>] TestKeyScopedToAccessGrouptest_model_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_group_grants_nothing_outside_it[name no provider claims-<lambda>] TestKeyScopedToAccessGrouptest_model_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_group_grants_nothing_outside_it[provider model outside the group's wildcard-<lambda>] TestKeyScopedToAccessGrouptest_model_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_group_grants_the_team_nothing_outside_it TestTeamScopedToAccessGrouptest_model_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_group_grants_the_teams_own_wildcard TestTeamScopedToAccessGrouptest_model_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_llm_api_routes_group_grants_every_llm_endpoint TestAccessControltest_access_control_e2e.py›
No steps recorded
View test on GitHub ↗✓test_llm_only_key_forbidden_from_management_route_403 TestAccessControltest_access_control_e2e.py›
No steps recorded
View test on GitHub ↗✓test_missing_authorization_header_is_denied TestChatAuthHeaderstest_chat_auth_headers_e2e.py›
No steps recorded
View test on GitHub ↗✓test_not_bearer_scheme_is_denied TestChatAuthHeaderstest_chat_auth_headers_e2e.py›
No steps recorded
View test on GitHub ↗✓test_token_without_bearer_prefix_is_denied TestChatAuthHeaderstest_chat_auth_headers_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unknown_model_returns_400 TestAccessControltest_access_control_e2e.py›
No steps recorded
View test on GitHub ↗✓test_valid_key_allows_and_invalid_key_denied TestVirtualKeyAuthtest_access_control_e2e.py›
No steps recorded
View test on GitHub ↗✓test_encrypted_stored_value_is_not_a_bearer_token TestSessionTokentest_session_token_e2e.py›
No steps recorded
View test on GitHub ↗✓test_expired_session_token_is_denied TestSessionTokentest_session_token_e2e.py›
No steps recorded
View test on GitHub ↗✓test_expired_token_is_rejected TestJwtAuthtest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_liveness_reports_alive_without_auth TestHealthLifecycletest_health_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_master_key_authenticates_and_grants_admin_route TestMasterKeyAuthtest_master_key_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_non_matching_master_key_is_denied TestMasterKeyAuthtest_master_key_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_plain_virtual_key_still_works_with_jwt_auth_enabled TestJwtAuthtest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_readiness_details_require_auth_and_expose_diagnostics TestHealthLifecycletest_health_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_readiness_is_reachable_without_credentials TestHealthLifecycletest_health_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_readiness_reports_connected_db TestHealthLifecycletest_health_lifecycle_e2e.py›
No steps recorded
View test on GitHub ↗✓test_signed_token_for_another_application_is_rejected TestJwtAuthtest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_signed_token_from_the_wrong_issuer_is_rejected TestJwtAuthtest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_tampered_signature_is_rejected TestJwtAuthtest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_header_with_the_alias_of_a_team_the_caller_is_not_in_is_rejected_like_an_unknown_value TestJwtTeamHeadertest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_team_header_with_the_team_alias_binds_the_same_team_as_the_team_id TestJwtTeamHeadertest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_token_naming_a_team_that_does_not_exist_is_rejected TestJwtAuthtest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unexpired_session_token_reaches_admin_route TestSessionTokentest_session_token_e2e.py›
No steps recorded
View test on GitHub ↗✓test_valid_token_for_an_existing_team_is_accepted_and_attributed TestJwtAuthtest_jwt_auth_e2e.py›
No steps recorded
View test on GitHub ↗✓test_a_streamed_response_round_trips_through_the_bundle TestRecordAndLoadtest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_bundle_at_the_limit_is_still_fresh TestFreshnesstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_corrupt_manifest_is_unreadable TestFreshnesstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_fresh_directory_gets_a_fresh_manifest TestPrepareBundletest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_interaction_filename_orders_and_slugs TestSlugstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_interactions_group_per_test TestRecordAndLoadtest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_load_bundle_rejects_a_foreign_format_version TestRecordAndLoadtest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_load_returns_interactions_in_recorded_order TestRecordAndLoadtest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_missing_manifest_is_unreadable_with_recording_hint TestFreshnesstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_naive_recorded_at_is_read_as_utc TestFreshnesstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_record_wipes_the_previous_bundle_instead_of_reading_it TestPrepareBundletest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_refuses_a_path_that_is_a_file TestPrepareBundletest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_refuses_to_wipe_a_directory_that_is_not_a_bundle TestPrepareBundletest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_same_tail_in_different_files_never_collides TestSlugstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_slug_for_test_is_deterministic TestSlugstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_stale_bundle_reports_age_and_limit TestFreshnesstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_unknown_format_version_is_unreadable TestFreshnesstest_fixture_bundle.py›
No steps recorded
View test on GitHub ↗✓test_fresh_replay_bundle_collects TestCollectionGatetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_invalid_mode_names_the_value_and_the_choices TestCollectionGatetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_known_values_normalize[ REPLAY -replay] TestParseFixtureModetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_known_values_normalize[-live] TestParseFixtureModetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_known_values_normalize[live-live] TestParseFixtureModetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_known_values_normalize[record-record] TestParseFixtureModetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_known_values_normalize[replay-replay] TestParseFixtureModetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_live_and_record_never_block_collection[] TestCollectionGatetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_live_and_record_never_block_collection[live] TestCollectionGatetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_live_and_record_never_block_collection[record] TestCollectionGatetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_live_mode_prints_nothing TestReportHeadertest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_names_this_test_and_strips_the_phase TestCurrentTestKeytest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_record_and_replay_name_the_bundle TestReportHeadertest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_replay_with_no_bundle_says_how_to_record_one TestCollectionGatetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_sequence_is_a_pure_function_of_test_and_ordinal TestDeterministicMarkertest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_stale_replay_bundle_fails_naming_its_age TestCollectionGatetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_unknown_value_is_invalid_with_the_original_spelling TestParseFixtureModetest_fixture_mode.py›
No steps recorded
View test on GitHub ↗✓test_cell_claimed_only_by_a_skipped_test_is_uncoveredtest_collector.py›
No steps recorded
View test on GitHub ↗✓test_collection_counts_only_markers_on_tests_that_would_runtest_collector.py›
No steps recorded
View test on GitHub ↗✓test_compute_coverage_counts_covered_p0_and_gapstest_collector.py›
No steps recorded
View test on GitHub ↗✓test_json_render_exposes_module_coverage_for_grafana_jobstest_collector.py›
No steps recorded
View test on GitHub ↗✓test_llm_cells_roll_up_by_core_endpointtest_collector.py›
No steps recorded
View test on GitHub ↗✓test_load_registry_rejects_duplicate_idstest_collector.py›
No steps recorded
View test on GitHub ↗✓test_logging_and_guardrail_roll_up_into_one_moduletest_collector.py›
No steps recorded
View test on GitHub ↗✓test_loki_render_exposes_exact_stdout_lines_for_lokitest_collector.py›
No steps recorded
View test on GitHub ↗✓test_orphan_marker_is_reported_not_countedtest_collector.py›
No steps recorded
View test on GitHub ↗✓test_prometheus_render_exposes_module_coverage_timeseriestest_collector.py›
No steps recorded
View test on GitHub ↗✓test_real_registry_loads_and_ids_are_uniquetest_collector.py›
No steps recorded
View test on GitHub ↗✓test_skipped_marker_outside_the_registry_is_still_an_orphantest_collector.py›
No steps recorded
View test on GitHub ↗✓test_text_render_uses_plain_coverage_languagetest_collector.py›
No steps recorded
View test on GitHub ↗✓test_access_group_scopes_tool_selection TestMcpAccessGroupToolSelectiontest_mcp_access_group_e2e.py›
No steps recorded
View test on GitHub ↗✓test_alias_grant_persists_verbatim_and_lists_tools TestMcpKeyGrantByAliastest_mcp_key_access_e2e.py›
No steps recorded
View test on GitHub ↗✓test_call_tool_denied_without_permission TestMcpKeyWithoutAccessIsDeniedtest_mcp_key_access_e2e.py›
No steps recorded
View test on GitHub ↗✓test_content_filter_blocks_banned_keyword_in_tool_args TestMcpToolCallGuardrailtest_mcp_guardrail_e2e.py›
No steps recorded
View test on GitHub ↗✓test_key_granted_a_toolset_lists_exactly_its_tools TestMcpToolsetEnforcementtest_mcp_toolset_enforcement_e2e.py›
No steps recorded
View test on GitHub ↗✓test_list_tools_denied_without_permission TestMcpKeyWithoutAccessIsDeniedtest_mcp_key_access_e2e.py›
No steps recorded
View test on GitHub ↗✓test_route_restricted_health_matches_server_grants TestMcpHealthVisibilitytest_mcp_key_access_e2e.py›
No steps recorded
View test on GitHub ↗✓test_search_logs_finds_seeded_completion TestDatadogMcpRoundTriptest_mcp_datadog_e2e.py›
No steps recorded
View test on GitHub ↗−test_chat_completion_uses_linear_with_authorization_bearer_header TestMcpChatCompletionOauthtest_mcp_chat_completion_oauth_e2e.py›
No steps recorded
set E2E_LINEAR_STORAGE_STATE to a Linear session captured via mcp/linear_session_capture.py
View test on GitHub ↗−test_chat_completion_uses_linear_with_x_litellm_api_key_header TestMcpChatCompletionOauthtest_mcp_chat_completion_oauth_e2e.py›
No steps recorded
set E2E_LINEAR_STORAGE_STATE to a Linear session captured via mcp/linear_session_capture.py
View test on GitHub ↗✓test_discovery_card_is_proxy_fronted TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗✓test_malformed_protocol_version_rejected TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗✓test_message_send_runs_completion_bridge TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pinned_v0_3_serves_flat_message_shape TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗✓test_pinned_v1_0_serves_nested_message_shape TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗✓test_real_world_agent_replies_to_property_query TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗✓test_register_persists TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗✓test_semver_protocol_version_registers_and_serves TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗✓test_unsupported_protocol_version_rejected TestA2AAgentLifecycletest_a2a_agent_e2e.py›
No steps recorded
View test on GitHub ↗−llm_translation/realtime/test_realtime_pipecat_audio_e2e.pyllm_translation/realtime/test_realtime_pipecat_audio_e2e.py›
No steps recorded
collection skipped