UMA1 Interop Features and Feature Tests
Table of Contents | ||||
---|---|---|---|---|
|
The features and tests relate exclusively to the core protocol spec, any other normatively referenced specs, and software components that serve as protocol endpoints. None relate to the Binding Obligations specification because it describes expected behaviors of operators and users of these endpoints, which makes them untestable for the purposes of an interop.
TODO:
- Fill in supporting clauses for resource protection feature(s).
- Discuss and resolve issues under each feature.
F-as-config: AS makes available its configuration data in the correct form at the correct location
Supporting clauses | Test ID | Type | Role | Description | Success condition |
---|---|---|---|---|---|
Issues: We no longer say RS and C MUST retrieve the config data. Should we? Should the last two tests here be "opt"? | FT-as-config-data | req | AS | AS provides configuration data that conforms to specified format | Data conforms to format requirements |
FT-as-config-endpts | opt | AS | AS makes config data available through SSL/TLS-protected URL | AS config data endpoint uses https: scheme and RS or client is able to validate AS's certificate | |
FT-rs-get-config-data | req | RS | RS successfully accesses and parses AS config data properties it needs at http://{as_uri}/.well-known/uma-configuration or https://\{as_uri}/.well-known/uma-configuration, including all endpoint-related properties not specific to the client and including handling of non-understood extension properties | RS successfully accesses and parses AS config data | |
FT-c-get-config-data | req | C | Client successfully accesses and parses AS config data properties it needs at http://\{as_uri}/.well-known/uma-configuration or https://{as_uri}/.well-known/uma-configuration, including all endpoint-related properties not specific to the RS and including handling of non-understood extension properties | Client successfully accesses and parses AS config data |
F-dyn-client-reg: AS supports generating dynamic client credentials and RS and client support getting them
Supporting clauses | Test ID | Type | Role | Description | Success condition |
---|---|---|---|---|---|
Issues: Typo in Core Sec 1.4: s/absent/absence/ | FT-as-dyn-client-reg | opt | AS | AS config data "dynamic_client_endpoint" property is non-null | AS config data "dynamic_client_endpoint" property has a valid URL value for a DynClientReg endpoint |
FT-rs-get-dyn-client-creds | opt | RS | RS interacts with AS to request and receive client credentials dynamically | RS gets client credentials dynamically | |
FT-c-get-dyn-client-creds | opt | C | C interacts with AS to request and receive client credentials dynamically | C gets client credentials dynamically |
F-pat: AS successfully issues PAT to RS for use at AS's protection API
Supporting clauses | Test | Type | Role | Description | Success condition |
---|---|---|---|---|---|
Issues: The repetition of the statement in Sec 3.2 should be removed as appropriate. | FT-rs-get-pat | req | AS | AS issues PAT to RS given correct OAuth authorization_code grant flow (required by the spec) and request for protection API | AS issues PAT to RS IFF RS engages correctly and with correct scope |
FT-as-pat-profile | opt | AS | AS supports additional PAT token types as declared in configuration data | ? | |
FT-as-pat-grant-types | opt | AS | AS supports additional PAT grant types as declared in configuration data | ? | |
FT-as-require-pat | req | AS | AS requires OAuth clients of protection API (definitionally, RSs) to present valid OAuth access tokens with protection API scope in order to use endpoints | AS allows RSs to make protection API calls IFF they present protection API scope | |
FT-rs-use-pat | req | RS | RS presents valid OAuth access token with protection API scope when making calls to all protection API endpoints | RS presents PAT to all protection API endpoints |
F-aat: AS successfully issues AAT to Client for use at AS's authorization API
Supporting clauses | Test | Type | Role | Description | Success condition |
---|---|---|---|---|---|
Issues: How should the optional test success conditions be worded? Should we even test this? Does anyone want to do those yet? Perhaps they should be associated with only profile-specific features that are defined by the relevant stakeholders. | FT-c-get-aat | req | AS | AS issues AAT to Client given correct OAuth authorization_code grant flow (required by the spec) and request for authorization | AS issues AAT to client IFF client engages correctly and with correct scope |
FT-as-aat-profile | opt | AS | AS supports additional AAT token types as declared in configuration data | ? | |
FT-as-aat-grant-types | opt | AS | AS supports additional AAT grant types as declared in configuration data | ? | |
FT-as-rsr-scopes | req | AS | AS retrieves (or attempts to retrieve) scope descriptions associated with resource set description at the time RS registers and updates it, and also attempts to re-retrieve relevant scope descriptions whose cached versions have expired when resource owner begins an AS interaction session | AS attempts to retrieve scope descriptions | |
FT-as-require-aat | req | AS | AS requires OAuth clients of authorization API to present valid OAuth access tokens with authorization API scope in order to use endpoints | AS allows client to make authorization API calls IFF they present authorization API scope |
F-rsr: RS registers resource sets at AS in order to put them under AS protection
...
- Core 2: "In an ongoing fashion, the resource server registers any resource sets with the authorization server for which it intends to outsource protection, using the process defined by [OAuth-resource-reg]." (non-normative)
- RSR 2.1: "Scope descriptions MAY contain extension properties that are not defined in this specification."
- RSR 2.2: "When a resource server creates or updates a resource set description (see Section 2.3), the authorization server MUST attempt to retrieve the referenced scope descriptions so that it can present fresh data in any resource owner interactions."
- RSR 2.3: "Following is a summary of the five registration operations the authorization server is REQUIRED to support. Each is defined in its own section below. All other methods are unsupported." (see all RSR 2.3 subsections)
- RSR 2.3: "If the request to the resource set registration endpoint is incorrect, then the authorization server responds with an error message by including one of the following error codes with the response..."
Issues: RSR 2.1: s/scope/Scope/ at beginning of sentence. Need some special error condition if a scope description is malformed? We no longer say anything explicit about cached versions of resource set descriptions; should we? If not, revise RT-as-rsr-scopes?
...
UMA1 Interop Features and Feature Tests
Main UMA1 Interop Testing page | Participants and Solutions | Results
Table of Contents | ||||
---|---|---|---|---|
|
The feature tests provided below are historical. We are redesigning them in light of feedback from the OpenID Connect interop and conformance testing process and Roland Hedberg's UMA test suite implementation process. The tests below may be inaccurate with respect to UMA V1.0 Candidate specs, as they date from the pre-V0.9 era.
...
These feature tests relate exclusively to the core protocol specification, any other normatively referenced technical specifications, and the software entities that serve as protocol endpoints implementing these specifications. None relate to the Binding Obligations specification because that spec describes expected behaviors of operators and users of these endpoints, which makes them untestable for the purposes of an interop. Feature tests are marked as either required (req) or optional (opt) based on the optionality of the underlying spec clauses they're derived from, where req is for all testable MUST/REQUIRED clauses and opt is for all other testable clauses. We have not yet defined what "full conformance" means in any formal sense. (A few untestable clauses do appear in the technical specifications.)
A feature test identifier has three parts, separated by hyphens. Every identifier starts with FT. The second part indicates the software entity being tested: AS, RS, or C. The third part, which may have embedded hyphens, describes the nature of the test. The supporting clauses in the technical specifications have been classified using feature "tags". The tests are grouped under primary feature tags for ease of test result reporting.
Feature tests for "config"
Machine-readability of entity capabilities and constraints.
ID | req/opt | Description | Success |
---|---|---|---|
FT-as-config-data | req | AS provides configuration data that conforms to specified formats and provides all required properties and values. | Data conforms and is complete
|
FT-as-config-endpt | req | AS makes config data available through https://as_uri/.well-known/uma-configuration. | AS config data endpoint uses https: scheme with specific URL form, with a valid certificate |
FT-rs-get-config-data | opt | RS successfully accesses and parses AS config data properties it needs at https://as_uri/.well-known/uma-configuration, including all endpoint-related properties not specific to the RS and including handling of non-understood extension properties. | RS successfully accesses and parses AS config data |
FT-c-get-config-data | opt | Client successfully accesses and parses AS config data properties it needs at https://as_uri/.well-known/uma-configuration, including all endpoint-related properties not specific to the client and including handling of non-understood extension properties. | Client successfully accesses and parses AS config data |
Feature tests for "dynreg"
Client registration of resource servers (which are clients of the AS's protection API) and clients of resource servers (which are also clients of the AS's authorization API) at run time when services have not "met" before a resource owner or requesting party forces the issue.
ID | req/opt | Description | Success |
---|---|---|---|
FT-as-dyn-client-reg | opt | AS config data "dynamic_client_endpoint" property provides a URI value | Property has a URI provided |
FT-rs-get-dyn-client-creds | opt | RS interacts with AS to request and receive client credentials dynamically | RS gets client credentials dynamically |
FT-c-get-dyn-client-creds | opt | C interacts with AS to request and receive client credentials dynamically | C gets client credentials dynamically |
Feature tests for "pat"
"Protection of the protection API" at the authorization server, and the association made between the authorization server, resource server, and resource owner as a result of protection API token (PAT) issuance.
ID | req/opt | Description | Success |
---|---|---|---|
FT-rs-get-pat | req | AS issues PAT to RS using OAuth authorization_code grant flow and request for protection API scope | AS issues PAT to RS IFF RS engages correctly |
FT-as-require-pat | req | AS requires OAuth clients of protection API (definitionally, RSs) to present valid OAuth access tokens with protection API scope in order to use endpoints | AS allows RSs to make protection API calls IFF they present protection API scope |
FT-rs-use-pat | req | RS presents valid OAuth access token with protection API scope when making calls to all protection API endpoints | RS presents PAT to all protection API endpoints |
Feature tests for "aat"
"Protection of the authorization API" at the authorization server, and the association made between the authorization server, client, and requesting party as a result of authorization API token (AAT) issuance.
ID | req/opt | Description | Success |
---|---|---|---|
FT-c-get-aat | req | AS issues AAT to Client given OAuth authorization_code grant flow and request for authorization API scope | AS issues AAT to client IFF client engages correctly |
FT-as-require-aat | req | AS requires OAuth clients of authorization API (definitionally, Clients) to present valid OAuth access tokens with authorization API scope in order to use endpoints | AS allows Client to make authorization API calls IFF they present authorization API scope |
FT-c-use-aat | req | Client presents valid OAuth access token with authorization API scope when making calls to all authorization API endpoints | Client presents AAT to all authorization API endpoints |
Feature tests for "protapi"
RS-AS communication through the protection API and its various endpoints.
ID | req/opt | Description | Success | |||||
---|---|---|---|---|---|---|---|---|
FT-as-rsr | req | AS presents all of the following methods at a resource set registration endpoint of form rsreguri/resource_set/rsid, and treats others as unsupported: PUT with unique ID to register new resource set description; GET with unique ID to read already-registered resource set description, handling the presence of any policy_uri property in AS's response; PUT with If-Match and unique ID to update already-registered resource set description, handling the presence of any policy_uri property in AS's response; DELETE with a unique ID to delete an already-registered resource set description; and GET on resource_set path to read list of already-registered resource set descriptions. RS links to well-formed scope set descriptions. | RS uses able to use all elements of resource set registration API and scope description format correctly | FT-as-rsr-error | req | AS | AS issues errors for error conditions, including unsupported_method_type, not_found, and precondition_failed. | AS issues resource set registration API errors for error conditions |
FT-asrs-rsr-scopes | req | AS | AS retrieves (or attempts to retrieve) scope descriptions associated with resource set description at the time RS registers and updates it, and also attempts to re-retrieve relevant scope descriptions whose cached versions have expired when resource owner begins an AS interaction session | AS attempts to retrieve scope descriptions | ||||
FT-as-rsr-scope-display | opt | AS | In the interface it presents to a resource owner, AS uses scope names and any icons defined as part of registered scope descriptions associated with that resource owner | AS displays scope description information | ||||
FT-as-rsr-scope-ext | req | AS | If a scope description contains extension properties, the AS proceeds normally in handling the scope description | AS does not produce an error on encountering extension properties in scope description |
F-protect-rsrc: RS, AS, and client interact to enable authorized access to protected resources and block unauthorized access
Supporting clauses | Test ID | Type | Role | Description | Success condition |
---|---|---|---|---|---|
Issues: Break down these feature tests into smaller chunks? What makes sense? The list of supporting clauses will be huge once we fill it in. | FT-unprotected-resource | req | RS | RS responds to access request for unprotected resource without including anything UMA-specific in the response | RS responds in non-UMA fashion |
FT-no-rpt | req | RS | RS responds to client not bearing an RPT with HTTP 401 and correct as_uri corresponding to resource to which access was attempted | RS responds with HTTP 401 and as_uri | |
FT-c-get-rpt | req | C | Client presents valid AAT at AS's RPT endpoint to get RPT | Client qualifies for and gets RPT | |
FT-as-issue-rpt | req | AS | AS RS uses: PUT with unique ID to register new resource set description; GET with unique ID to read already-registered resource set description, handling the presence of any policy_uri property in AS's response; PUT with If-Match and unique ID to update already-registered resource set description, handling the presence of any policy_uri property in AS's response; DELETE with a unique ID to delete an already-registered resource set description; and GET on resource_set path to read list of already-registered resource set descriptions. RS links to well-formed scope descriptions and provides well-formed resource set descriptions. | RS uses all elements of resource set registration API and scope and resource set description formats correctly | |
FT-as-rsr-error | req | AS issues errors for resource set registration error conditions, including unsupported_method_type, not_found, and precondition_failed. | AS issues resource set registration API errors for error conditions | ||
FT-as-rsr-scope-ext | req | If a scope description contains extension properties, the AS proceeds normally in handling the scope description. | AS does not produce an error on encountering extension properties in scope description | ||
FT-as-introspect | req | AS presents the token introspection endpoint, supporting only the POST method. | RS able to use token introspection endpoint | ||
FT-rs-introspect | req | RS presents a valid RPT at AS's token introspection endpoint to get token's status. | RS gets well-formed RPT status | ||
FT-as-reg-perm | req | AS presents a permission registration endpoint that enables RS to register permission associated with correct resource owner, resource set, and scopes, and returns securely random permission ticket in response to RS registration of requested permission. | AS returns permission ticket that is securely random | ||
FT-rs-reg-perm | req | RS presents a valid PAT, and valid previously registered resource set and scope information, at AS's permission registration endpoint to register a requested permission that is relevant for the type of access attempted by client. | RS registers requested permission |
Feature tests for "authzapi"
C-AS communication through the authorization API and its various endpoints.
ID | req/opt | Role | Description | Success | ||
---|---|---|---|---|---|---|
FT-as-rpt | req | AS | AS presents the RPT endpoint and AS issues RPT in response to client's request for an RPT at the correct endpoint with a valid AAT | AS issues RPT | ||
FT-rs-introspect-rpt | req | RS | RS presents valid RPT at AS's token introspection endpoint to get token's status | RS gets well-formed RPT status | ||
FT-as-introspect-. | Client able to get RPT using endpoint | |||||
FT-c-rpt | req | ASC | Client presents valid AAT at AS returns RPT's status in response to RS requestAS returns well-formed RPT statusRPT endpoint to get RPT. | Client gets new or refreshed RPT | ||
FT-rsc-invalidauthz-rptdata | req | RS | RS responds to client bearing invalid RPT with HTTP 401 and correct as_uri corresponding to resource to which access was attempted | RS responds with HTTP 401 and as_uri | ||
FT-rs-register-permission | req | RS | RS presents valid PAT at AS's permission registration endpoint to register a requested permission that would suit for the type of access attempted | RS registers requested permission | ||
FT-as-permission-ticket | req | AS | AS registers permission associated with correct resource owner and resource set and returns permission ticket in response to RS registration of requested permission | AS returns permission ticket | ||
FT-rs-insufficient-perms | req, rptbearer | RS | RS responds to client bearing valid bearer RPT with insufficient permissions with HTTP 403, as_uri, and permission ticket corresponding to resource for which access was attempted | RS responds with HTTP 403, as_uri, and permission ticket | ||
FT-c-add-authz-data | req | C | Client presents valid AAT, valid RPT, and permission ticket at AS's authorization endpoint to POST request that authorization data be associated with RPT | Client receives back normal success or error message | ||
FT-as-deny-authz-data | req | AS | AS determines that the client should not get authorization data, and returns either an invalid_ticket error, an expired_ticket error, or a not_authorized_permission error | AS returns one of the errors | ||
FT-as-give-authz-data | req | AS | AS associates new authorization data with the RPT that the client presented and responds with success | AS adds authorization data and responds with success | ||
FT-as-need-claims | req, rptbearer | AS | AS indicates it needs requesting party claims to considering adding permission to "bearer" RPT | AS responds to the client with a need_claims error | ||
FT-c-claims-redirect | req | C | Client redirects requesting party to AS to provide claims, providing a redirect URI, a callback URI, and a state parameter | AS redirects requesting party to ASC | Client presents valid AAT, valid RPT, and permission ticket at AS's authorization endpoint to POST request that authorization data be associated with RPT. | Client receives back normal success or error message |
FT-as-authz-data-deny | req | AS | AS determines that the client should not get authorization data, and returns either an invalid_ticket error, an expired_ticket error, or a not_authorized_permission error. | AS returns one of the errors | ||
FT-as-authz-data-give | req | AS | AS associates new authorization data with the RPT that the client presented and responds with success. | AS adds authorization data and responds with success | ||
FT-as-need-claims | req | AS | AS indicates it needs requesting party claims to considering adding permission to "bearer" profile RPT. | AS responds to the client with a need_claims error |
Feature tests for "access"
C-RS communication through the UMA-protected resource interface for the purpose of attempting and granting or denying access.
ID | req/opt | Role | Description | Success |
---|---|---|---|---|
FT-rs-no-rpt | req | RS | RS responds to client not bearing an RPT with HTTP 401 and correct as_uri corresponding to AS protecting the resource to which access was attempted. | RS responds with HTTP 401 and as_uri |
FT-rs-invalid-rpt | req | RS | RS responds to client bearing an invalid RPT with HTTP 401 and correct as_uri corresponding to AS protecting the resource to which access was attempted. | RS responds with HTTP 401 and as_uri |
FT-c-rpt | req | C | C requests access to a resource by providing a correctly formed and located RPT. | |
FT-rs-insufficient-perm | req | RS | RS responds to client bearing a valid "bearer" profile RPT that has insufficient permissions with HTTP 403, as_uri, and permission ticket corresponding to resource for which access was attempted. NOTE: Conducting this test depends on RS-specific API and scope details. | RS responds with HTTP 403, as_uri, and permission ticket |
FT-rs-respect-authz-data | req | RS | RS limits access to resource that is currently under protection at an AS for which a valid RPT with valid authorization data has not been presented by a client. NOTE: Conducting this test depends on RS-specific API and scope details. | RS blocks and grants client's access according to RPT's current status |
Feature tests for "claims"
TBS.