2024-03-26 DEIA Agenda and Meeting Notes

Reminders

Jordan

Review of reminders

Charter

Jordan

Will be updating the charter work towards making recommendations as work group, etc.

Volunteers will be needed!

ID.me

Wes, Gray, Evan

• Intro: Comments submitted to NIST and Kantara

  • another round of comments for -4 expected soon

  • Hopes Kantara can set an industry standard for “metrics that matter” in the hopes that it can make it into -4

• Topics:

  • Metrics

    • Pass rates

    • Failure rates

    • Abandonment rates

    • Fraud (post-verification failure) rates

    • Time to verify (individual and aggregate)

      • Multiple pathways-details can be broken down amongst the pathways

    • Jordan:

      • Reprocessing (how many times someone had to attempt to verify)

      • Passive v. active pass rates (same for fail rates and drop-offs)

      • Time resolution

      • False positives and negatives

      • Geocoding -using different “buckets” of demographics (single or multiple) to organize populations and checks consistency amongst zip codes

        • Any clarity on definitions/methods?

          • Jordan: How to orient around that as starting basis?

          • Peter: Will look into Onfido’s approach

      • Costs/benefits

  • Some metrics will be universal amongst CSPs/processes, if they aren’t, categories/variations should be established

    • Go for the whole list, or go with the common metrics?

    • Jordan: hybrid approach - baseline, followed by tiering?

      • Foundational v. next steps (intermediate/advanced)

      • Where things are v. where they want to be

        • how to move people/orgs out of complacency?

      • Wes - do tiers add the complexity or the clarity?

        • Tiers similar to procurement process

          • Bare minimum, once that is achieved, move into 2nd /3rd tiers

    • Peter-paper on DEIA framework, similar approach (concentric circles), more precision as you moved out

    • Jordan: how do we give voice to equity via the solutions?

    • Gray: definitions for equity, underserved, etc. need clarity, as everyone has a different understanding

      • Begin using the Wiki to start defining these terms

    • Should Kantara set out these metrics/terminology?

      • Wes: set out a table and begin to fill intersecting cells

        • Aspiration-when public comments are due, share the grid

      • Peter: A)develop basic principles/baseline first

    • Gray: What does good look like in the industry?

      • Peter: Levels of inclusion

    • Jordan: standardization of testing

      • Come up with a common approach to testing

    • Definitions need to be clear

  • Goals: Principles, definitions, grid seem to be a reasonable points at which to start work

  • Jordan: would there be interest from Relying Parties for verification analysis?

    • Private v. public - getting data out of private sector will likely be a challenge

  • Action: get a demo regarding geocoding and how this is presently being used.  Continue to solicit other perspectives/usages

    • Reach out to Stephanie for academic perspective

  • Approaches used elsewhere