Choose criteria that expose meaningful tradeoffs

What this choice changes

Criteria should be independent enough to avoid double-counting and precise enough that two reviewers can interpret provider evidence consistently. Mandatory gates belong outside a weighted preference score.

Questions for the Shopify program team

Resolve these questions against the actual offer, customer journey, and operating model before comparing providers.

• Which criteria directly trace to the program objective?
• Could one strong feature inflate several overlapping scores?
• What evidence corresponds to each score level?
• Which failures should disqualify rather than reduce a score?

Evidence to collect

Ask for evidence that can be reviewed by commercial, operations, support, security, and legal stakeholders.

• Criteria definitions and weights
• Score-level evidence rubric
• Reviewer calibration record
• Gate and exception rules