The following validation is a review of the guarantees offered by Quizzify to its customers. These guarantees are fully disclosed on the Quizzify website, which is the sole source for the data reviewed.
The focus of validation review was on whether the Quizzify guarantees apply clear and valid measures. Two guarantees met the standards for validation: cost and utilization; and engagement. (Note: Quizzify may offer other guarantees which have not been validated.)
Cost and Utilization
Text of the cost and utilization guarantee Part I:
If the client splits its population, Quizzify guarantees that the medical and wellness program costs per person will trend more favorably in the Quizzify cohort than the conventional wellness cohort. Under the guarantee, expenses for catastrophic or outlier events are excluded. Thus, costs for a single person that exceed $50,000 (or some other amount) would be excluded; the first $50,000 would, however, be included. An “outlier cutoff” figure will be agreed upon ahead of time by Quizzify and the client and will apply to the before and after assessments of both groups.
This guarantee is valid assuming that the two cohorts are similar except for their exposure to wellness or Quizzify programs. By using a per person measure, the guarantee ensures that population changes do not distort results. This is a valid and consistent method for ensuring that extraordinary expenses do not skew the results.
Text of the cost and utilization guarantee Part II:
If the client does NOT split the population in half but rather offers Quizzify as the lead program, Quizzify guarantees a reduction (vs. history) in the following two categories:
1. Wellness-sensitive medical event rates, as defined by Gowrisankaran et al. (Health Affairs March 2013, Vol. 32, No. 3 pp. 477 – 485)
2. A grouping of any 50 items of utilization that are proposed by the client as being overused in their population, such as CT scans. These items will have to be identifiable through simple diagnosis, procedure or drug codes, to facilitate reconciliation. Measures will be done per capita and will not use diagnosed patients as a denominator.
This form of the guarantee is also valid, as it cites a source for defining wellness-sensitive medical event rates. It applies a rate to the measure. Allowing the client to define overused procedures is also valid, limiting it to procedures that can be identified using the available data sources. Further, the guarantee specifies that diagnosed patients will not be used as a denominator for calculating rates; rather, all rates will be calculated per capita.
Text for engagement guarantee:
Companies measure engagement different ways. No matter what way is used, Quizzify guarantees that the non-engaged population will decline by half, up to 10% in total. Example: if the client has a 90% engagement rate, Quizzify will increase that to 95%. If the client has a 20% engagement rate, Quizzify will increase that to 60%. The requirements for this guarantee are:
1. The client must measure the same way (survey instrument and communication channel) in both periods and both populations, over the same time intervals and
2. The client must maintain the same incentives or penalties during the time period.
This guarantee is valid and enforceable, even if the survey instrument used has not been validated. Using the same instrument at the same time interval for both groups ensures that results are based upon an underlying consistency.
Disclaimers of Review
This review was limited to the descriptions of the guarantees published on Quizzify’s website. This review also relied upon the website’s statement that the ROI reporting applies valid measurement tools; a review of the ROI report was not undertaken.
Quizzify delivers wellness education to employees in unique, entertaining, and effective quizzes. Quizzify guarantees that participants will have lower medical costs and higher engagement levels than participants in traditional wellness programs. These guarantees apply valid measures, giving clients a clear and objective method to assess performance.