Using only PSA results from your model
In a matter of seconds from the SAVI online application you can generate:
Disclaimer: This application is based on peer-reviewed statistical approximation methods. It comes with no warranty and should be utilised at the user's own risk (see here). The underlying code is made available under the BSD 3-clause license.
If you use SAVI in your work please cite our paper
The SAVI process has 4 steps (using the TABS from left to right)
Step 1: Save PSA input parametes, costs and effects as separate .csv files
Step 2: Input details about your model, then upload and check PSA samples
Step 3: View your VoI analysis
Step 4: Download your results as .csv files. Download a report as a PDF, HTML or word document
Our email address is email@example.com
(only the first 5 first rows of each dataset are shown)
Section 5.1 in Briggs, Claxton & Sculpher. Decision Modelling for Health Economic Evaluation (Handbooks for Health Economic Evaluation). OUP Oxford; 1 edition (2006). ISBN-13: 978-0198526629
A guide to cost-effectiveness acceptability curves. Fenwick & Byford. The British Journal of Psychiatry (2005) 187: 106-108 doi: 10.1192/bjp.187.2.106
This is particularly useful when comparing several strategies because the analyst and decision maker can see in one single measure the expected net value of each strategy, rather than looking at many comparisons of incremental cost-effectiveness ratios between different options. Under the rules of decision theory, the strategy with the greatest expected net benefit is optimal.
Analysis of the expected incremental net benefit helps to visualise whether particular strategies are better than others and how certain a decision maker can be about the differences.
If there are strategies with credible intervals for incremental net benefit that include zero, then there is decision uncertainty. Whether it is valuable to consider further research to reduce uncertainty is the motivation for the value of information calculations. These calculations can consider decision uncertainty arising from all uncertain parameters together (the overall expected value of perfect information – overall EVPI) or for particular sets of uncertain parameters (the expected value of perfect parameter information – EVPPI).
The calculation begins with the existing confidence intervals (or credible intervals) for the model parameters as used in the probabilistic sensitivity analysis. We then imagine a world in which we become absolutely (perfectly) certain about all of the model parameters i.e. the confidence interval for every single parameter is shrunk right down to zero. The decision maker would then be absolutely certain which strategy to select and would choose the one with highest net benefit. One can visualise this idea by imagining that instead of seeing the cloud of dots on the cost-effectiveness plane (representing current uncertainty in costs and benefits) and having to choose, the decision maker now knows exactly which 'dot' is the true value (because all of the uncertainty is removed) and so can be certain to choose the strategy which gives the greatest net benefit. In a two strategy comparison of new versus current care, if the 'true dot' turns out to be below and to the right of the threshold lambda line, then the decision maker would select the new strategy. If the 'true dot' is above and to the left, then current care would be selected. Under the current uncertainty, the decision maker will choose the strategy based on the expected costs and benefits (essentially on whether the 'centre of gravity' of the cloud is above or below the threshold line).
Partial EVPI enables identification of those parameters that contribute particularly highly to decision uncertainty. For each parameter, the expected value of removing current uncertainty is displayed in the table below. The barplot shows parameters in descending order of importance.
Although EVPPI information about individual parameters is useful, often it is more informative if EVPPI can be computed for groups of associated parameters e.g. all parameters associated with efficacy data. This is the maximum expected value of further research that will jointly inform this set of parameters.
First, define groups of parameters for which to calculate EVPPI. Choose a subset of parameters using the tick boxes and press the Calculate EVPPI button.
When calculation of the first parameter group is complete, select a new subset (remember to untick your original choices) and press the Calculate EVPPI button again. This can be repeated for any number of different groups, with all results appearing below on an expanding results table.
For subsets with up to five parameters, the GAM regression method is used. For subsets with five or more parameters the GP regression method is used. See this paper for details.
The 'Payer Strategy-Specific Burden' (PSB) and 'Payer Uncertainty Burden' (PUB) reflect the payer's financial risks.
The PSB for decision option d is the difference between the expected net benefit of the most cost-effective option, and the expected net benefit of decision option d. The PSB indicates to the Payer the risk of choosing an option that is not the most cost-effective option.
The PUB is equal to the overall Expected Value of Perfect Information. It indicates to the Payer the financial risk of making the decision with current evidence, relative to making the decision with perfect evidence.
This document contains all the tables and figures generated from the SAVI analysis of your PSA.
NB generating the document can take some time.
This web tool is an R Shiny Server application.
The source code is available on GitHub at https://github.com/Sheffield-Accelerated-VoI/SAVI.
Please cite the method as
Please email us at firstname.lastname@example.org
Please tell us about any bugs!
The method for partial EVPI computation that is implemented in this web application arose from independent research supported by the National Institute for Health Research (Mark Strong, postdoctoral fellowship PDF-2012-05-258). The views expressed in this publication are those of the authors and not necessarily those of the National Health Service, the National Institute for Health Research, or the Department of Health.