In the original version of the SEIQoL a method called judgment analysis (JA), based on social judgment theory, was used for stage 3 [
2,
3]. In social judgment theory, linear models are used to explain the impact of important factors, or cues, and their weights, on judgments. For the SEIQoL, to quantify the relative weights, subjects were presented with 30 randomly generated profiles of hypothetical situations labeled with the five chosen domains [
3]. Respondents were asked to rate the QoL they associated with each profile on a VAS. Ten of the 30 scenarios were replicates to allow for a measure of consistency of judgments. The judgments were modeled using multiple regression to produce five relative weights summing to 100 [
2]. The authors stated that JA was a successful aid to the evaluation of QoL [
2,
3,
8], but from a theoretical viewpoint the number of 20 scenarios was small. Thirty to 50 scenarios are recommended to model the five weights [
9]. McGee reported the use of 40 scenarios in the first study on the SEIQoL [
8], but in later studies only 30 scenarios were used, of which ten were replicates [
1‐
3]. Further, the time required to administer the JA to respondents is long and the task cumbersome, especially for older and cognitively impaired people. It requires compensatory decision-making processes, i.e., the ability to make an overall judgment on the basis of weighted information. These drawbacks make JA unsuitable for application in most clinical practices as well as for frequent assessment over a short period of time [
1]. Because of these problems with JA, Browne et al. [
1] developed a more easy to administer version of the SEIQoL, namely SEIQoL-direct weighting (SEIQoL-DW). Respondents are asked to fill in a pie chart in which the relative size of each sector of the pie represents the weight the respondent attaches to a QoL domain. The validity and reliability of the DW in comparison with the JA-based SEIQoL have only been investigated in two small studies. The first was done in a sample of 40 healthy volunteers [
1]. The mean absolute difference between the 200 weights derived for each method, that is, 40 times five weights, was 7.8 at the first measurement, and 7.2 at the second measurement. When weights derived from the two methods were converted to ranks and compared for agreement, the
κ value was moderate at both measurements (0.40 and 0.44, respectively). The reliability of the weights was moderate for the DW (
κ = 0.51), and only fair for JA (
κ = 0.31) [
1]. In a later study, Waldron et al. compared the psychometric characteristics of the SEIQoL-DW with the SEIQoL-JA among 80 patients with advanced incurable cancer. The index scores generated by the two methods fell within a range of 14.9 [
10]. These differences are large in clinical terms [
3]. Therefore, the authors [
10] concluded that the two methods are not interchangeable. Despite this lack of data on the DW, and its demonstrated lack of agreement with the JA, it has become the standard method for eliciting weights of the SEIQoL, due to it being simple to administer. However, a fundamental distinction in cognitive psychology is that between explicit and implicit thought [
1], and previous evidence with weighting methods suggests that respondents may be unable to provide accurate implicit weights through a method such as the DW [
1]. Indirect methods such as JA are based on more basic and simple judgmental tasks, such as paired comparisons, and thereby may reduce possible biases that may play a role in direct judgments. Further, indirect methods are more likely to avoid the social desirability effect according to which respondents bias their response toward the perceived values of the researcher/clinician [
11]. Another advantage is that indirect methods can provide measures of internal reliability and validity for individual interviews [
1]. An alternative indirect weighting method might be conjoint analysis, which was developed in mathematical psychology and, like JA, has a strong theoretical basis [
12‐
14]. As in JA, conjoint analysis is based on the premises that any treatment or health state can be described by its characteristics (or attributes) and that the extent to which an individual values a treatment or health state depends on the levels of these characteristics. The method can be used to estimate the relative importance of these attributes, and may therefore be suitable for eliciting the weights of domains of iQoL, since the domains can be seen as attributes of iQoL.
This study aims to assess the feasibility and the validity of the ACA to derive weights for iQoL domains. Furthermore, agreement of the weighting procedures performed by the ACA and the DW will be assessed. Because it would not be feasible to use the JA as well, the ACA was only compared with the DW. Since JA is rarely used and the scientific community has overwhelmingly embraced the DW, despite the lack of data on its validity, we wished to compare ACA and DW. Further, relationships of the resulting iQoL index scores with scores on a VAS for QoL and for iQoL may give more insight into the validity of both weighting methods.