Health Indicators as a Measure of Individual Health Status: Public Perspectives

Xia Jing, Temiloluwa Sokoya, Yuchun Zhou, Sebastian Diaz, Timothy Law, Lina Himawan, Francisca Lekey, Lu Shi, Ronald W Gimbel

Submitted to: Journal of Medical Internet Research on: March 18, 2022

Need answer to this question?

Disclaimer: © The authors. All rights reserved. This is a privileged document currently under peer-review/community review. Authors have provided JMIR Publications with an exclusive license to publish this preprint on it’s website for review purposes only. While the final peer-reviewed paper may be licensed under a CC BY license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.

https://preprints.jmir.org/preprint/38099 [unpublished, peer-reviewed preprint]

Table of Contents

Original Manuscript 5

Supplementary Files 30

Figures 31

Figure 1 32

Figure 2 33

Multimedia Appendixes 34

Multimedia Appendix 1 35

Multimedia Appendix 2 35

Multimedia Appendix 3 35

Multimedia Appendix 4 35

Multimedia Appendix 5 35

Multimedia Appendix 6 35

Multimedia Appendix 7 35

Multimedia Appendix 8 35

Health Indicators as a Measure of Individual Health Status: Public Perspectives

Xia Jing1 MD, PhD; Temiloluwa Sokoya2 MPH; Yuchun Zhou3 PhD; Sebastian Diaz4 PhD, JD; Timothy Law3 DO; Lina Himawan3 MSc; Francisca Lekey3 MPH; Lu Shi5 PhD; Ronald W Gimbel5 PhD

1Jackson State University Jackson US

2Ohio University Athens US

3College of Medicine, Northeast Ohio Medical University Rootstown US

4Department of Public Health Sciences Clemson University Clemson US

Corresponding Author:

Xia Jing MD, PhD

Abstract

Background: Disease status, such as cancer stage, has been used in routine clinical practice to determine more accurate treatment plans. Health-related indicators, such as mortality, morbidity, and life expectancy for the population group, also have been used. Few studies, however, focus on more comprehensive and objective measures of individual health status.

Objective: We examined the perspectives of the general public on 29 health indicators to provide evidence for further prioritizing the indicators, which were obtained from the literature review. Health status is different from disease status, which can refer to different stages of cancer.

Methods: Design: This study uses a cross-sectional design.

Setting: An online survey was administered through Ohio University, ResearchMatch, and Clemson University.

Participants: Participants included the general public who are 18 years or older. A total of 1153 valid responses were included in the analysis.

Primary outcomes measures: Participants rated the importance of the 29 health indicators. The data were aggregated, cleaned, and analyzed in three ways: (1) to determine the agreement among the three samples on the importance of each indicator (IV = the three samples, DV = individual survey responses); (2) to examine the mean differences between the retained indicators with agreement across the three samples (IV = the identified indicators, DV = individual survey responses); and (3) to rank the groups of indicators after grouping the indicators with no mean differences (IV = the groups of indicators, DV = individual survey responses).

Results: The descriptive statistics indicate that the top-five rated indicators are drug or substance abuse, smoking or tobacco use, alcohol abuse, major depression, diet and nutrition. The importance of 13 of the 29 health indicators was agreed upon among the three samples. The 13 indicators were categorized into seven groups. Groups 1-3 were rated as significantly higher than Groups 4-7.

Conclusions: This study provides a baseline for prioritizing further the 29 health indicators, which can be used by electronic health records or personal health record system developers. Currently, self-rated health status is used predominantly. Our study provides a foundation to track and measure preventive services more accurately and to develop an individual health status index.

(JMIR Preprints 18/03/2022:38099)

DOI: https://doi.org/10.2196/preprints.38099

Preprint Settings

  1. Would you like to publish your submitted manuscript as preprint?

Please make my preprint PDF available to anyone at any time (recommended).

Please make my preprint PDF available only to logged-in users; I understand that my title and abstract will remain visible to all users. Only make the preprint title and abstract visible.

No, I do not wish to publish my submitted manuscript as a preprint.

  1. If accepted for publication in a JMIR journal, would you like the PDF to be visible to the public?

Yes, please make my accepted manuscript PDF available to anyone at any time (Recommended).

Yes, but please make my accepted manuscript PDF available only to logged-in users; I understand that the title and abstract will remain Yes, but only make the title and abstract visible (see Important note, above). I understand that if I later pay to participate in <a

Original Manuscript

Health Indicators as a Measure of Individual Health Status: Public Perspectives

Temiloluwa Sokoya, MPH1; Yuchun Zhou, PhD2; Sebastian Diaz, PhD, JD3; Timothy Law, DO4; Lina Himawan, MS5; Francisca Lekey, MPH6; Lu Shi, PhD7; Ronald W. Gimbel, PhD7; Xia Jing, MD, PhD*7

1Temiloluwa Sokoya, Jackson State University, Jackson, Mississippi

2Yuchun Zhou, College of Education, Ohio University, Athens, Ohio

3Sebastian Diaz, College of Medicine, Northeast Ohio Medical University, Rootstown, Ohio

4Timothy Law, Ohio Musculoskeletal and Neurologic Institute, Ohio University, Athens, Ohio

5Lina Himawan, Department of Psychology, College of Art and Sciences, Ohio University, Athens, Ohio.

6Francisca Lekey, College of Health Sciences and Professions, Ohio University, Athens, Ohio

7Lu Shi, Ronald W. Gimbel, and Xia Jing, Department of Public Health Sciences, College of Behavioral, Social, and Health Sciences, Clemson University, Clemson, South Carolina

*Corresponding Author Xia Jing, MD, PhD Edwards Hall 511

Department of Public Health Sciences

College of Behavioral, Social, and Health Sciences Clemson University

Clemson, SC 29634 Email: xjing@clemson.edu Tel: 864-656-3347

Abstract

Background: Disease status—such as cancer stage—has been used in routine clinical practice to determine more accurate treatment plans. Health-related indicators, such as mortality, morbidity, and population group life expectancy, have also been used. However, few studies specifically focus on the comprehensive and objective measures of individual health status.

Objective: The perspectives of the public toward 29 health indicators obtained from a literature review were analyzed to provide evidence for further prioritization of the indicators. The difference between health status and disease status should be considered.

Methods: This study used a cross-sectional design. Online surveys were administered through Ohio

University, ResearchMatch, and Clemson University, resulting in three samples. Participants included individuals aged ≥ 18 years. Participants rated the importance of the 29 health indicators. The rating results were aggregated, cleaned, and analyzed as follows: (1) to determine the agreement among the three samples regarding the importance of each indicator (IV = the three samples, DV = individual survey responses); (2) to examine the mean differences between the retained indicators with agreement across the three samples (IV = the identified indicators, DV = individual survey responses); and (3) to rank the groups of indicators into various levels after grouping the indicators with no mean differences (IV = the groups of indicators, DV = individual survey responses).

Results: A total of 1,153 valid responses were analyzed. Descriptive statistics revealed that the top- five rated indicators were drug or substance abuse, smoking or tobacco use, alcohol abuse, major depression, and diet and nutrition. Among the 29 health indicators, the three samples agreed upon the importance of 13. Inferential statistical analysis indicated that some of the 13 indicators held equal importance. Therefore, the 13 indicators were categorized by rank into seven levels as follows: Level 1: blood sugar level and immunization/vaccination; Level 2: LDL cholesterol; Level 3: HDL cholesterol, blood triglycerides, cancer screening detection, and total cholesterol; Level 4: health literacy rate; Level 5: personal care needs and air quality index > 100; Level 6: self-rated health status and HIV testing; and Level 7: the supply of dentists. Levels 1–3 were rated significantly higher than Levels 4–7. Among the 13 health indicators, blood sugar level and immunization/vaccination status were the most important, and the supply of dentists was the least important.

Conclusions: This study provides a baseline for prioritizing 29 health indicators, which can be used by electronic health records or personal health record system designers or developers to determine what can be included in the systems to capture an individual’s health status. Currently, self-rated health status is used predominantly. Additionally, this study provides a foundation for tracking and measuring preventive healthcare services more accurately and developing an individual health status

index.

Keywords:

Health status measurement; Individual health indicators; Public perspectives; Surveys and questionnaires

Strengths and limitations of this study

  • The work establishes the foundation to measure individual health status more comprehensively and objectively
  • The work reflects perspectives from three communities with a relatively large sample size
  • The work provides the foundation to prioritize the 29 health indicators
  • With real-world longitudinal data, the public perspective data on individual health status measurement could be verified and validated further

Introduction

Disease status, such as cancer stages, has frequently been used in routine clinical practice to determine more accurate treatment plans. Health-related indicators, such as mortality, morbidity, and life expectancy for a given population group, have also been used. Few studies, however, have focused on more comprehensive and objective measures of an individual’s health status. Self-rated health status has previously been identified as a reliable indicator of an individual’s overall health status [1, 2], but this is subjective, and the rating criteria are unclear. Although there is research on health indicators used for the measurement of care quality [3], as well as social and behavioral measures in electronic health record (EHR) systems [4, 5]; more comprehensive and objective health indicators of an individual’s health status are lacking. These must be developed and used to measure health status more accurately, objectively, and consistently, as well as to evaluate the outcomes of preventive medicine services [1, 6]. As the healthcare paradigm shifts from treatment to prevention [7, 8], the accurate, objective, and convenient measurement of preventive services and their long- term outcomes become an urgent and growing need.

Individual health status refers to a person’s overall physical, mental, and social well-being, as well as freedom from illness or injury. In contrast, individual disease status refers to a person’s

physical or mental symptoms with or without diagnosis [9]. Accurate individual health status measures can guide customized preventive medicine services and lifestyle suggestions and be applied to population health programs by aggregating an individual’s health data into meaningful groups. Chronic diseases are increasingly costly to both patients and society, and most can be prevented or delayed via preventive medicine services. These services need to be provided in a routine and consistent manner [7, 8], thus maximizing the potential to control healthcare costs.

The Institute of Medicine (IOM) reviewed social and behavioral domain measures, as seen in EHR systems [4, 5]. They identified 17 domains, and these measurements were used as a foundation for the Office of the National Coordinator for Health Information Technology’s (ONC) EHR Meaningful Use reporting requirements [4, 5]. In 2015, the Centers for Disease Control and Prevention’s National Center for Health Statistics released 15 selected health indicators based on the National Health Interview Survey [10]. Other research [1, 2, 6, 11] also considered health indicators, although none focused on comprehensive, objective measures of an individual’s health status.

Although preventive medicine has been recognized for its critical role in health care, such services are not provided consistently to the majority of the American population [12]. Because chronic diseases represent a large portion of healthcare expenditures, it is critical to prevent or delay the onset of chronic diseases via preventive services [13]. The tracking of health indicators has been reported to help policymakers note changes needed in coverage and to influence policy decisions [14]. Such tracking also enables governments to better allocate health resources [14]. Nevertheless, accurate measurements of preventive services are inadequate or lacking.

We conducted a literature review of existing health indicators [15-22]. We consolidated the described health indicators and determined that 29 health indicators could be utilized to measure an individual’s health. We then examined four commercial EHR systems used in rural, primary care, and ambulatory settings to explore the availability and presentation of these indicators as a pilot

study. None of these systems were found to capture all of the indicators [9], but each system provided data on some available health indicators, and all four systems had preventive medicine panels. The pilot study indicated that no established group of health indicators existed for individuals, nor were indicators incorporated or used consistently and routinely across different EHR systems. Therefore, there is at least a need to provide more evidence for these health indicators. This includes what should be included among the individual health indicators used by EHR systems and whether these indicators can be prioritized based on their importance. Additionally, we recognize that these health indicators have much broader potential use beyond incorporating them into EHR [9].

The current study aimed to examine public perspectives on the importance of 29 health indicators to inform their relative perceived priority. This would, for example, allow the separation of the health indicators into core and secondary sets, which could be incorporated into EHR or similar systems [23]. Such health indicators could capture an individual’s health status, thus informing and enabling preventive services to make them more accurate, consistent, and convenient without overburdening providers’ data collection workload. These public perspectives could also provide a foundation for developing an individual health index which could be used to stratify healthy populations into subgroups based on the corresponding study requirements. There is no established list or ranking of health indicators according to importance, nor is there a matural methodology to develop such a list. Therefore, we attempted to use public perspective surveys as a starting point in this study. We plan to validate the results quantitatively through longitudinal health record analysis in a future study. The assumption is that an individual’s perception of the importance of each health indicator may be associated with their conscious or unconscious behaviors, which would ultimately affect health outcomes. This paper focuses on the public perspectives, the approach, the results, and the analysis of the results.

Methods

General study design

The overall design of this project is illustrated in Figure 1 to provide context for this manuscript. The work reported here focuses on public perspectives, the methods utilized, and the results. The first three steps in Figure 1 have been completed and published [9, 23]. The section (about quantitative validation) on the far-right side, shown in Figure 1, illustrates directions we plan to explore in future studies.

Figure 1. The overall design of the project; public perspectives are the focus of this manuscript; the three sections connected via green arrows were completed, and the far-right section is for future work

Data collection

An online survey (Appendix A) was administered through Ohio University (Summer 2017), ResearchMatch [24] (Summer 2018), and Clemson University (Summer 2020), providing three samples. The Institutional Review Boards of Ohio University (17-X-142) and Clemson University (IRB2019-441) approved the study. The inclusion criterion for participation in the survey was 18 years of age or older. The Participants were allowed to share the survey’s URL link, and all respondents acknowledged informed consent.

The survey included seven demographic questions and rating items related to the importance of the 29 health indicators. Definitions of these health indicators were provided within the survey (Appendix B). In the survey, the 29 health indicators were separated into five subscales [15, 19, 21]:

  • Health Risks and Behaviors, with eight indicators
  • alcohol abuse, body mass index (BMI), diet and nutrition, drug or substance abuse, family history of cancer, physical inactivity, smoking or tobacco use, sun protection
  • Healthcare, with three indicators
  • immunization/vaccination, insurance coverage, personal care needs
  • Healthcare Provider Supply, with three indicators
  • cancer screening detection, hypertension screening, HIV testing
  • Blood Tests in Physical Exams, with five indicators
  • blood sugar level, blood triglycerides, HDL cholesterol, LDL cholesterol, total cholesterol
  • Other Health Indicators, with ten indicators
  • self-rated health status, high school diploma, air quality index > 100, supply of dentists, engagement in life, health literacy rate, major depression, having a sense of purpose in one’s life, race and ethnicity, and being unemployed

After removing invalid data, the final sample yielded 362 responses from Ohio University, 694 from ResearchMatch, and 97 from Clemson University (Appendix C). Items were rated on a scale of 0–10 (ie, 0 refers to not at all important and 10 refers to extremely important) in the survey used by Ohio University and Clemson University, whereas items in the ResearchMatch sample were measured using a scale of 0–100 (ie, 0 refers to not at all important and 100 refers to extremely important). Therefore, as part of the data cleaning process, the data from ResearchMatch were converted to a scale of 0–10 (Appendix D contains the codebook). In the Ohio University survey, there were five health indicators: blood sugar, blood triglycerides, HDL, LDL, and total cholesterol, for which a scale of 0–11, instead of 0–10, was used. Due to this error, data for these five indicators were removed from the Ohio University dataset. As a result, the total sample size of these five

indicators was 791, whereas the total sample size of the other indicators was 1153 (Table 1).

The internal reliability of the survey instruments were calculated for the overall set and the three institutional subsets using Cronbach’s alpha [25].

Data analytic strategies

Data analyses included rating the 29 health indicators based on their perceived importance. After aggregating data from the three samples with descriptive statistics, a three-step analysis was conducted. The first step of the analysis involved determining whether the three samples had a unanimous agreement on the importance of each indicator. A one-way ANOVA with a post hoc test was conducted in SPSS v.27 (IBM) for each indicator to examine any group mean difference (IV = the three samples, DV = individual survey responses). A Levene’s test was used to test the homogeneity of variance for each indicator before running an ANOVA. The indicators with no group mean differences across samples were retained for the following analysis step.

The second step of the analysis examined the mean differences between the retained indicators via a one-way ANOVA (IV = the identified indicators, DV = individual survey responses). Any indicators with no significant mean differences were grouped together because they could not be ranked.

The third step of the analysis ranked the groups of indicators into various levels after grouping the indicators with no mean differences. A one-way ANOVA with a post hoc test was conducted to examine the mean differences between the levels of indicators (IV = the levels of indicators, DV = individual survey responses). Any significant mean difference between any two levels of indicators indicated the ranking order of the two levels.

Results

The overall layout of the findings

The primary purpose of this study was to identify the public perspectives on the importance of the 29 selected health indicators, whether they agreed with each other, and if so, what were the

importance rankings of the health indicators that agreed. Figure 2 summarizes the analytic strategies and the main results of each step. The following paragraphs elaborate on the detailed results for each step.

Figure 2. The primary analytic strategies and overall results of each step

Results of descriptive statistics

Descriptive statistics for the 29 health indicators are reported in Table 1. The descriptive statistics for the demographic information for all respondents are reported in Appendix E. Descriptive analyses show that drug and substance abuse, smoking and tobacco use, alcohol abuse, major depression, and diet and nutrition were found to be the five most important health indicators, as rated by the study participants. Additionally, race and ethnicity, possession of a high school diploma, engagement in life, unemployment status, and sun protection were the five least important health indicators. Self- rated health status, the most used health indicator to assess an individual’s health status, was ranked in the 20th position.

Results of inferential statistics

A Levene’s test was conducted to test the homogeneity of variance for each indicator before running an ANOVA. This resulted in nine health indicators with homogenous variance: blood sugar level, HDL cholesterol, LDL cholesterol, total cholesterol, immunization/vaccination, insurance coverage, cancer screening detection, air quality index > 100, and self-rated health status (Appendix F). Twenty health indicators were found to have heterogeneous variance. These included the following indicators: blood triglycerides, alcohol abuse, BMI, diet and nutrition, drug or substance abuse,

family history of cancer, physical inactivity, smoking and tobacco use, sun protection, personal care needs, hypertension screening, HIV testing, high school diploma as a health indicator, supply of dentists, engagement in life, health literacy rate, major depression, having a sense of purpose in one’s life, race and ethnicity, and unemployment (Appendix G).

For the nine indicators with homogeneous variance, a one-way ANOVA was used. A one-way ANOVA Welch’s test was used for the 20 indicators with heterogeneous variance. As a result, 13 indicators were found to have no statistically significant mean differences among the three samples. This indicates that survey participants generally agreed on the relative level of importance of these indicators (Table 2). The 13 indicators were blood sugar level, blood triglycerides, HDL cholesterol, LDL cholesterol, total cholesterol, personal care needs, HIV testing, self-rated health status, supply of dentists, health literacy rate, immunization/vaccination, cancer screening detection, and air quality index >100. The means and standard deviations of their ratings are presented in Table 2. These 13 indicators were retained for the second step of the analysis. Significant mean differences were found among the other 16 indicators, which indicates that survey participants disagreed on their level of importance (Appendix H contains the post hoc results).

In the second step of the analysis, a one-way ANOVA was run for the 13 retained indicators (IV = 13 indicators; DV = individual survey responses). The indicators with no mean differences were grouped into the same level (Table 3) because they were rated as equally important and could not be ranked within a level. As a result, seven levels were formed (Table 3). Level 1 to Level 7 rankings were organized based on the mean importance of the health indicators from high to low within and between levels. Level 1 included blood sugar level and immunization/vaccination; Level 2 included LDL cholesterol; Level 3 included HDL cholesterol, blood triglycerides, cancer screening detection, and total cholesterol; Level 4 included health literacy rate; Level 5 included personal care needs and air quality index > 100; Level 6 included self-rated health status, and HIV testing; Level 7 included the supply of dentists.

In the third step of the analysis, one-way ANOVA was utilized to rank the seven levels of indicators (IV = 7 levels; DV = individual survey responses). There were seven indicators in Level 1, Level 2, and Level 3 (blood sugar level, immunization/vaccination, LDL cholesterol, HDL cholesterol, blood triglycerides, cancer screening detection, and total cholesterol). These indicators were found to be significantly more important to the survey participants than the six indicators ranked in Level 4, Level 5, Level 6, and Level 7 (ie, health literacy rate, personal care needs, air quality index > 100, self-rated health status, HIV testing, and supply of dentists; Table 4).

Among the more important indicators, the two indicators in Level 1 (blood sugar level and immunization/vaccination) were rated as significantly more important than the four indicators in Level 3 (HDL cholesterol, blood triglycerides, cancer screening detection, and total cholesterol). Therefore, based on the surveys and our analysis results, blood sugar level, and immunization/vaccination were the most important health indicators among these 13 health indicators, and the perspectives of the participants were agreed upon across all three samples.

Furthermore, among the less-important indicators, the indicator assigned to Level 4 (health literacy rate) was found to be significantly more important than the two indicators in Level 6 (self- rated health status and HIV testing), and the indicator assigned to Level 7 (supply of dentists). Additionally, the two indicators assigned to Level 5 (air quality index > 100 and personal care needs) were found to be significantly more important than the indicator assigned to Level 7 (supply of dentists). Therefore, the surveys and analysis results showed that the supply of dentists was the least important health indicator among the 13 health indicators with agreeable perspectives across the three samples. Additionally, the inferential statistical test results among levels provide more confidence in ranking the seven levels from the most important (ie, blood sugar level, immunization/ vaccination) to the least important (ie, supply of dentists). The statistical significance test results among the levels provide evidence for prioritizing 13 health indicators.

Survey instruments reliability

The survey instrument’s items (n = 29) showed good levels of internal reliability (Cronbach’s alpha = 0.912), as did each of the three subsets related to institutions where the survey was administered (see Table 5). Instruments with Cronbach’s alpha values equal to or higher than 0.7 or

0.75 are generally considered to be reliable [25].

Table 1. Descriptive statistics for all 29 health indicators



Health Indicators
ug or substance abuse
ResearchMatchOhio UniversityClemson UniversityTotal

Mean

SD

n

Mean

SD

n

Mean

SD

n

Mean

SD

n
8.751.56948.131.963628.361.87978.531.711153
oking, tobacco use8.81.526948.022.063628.181.84978.51.771153
cohol abuse8.341.716947.562.033628.061.64978.071.841153
ajor depression8.11.66857.791.943628.031.57977.991.721144
et and nutrition8.011.586947.81.933628.361.65977.971.711153
ood sugar level7.761.636947.591.75977.741.65791
ysical inactivity7.91.686947.412.133627.681.77977.731.851153
munization/vaccination7.492.126947.672.33627.722.4977.572.21153
pertension screening7.591.916947.172.293627.422.03977.452.051153
L cholesterol7.431.856947.561.91977.451.86791
ood triglycerides7.321.786947.341.95977.321.80791
DL cholesterol7.311.836947.431.91977.321.84791
ving a sense of purpose one’s life
7.59

1.94

685

6.67

2.53

362

7.88

1.93

97

7.32

2.19

1144
ncer screening tection
7.22

2.06

694

7.26

2.3

362

7.49

2.09

97

7.25

2.14

1153
tal cholesterol7.22.026947.61.85977.252.00791
alth literacy rate6.992.026857.062.263627.342.01977.042.101144
rsonal care needs6.822.086947.012.33627.212.1976.912.161153
r quality index > 1006.741.926856.762.133626.891.93976.761.991144
mily history of cancer6.982.066946.372.243626.251.98976.732.131153
lf-rated health status6.632.26946.622.153626.921.89976.652.161153
V testing6.622.366946.622.643626.842.37976.642.451153
urance coverage6.42.886946.792.913627.262.51976.62.871153
MI6.862.286945.82.543626.642.45976.512.421153
pply of dentists6.532.026856.342.263626.041.99976.432.101144
n protection6.6326945.732.33625.542.18976.252.161153
employed individual6.072.346855.522.683626.22.69975.912.491144
gagement in life6.382.186854.822.873626.42.33975.892.541144
gh school diploma as a alth indicator
5.02

2.57

694

6.04

3.07

362

5.56

2.75

97

5.38

2.79

1153
ce and ethnicity5.282.536854.322.763625.022.85974.962.671144

BMI = Body mass index; SD = Stadnard deviation; -, no value.

Table 2. The 13 indicators with non-significant mean differences across the three samples

Health indicatornMeanSDSourceANOVA/t-test Sig.


Blood sugar level
6947.7561.6303ResearchMatch

0.345
977.5881.7485Clemson
7917.7361.645Total


Blood triglycerides
6947.3181.7786ResearchMatch

0.914
977.341.952Clemson
7917.321.7995Total


HDL cholesterol
6947.3071.8264ResearchMatch

0.527
977.4331.9143Clemson
7917.3221.8366Total


LDL cholesterol
6947.431.8489ResearchMatch

0.531
977.5571.9147Clemson
7917.4461.8563Total


Total cholesterol
6947.2032.0177ResearchMatch

0.069
977.5981.8465Clemson
7917.2522.0006Total




Personal care needs
6946.8162.0786ResearchMatch



0.140
3627.0112.3026OU
977.2062.1013Clemson
11536.912.1551Total




HIV testing
6946.6162.361ResearchMatch



0.690
3626.6192.6439OU
976.8352.3747Clemson
11536.6352.453Total


Self-rated health status
6946.632.2032ResearchMatch

0.445
3626.6192.1504OU
976.9181.8912Clemson
11536.6512.1619Total




Supply of dentists
6856.5252.0215ResearchMatch



0.068
3626.342.2572OU
976.0411.9944Clemson
11446.4252.0999Total




Health literacy rate
6856.9862.0199ResearchMatch



0.260
3627.0612.2617OU
977.342.0098Clemson
11447.0392.0991Total



Immunization/ vaccination
6947.4942.1184ResearchMatch



0.372
3627.6662.3041OU
977.7222.3968Clemson
11537.5672.2023Total



Cancer screening detection
6947.2172.0625ResearchMatch



0.515
3627.2572.3045OU
977.4852.0922Clemson
11537.2522.1432Total




Air quality index > 100
6856.7361.9232ResearchMatch



0.784
3626.762.125OU
976.8871.9304Clemson
11446.7561.9885Total

IV = The three samples; DV = Individual survey data; SD = Standard deviation.

Table 3. The seven levels of health indicators with no significant mean differences within levels




Level



Indicator #
Individual Survey Data [DV]
Indicators with no group mean differences [IV]

n


Mean


SD
ANOVAresults within groups


1
1Blood sugar7917.741.650.053

2
Immunization/ vaccination
1153

7.57

2.20
23LDL cholesterol7917.451.860



3
4HDL cholesterol7917.321.840.773
5Blood triglycerides7917.321.80

6
Cancer screening detection
1153

7.25

2.14
7Total cholesterol7917.252.00
48Health literacy rate11447.042.100
9Personal care needs11536.912.160.075

5

10
Air quality index > 100
1144

6.76

1.99

6

11
Self-rated health status
1153

6.65

2.16
0.873
12HIV testing11536.642.45
713Supply of dentists11446.432.100
Total143057.082.101

IV = The levels of indicators; DV = Individual survey responses; SD = Standard deviation.

Table 4. ANOVA post hoc test results for the seven levels of indicators



Health Indicator


Health indicator


Sig.
Level 1Level 20.582
Level 1Level 3<0.001
Level 1Level 6<0.001
Level 1Level 7<0.001
Level 2Level 40.006
Level 2Level 30.678
Level 2Level 5<0.001
Level 2Level 7<0.001
Level 3Level 40.063
Level 3Level 5<0.001
Level 4Level 50.274
Level 4Level 1<0.001
Level 4Level 6<0.001
Level 5Level 60.136
Level 5Level 1<0.001
Level 5Level 7<0.001
Level 6Level 70.207
Level 6Level 2<0.001
Level 6Level 3<0.001
Level 7Level 2<0.001
Level 7Level 3<0.001
Level 7Level 4<0.001

IV = The levels of indicators, DV = Individual survey responses.

Table 5. Cronbach’s alpha for the survey instrument (entire survey and subscales)

Survey componentsData analyzedCronbach’s alpha

Entire survey (all items)
All three samples0.912
ResearchMatch0.922
Ohio University0.893
Clemson University0.925


Survey subscales
Health risks and behaviors indicators0.795
Healthcare0.613
Healthcare provider supply0.831
Blood tests in physical exams0.934
Other health indicators0.823

Discussion

Interpretation of the results

Among all three samples, the ranking of the importance of the 13 (13/29, 44.8%) health indicators showed agreement (Table 3). However, these health indicators were not necessarily more important than the other 16 health indicators; instead, participants were observed to have more consistently perceived importance among these 13 health indicators. When we compared the 13 health indicators (Table 3) and their corresponding ranks in Table 1, we noticed that the 13 health indicators were placed between the 6th and 24th rankings in Table 1. This indicated more agreement among participants regarding the middle-ranked health indicators than the higher- or lower-ranked ones. The perspectives were more heterogeneous for those higher- or lower-ranked health indicators. Noticeably, the currently wide-used standard individual health indicator, the self-rated health status, was ranked 20th based on the results of the descriptive statistics. These results indicate a need for new and improved health indicators.

Among these 13 health indicators found in the seven levels, all levels were not significantly different from their immediate next level (Table 4), ie, there were no significant differences between Levels 1 and 2 (ie, between n and n + 1). There were, however, significant differences between Level 1 and Levels 3 to 7 (ie, between n and any level > n + 1). These results pertain to the further prioritization of health indicators.

Given descriptive statistics and inferential test results, our findings among the 13 health indicators can reasonably be generalized to some extent to a broader population beyond our survey respondents. We do not claim the complete generalizability of our results mainly because our respondents were not perfectly representative of the composition of the American population. However, we believe that the 13 health indicators and their importance rankings within and among levels can provide substantial and useful evidence when such indicators need to be prioritized.

Cronbach’s alpha is one of the more cited statistics for informing internal consistency for the items of an instrument. If Cronbach’s alpha is greater than 0.7, the instrument is reliable [25]. The Cronbach’s alpha for the entire survey among the three samples was between 0.893 and 0.925. This indicates that we developed a reliable survey instrument. When examining the subscales, only the healthcare category, which included vaccination/immunization, insurance coverage, and personal care need, was below 0.7. The items in this category are among the most discussed topics in health care in the United States. Understandably, the reliability is lower since the respondents have relatively less consistent perspectives for these items.

Significance and comparison with related research

This study provides a more comprehensive understanding of the indicators affecting an individual’s health status, particularly as compared to self-rated health status, the most commonly used health status measurement [2]. Although there are advantages associated with using a single health indicator during clinical encounters, we believe that the multidimensional measurement of an individual’s health status may be more objective and can provide additional insights into the individual’s health status, particularly if we are concerned with improving and maximizing the preventive healthcare services offered. Obtaining these public perspectives is the first step toward a more accurate and effective measurement of individual health status.

This work can be potentially used in two ways: 1) more comprehensive and objective

measurement of an individual’s health status, and 2) development of a health index for an individual. Additionally, these results can be used to prioritize various health indicators, eg, to distinguish between core and secondary indicators. They can also be referenced by designers and developers for EHR systems, personal health records (PHR) systems, or other data capture and analysis applications to determine what health indicators to include in the systems. Furthermore, these results can contribute to developing a health index, which can be used to stratify healthy research participants to make them more comparable. This would be analogous to the Charlson Comorbidity Index [26] or propensity scores [27], which are broadly used in clinical epidemiology data analytics, both of which, however, are disease-oriented. Although the health indicators reported here are not in a formula format, this will be a focus for future research. These results set the foundation for further weighting, prioritizing, and validating the health indicators via additional data resources.

Additionally, these measurements can track overall health status, measure the outcomes of preventive services, or aggregate data to examine community health. Although having more data points provides increased accuracy and specificity for health indicators embedded within an EHR or PHR, it is important to consider clinician burnout [28] in using technology. Therefore, it is necessary to be mindful of the impacts that creating more data capture requirements or expectations of clinical users may have. In this regard, prioritizing health indicators is a necessary step.

Over the years, other systems have been developed to assess various health risks and associations. The Johns Hopkins Adjusted Clinical Group (ACG) system, developed and maintained by Johns Hopkins University for over 30 years, is a global tool used in population health analytics [29]. This system is focused on chronic conditions and comorbidities, and its goal is therefore fundamentally different from ours, which is to measure individual health (not disease) status more accurately. Another system, the Committee on Quality Measures for the Healthy People Leading Health Indicators [3], focuses more on quality measures with an aim to align the measurements within a framework of assessment, improvement, and accountability. The focus, however, is on

monitoring and reporting at the population level, not necessarily individual health [3].

There are other health-related surveys broadly used worldwide. For example, the SF-36, developed by the RAND Corporation [30], measures life quality and health outcomes. Similarly, compared with the related but smaller SF-12 [31], our health indicators provide a more comprehensive measurement beyond physical and mental health. The PHQ-9 [32] is a validated tool to measure depression severity. However, we were looking for more objective indicators to measure an individual’s physical and mental health status in our work.

Our health indicators have good but not all-inclusive coverage. The Committee on the Recommended Social and Behavioral Domains and Measures for Electronic Health Records of IOM identified measures across the individual and neighborhood levels that involve sociodemographic, psychological, and behavioral data [4, 5]. Among the 17 domains identified by the committee [4, 5], ten were included in our 29 health indicators. Healthy People 2030 [33] proposed 22 leading health indicators for different age groups, of which 16 are included in our health indicators.

Limitations of the current study

The main limitation of this study is that it is only the first step in determining the importance of these health indicators, and, notably, the results, which are based on public perspectives, are subjective. Further validation of these results via additional objective measures (such as healthcare expenditure by disease category [34] and the burden of illness estimates for specific disease categories [35]) is needed to support these findings. Currently, for each health indicator, the sample size of valid responses ranges from 791 to 1153. We recognize that larger sample sizes may generate more conclusive and generalizable results. Therefore, our results about the 13 health indicators, even though they are inferential statistics, should be treated as preliminary baseline results; future research may be needed to validate these findings in other settings.

Another limitation concerns the survey respondents. Females comprised the majority of

survey respondents, at 72.1%, 77.7%, and 69% from Ohio University, ResearchMatch, and Clemson University, respectively. We noticed a similar phenomenon in other studies conducted via ResearchMatch. While we are pleased with the relatively large sample size, responses may reflect the perspectives of well-educated females more than those of other groups. For example, survey respondents with an educational level of college and beyond represent 54.6%, 82.2%, and 74% of Ohio University, ResearchMatch, and Clemson University respondents.

In addition to the distribution imbalance in gender and educational background among our respondents, we also noticed that race/ethnicity groups (Appendix E) are not perfectly representative of the composition of the American population. The breakdown by racial groups among respondents to our surveys was: White American, 87.3%; African American, 3.3%; Hispanic and Latino American, 2.2%; Asian American, 1.6%; Native American, 0.4%; two or more races, 2%. We recognize that our dataset’s gender and ethnicity imbalances are limitations of our current convenience sampling method. In the future, a stratified random sampling based on census-based population demographical data might provide more representative results and be a better option. This is a critical point that should be considered when using the results from this study.

Future research

We foresee several potential directions in which to continue this project. Our primary goal for future research is to validate the results obtained from the three completed surveys. This can be accomplished in several ways. Because we wish to measure individual health status accurately over time, the use of longitudinal data would be ideal. One data source is a citizen science project initiated by the National Institutes of Health, the All of US [36] research program. Another source is the UK Biobank initiated in the United Kingdom [37], but the most ideal source would be well-documented longitudinal data of a group of individuals that include not only their EHR data but also other data that correlate with our health indicators. Such ideal data sources would allow for examining the

corresponding health indicators and validation of the importance of health indicators via EHR records and additional health-related data. In this way, public perspectives will be considered along with more concrete quantitative evidence to ensure more confidence in prioritizing health indicators and using them for various purposes.

Additionally, to mitigate the effect of the current imbalances seen in respondents by gender, race/ethnicity, and other factors, we could explore the possibility of stratified random sampling to proactively select more representative participants. The respondent pool can be more proportionally representative of the composition of the American population. As a potential future project, we may also explore the possible correlations between the demographic variables and the rating results.

Conclusion

Well-designed health indicators are critical tools needed to accurately measure individual health status. They enable the determination of effective preventive services and verify their outcomes. Obtaining the public’s perspective on specific health indicators is the first step toward prioritizing them for analytical and clinical use. The current study found that the top five rated health indicators were drug and substance abuse, smoking and tobacco use, alcohol abuse, major depression, and diet and nutrition. Our respondents, however, had heterogeneous views on the top-and bottom-rated health indicators. The middle 13 health indicators were rated more homogeneously among all the respondents. These 13 health indicators were separated into seven levels based on their perceived importance, providing further evidence used to prioritize these health indicators. Levels 1 to 7 were organized based on the mean importance of health indicators from high to low within and between each level. Level 1 included blood sugar level and immunization/vaccination; Level 2 included LDL cholesterol; Level 3 included HDL cholesterol, blood triglycerides, cancer screening detection, and total cholesterol; Level 4 included health literacy rate; Level 5 included personal care needs and air quality index > 100; Level 6 included self-rated health status, and HIV testing; and Level 7 had the

supply of dentists. The results of this study can provide evidence to EHR or PHR system designers and developers, which they can then use to select health indicators to incorporate into their systems.

Acknowledgements

We want to thank all the respondents who answered the surveys. Without their input, this study would not have been possible.

Funding

This work is partially supported by the Clemson University, College of Behavioral, Social, and Health Sciences, Department of Public Health Sciences, which provided start-up funding for Xia Jing.

Conflict of Interest

We have no conflicts of interest to declare.

Data statement

This manuscript’s datasets and statistical analysis codes are available by request from the corresponding author.

Ethics statement

This study was approved by the Institutional Review Boards of Ohio University (17-X-142) and Clemson University (IRB2019-441).

Author contributions:

Conceptualization and design: Xia Jing, Temiloluwa Sokoya, Francisca Lekey, Sebastian Diaz Acquisition, analysis, or interpretation of data: Xia Jing, Temiloluwa Sokoya, Yuchun Zhou, Sebastian Diaz, Timothy Law, Lina Himawan, Lu Shi, Ronald W. Gimbel

Drafting of the manuscript: Temiloluwa Sokoya, Yuchun Zhou, Xia Jing

Critical revision of the manuscript: Xia Jing, Temiloluwa Sokoya, Yuchun Zhou, Sebastian Diaz, Timothy Law, Lina Himawan, Lu Shi, Ronald W. Gimbel

Statistical analysis: Temiloluwa Sokoya, Yuchun Zhou, Sebastian Diaz, Lina Himawan, Xia Jing Obtaining funding: Xia Jing

Supervision: Xia Jing, Ronald W. Gimbel

Abbreviations

ACG: Adjusted Clinical Group BMI: body mass index

DV: dependent variable EHR: electronic health record

HDL: high-density lipoprotein

HIV: human immunodeficiency virus IOM: Institute of Medicine

IRB: Institutional Review Board IV: independent variable

LDL: low-density lipoprotein

ONC: Office of the National Coordinator for Health Information Technology OU: Ohio University

PHQ-9: Patient Health Questionnaire-9 PHR: personal health record

SD: standard deviation

SF-36: 36-item Short Form Survey UK: United Kingdom

References

  1. C, W., Health indicators: a review of reports currently in use. . 2008.
  2. Medicine, I.o., Vital Signs: Core Metrics for Health and Health Care Progress, ed. D. Blumenthal, E. Malphrus, and J.M. McGinnis. 2015, Washington, DC: The National Academies Press. 308.
  3. IOM (Institute of Medicine), Toward quality measures for population health and the leading health indicators. 2012, Washington, DC: : The National Academies Press.
  4. Institute of Medicine, Capturing Social and Behavioral Domains and Measures in Electronic Health Records: Phase 2. 2014, Washington, DC: The National Academies Press. 374.
  5. Institute of Medicine, Capturing Social and Behavioral Domains in Electronic Health Records: Phase 1. 2014, Washington, DC: The National Academies Press. 136.
  6. CDC National Center for Health Statistics. National Health Interview Survey. 2021 [cited 2021 Aug 29]; Available from: https://www.cdc.gov/nchs/nhis/index.htm.
  7. Hensrud, D.D., Clinical preventive medicine in primary care: background and practice: 1. Rationale and current preventive practices. Mayo Clin Proc, 2000. 75(2): p. 165-72.
  8. Hensrud, D.D., Clinical preventive medicine in primary care: background and practice: 2. Delivering primary preventive services. Mayo Clin Proc, 2000. 75(3): p. 255-64.
  9. Jing, X., et al., Health indicators within EHR systems in primary care seṄngs: Availability and presentation. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2016. 10038 LNCS.
  10. Clarke, T.C., et al., Early Release of Selected Estimates Based on Data From the National Health Interview Survey, 2015. 2016, CDC National Center for Health Statistics.
  11. Medicine, I.o., State of the USA Health Indicators: Letter Report. 2009, Washington, DC: The National Academies Press. 98.
  12. Gallup-Healthways Well-Being Index, State of global well-being: results of the Gallup- Healthways global well-being index (2014). 2014.
  13. Broussard, D.L., et al., Core state preconception health indicators: a voluntary, multi-state selection process. Matern Child Health J, 2011. 15(2): p. 158-68.
  14. Hunter, B.M., et al., National health policy-makers’ views on the clarity and utility of Countdown to 2015 country profiles and reports: findings from two exploratory qualitative studies. Health Res Policy Syst, 2014. 12: p. 40.
  15. Wold, C. Health Indicators: a review of reports currently in use (2008). 2009 [cited 2017; Available from: http://www.cherylwold.com/images/Wold_Indicators_July08.pdf.
  16. Healthy People 2020, H., Healthy People 2020 Leading Health Indicators: Progress Update. 2020.
  17. National Academies of Sciences, E., Medicine, Leading Health Indicators 2030: Advancing Health, Equity, and Well-Being. 2020, Washington, DC: The National Academies Press. 172.
  18. Medicine, I.o., State of the USA Health Indicators: Letter Report. 2009, Washington, DC: The National Academies Press.
  19. Medicine, I.o., Vital Signs: Core Metrics for Health and Health Care Progress. 2015, Washington, DC: The National Academies Press.
  20. National Center for Health Statistics, C. National Health Interview Survey. 2022 [cited 2022 April 12]; Available from: https://www.cdc.gov/nchs/nhis/.
  21. CMS. Physician Quality Reporting System (PQRS) Measure List. 2016; Available from: https:// www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/PQRS/ MeasuresCodes.
  22. Index, G.-H.W.-B., State of global well-being: results of the Gallup-Healthways global well- being index (2014). 2015.
  23. Jing, X., et al., Health indicators to measure individual health status: public perspectives- preliminary results, in AMIA Summit 2019. 2019: San Francisco. p. 970-971.
  24. Vanderbilt University Medical Center. ResearchMatch.org. [cited 2021 Sept 19]; Available from: https://www.researchmatch.org/.
  25. Christmann, A. and S. Van Aelst, Robust estimation of Cronbach’s alpha. Journal of multivariate analysis, 2006. 97(7): p. 1660-1674.
  26. Charlson, M.E., et al., A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis, 1987. 40(5): p. 373-83.
  27. Austin, P.C., An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies. Multivariate Behav Res, 2011. 46(3): p. 399-424.
  28. McPeek-Hinz, E., et al., Clinician Burnout Associated With Sex, Clinician Type, Work Culture, and Use of Electronic Health Records. JAMA Network Open, 2021. 4(4): p. e215686-e215686.
  29. The John Hopkins University. John Hopkins ACG System. [cited 2021 Sept 19]; Available from: https://www.hopkinsacg.org/.
  30. Ware, J.E., Jr. and C.D. Sherbourne, The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care, 1992. 30(6): p. 473-83.
  31. Corporation, R. 12-Item Short Form Survey (SF-12). [cited 2021 Sept 28]; Available from: https://www.rand.org/health-care/surveys_tools/mos/12-item-short-form.html.
  32. Kroenke, K., R.L. Spitzer, and J.B. Williams, The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med, 2001. 16(9): p. 606-13.
  33. HHS Office of Disease Prevention and Health Promotion. Helthy People 2030-Leading Health Indicators. [cited 2021 Aug 30]; Available from: https://health.gov/healthypeople/objectives-and-data/leading-health-indicators.
  34. Ozieh, M.N., et al., Trends in healthcare expenditure in United States adults with chronic kidney disease: 2002-2011. BMC Health Serv Res, 2017. 17(1): p. 368.
  35. Cannon, A., et al., Burden of Illness in Type 2 Diabetes Mellitus. J Manag Care Spec Pharm, 2018. 24(9-a Suppl): p. S5-s13.
  36. The “All of Us” Research Program. New England Journal of Medicine, 2019. 381(7): p. 668- 676.
  37. About UK Biobank.

Appendices

Appendix A. The online survey instrument

Appendix B. Definitions of the health indicators

Appendix C. Records from three datasets: before and after data cleaning

Appendix D. Codebook

Appendix E. Demographic descriptive statistics for all respondents Appendix F. Total of nine indicators with homogenous variance Appendix G. Total of 20 indicators with heterogeneous variance

Appendix H. Total of 16 indicators with significant mean differences post hoc results for the three samples

Supplementary Files

Figures

The overall design of the project; public perspectives are the focus of this manuscript; the three sections connected via green arrows were completed, and the far-right section is for future work.

The primary analytic strategies and overall results of each step.

Multimedia Appendixes

Survey instrument: Health indicators to measure an individual’s health status: a public perspective survey. URL: http://asset.jmir.pub/assets/35249e99c63e61cdc34253dc4d4a2f1d.pdf

Health indicators-definitions used in the survey.

URL: http://asset.jmir.pub/assets/04c9982eb7b5c0b2d585473e17415c4c.pdf

Records from three datasets: before and after data cleaning.

URL: http://asset.jmir.pub/assets/f99fb82846b0f9bd7dfd2d071940b92d.pdf

Codebook.

URL: http://asset.jmir.pub/assets/8ff20738a2db71fe01bc3c05d2d20f89.pdf

Demographic descriptive statistics for all respondents.

URL: http://asset.jmir.pub/assets/53fa6bfedb75d0fd67997621051ad69a.pdf

Total of nine indicators with homogenous variance.

URL: http://asset.jmir.pub/assets/0a744f57e794f7fd52efd3ad40890c89.pdf

Total of 20 indicators with heterogeneous variance.

URL: http://asset.jmir.pub/assets/386814ecd2396f2ecdf4107a85b53d55.pdf

Total of 16 indicators with significant mean differences post hoc results for the three samples. URL: http://asset.jmir.pub/assets/d7da0aeee2ee4e5de1c203914e795558.pdf

Scroll to Top