Skip to main content
Download PDF

A study protocol for the development of a multivariable model predicting 6- and 12-month mortality for people with dementia living in residential aged care facilities (RACFs) in Australia

Diagnostic and Prognostic Research volume 4, Article number: 17 (2020) Cite this article

A Correction to this article was published on 16 April 2021

This article has been updated

Abstract

Background

For residential aged care facility (RACF) residents with dementia, lack of prognostic guidance presents a significant challenge for end of life care planning. In an attempt to address this issue, models have been developed to assess mortality risk for people with advanced dementia, predominantly using long-term care minimum data set (MDS) information from the USA. A limitation of these models is that the information contained within the MDS used for model development was not collected for the purpose of identifying prognostic factors. The models developed using MDS data have had relatively modest ability to discriminate mortality risk and are difficult to apply outside the MDS setting. This study will aim to develop a model to estimate 6- and 12-month mortality risk for people with dementia from prognostic indicators recorded during usual clinical care provided in RACFs in Australia.

Methods

A secondary analysis will be conducted for a cohort of people with dementia from RACFs participating in a cluster-randomized trial of a palliative care education intervention (IMPETUS-D). Ten prognostic indicator variables were identified based on a literature review of clinical features associated with increased mortality for people with dementia living in RACFs. Variables will be extracted from RACF files at baseline and mortality measured at 6 and 12 months after baseline data collection. A multivariable logistic regression model will be developed for 6- and 12-month mortality outcome measures using backwards elimination with a fractional polynomial approach for continuous variables. Internal validation will be undertaken using bootstrapping methods. Discrimination of the model for 6- and 12-month mortality will be presented as receiver operating curves with c statistics. Calibration curves will be presented comparing observed and predicted event rates for each decile of risk as well as flexible calibration curves derived using loess-based functions.

Discussion

The model developed in this study aims to improve clinical assessment of mortality risk for people with dementia living in RACFs in Australia. Further external validation in different populations will be required before the model could be developed into a tool to assist with clinical decision-making in the future.

Peer Review reports

Background

Health professionals working in residential aged care facilities (RACFs) providing long-term care play a key role in end of life care decision-making for residents with dementia. Uncertainty regarding prognosis and difficulty identifying people with dementia whose health is deteriorating presents a significant barrier to initiating discussions of a palliative approach to care [1, 2]. In countries such as the USA, assessment of estimated life expectancy is a central consideration in determining who can access palliative care services such as hospice care [3] but health professionals often do not feel confident making prognostic assessments for people with dementia [4].

Planning for end of life care is infrequently discussed in the months prior to death for people with dementia living in RACFs [5] and emergency services are increasingly utilized toward the end of life [6]. In order to improve the quality of end of life care, timely recognition of end of life illness trajectory is essential to support carers and health care proxy decision-makers (usually the closest family member or a formally appointed decision-maker) of people with dementia in end of life care planning [7]. If health care proxy decision-makers are aware that end of life is approaching, people with advanced dementia are less likely to have invasive interventions in the months prior to death [8]. Lack of prognostic guidance is, however, a common barrier to health care proxy decision-makers engaging in decisions to avoid burdensome interventions such as hospital transfers [9].

There has been limited previous research aimed at identifying indicators of increased mortality risk for people with dementia living in RACFs. The Advanced Dementia Prognostic Tool (ADEPT) was developed to assess prognosis for residents with advanced dementia living in long-term care [10] but external prospective validation only demonstrated modest ability to discriminate for 6-month mortality (c statistic 0.67) [11]. The variables used to develop the ADEPT model were limited to those contained in the long-term care minimum data set (MDS), an administrative data set used throughout the USA for assessment of care quality and allocation of funding [12]. MDS data is not collected for the purpose of identifying indicators of deteriorating health for people with dementia and the accuracy of the clinical information contained within the MDS is variable [13]. Reliance on MDS data limits the clinical utility of the ADEPT model for use outside the US long-term care setting, and it is unknown whether there are clinical variables not collected in the MDS that would better identify people with dementia who are at increased risk of mortality.

In Australia, MDS assessments are not routinely undertaken and the Aged Care Funding Instrument (ACFI) is instead used to determine the level of care and funding [14]. ACFI assessments are infrequently updated following admission to residential care and in a recent cross-sectional analysis, the average time since last ACFI completion was greater than 12 months across RACFs in Australia [15], making these assessments unsuitable for detecting clinical deterioration. Important changes in clinical conditions not captured in ACFI data are recorded during routine clinical care but there is currently no standardized process for identifying and responding to prognostic indicators associated with increased mortality.

Objectives

This study will aim to develop a prediction model for 6- and 12-month mortality for RACF residents with dementia using prognostic indicators recorded during routine clinical care. The model is intended to be applicable to people with dementia who have been living in a RACF for at least 3 months and to be utilized from 3 months onwards during the RACF admission.

Methods

Study design

This is a secondary analysis of a cohort of people with dementia from RACFs participating in a cluster-randomized trial of a simulation-based palliative care education intervention (IMPETUS-D) [16]. The cohort includes people with dementia living in RACFs in three states in Australia (Victoria, South Australia, and New South Wales) administered by a single-aged care provider. Residents do not receive any additional treatment or intervention through the IMPETUS-D program and participation is voluntary for all staff. Ethics approval for the study was obtained from the Melbourne Health Human Research and Ethics Committee (HREC/17/MH/336) as a component of the IMPETUS-D project ethics application. The study protocol has been designed in accordance with the TRIPOD statement for transparent reporting of the development of multivariable predictive models [17]. Prognostic indicator variables are extracted from RACF records retrospectively from the time of IMPETUS-D randomization using the date of most recent weight measurement as t0. Mortality will then be assessed prospectively for each resident at 6 and 12 months after t0.

Data source

Data from RACF files has been accessed by site co-ordinators using a centralized database administered by the aged care provider. This database contains information recorded during routine clinical care and no assessment of residents will be undertaken outside of that required for usual care. Enrolment of participants occurred over a 12-month period during the pre-implementation and training phase of the IMPETUS-D project from December 2018, to December 2019, with baseline data and prognostic indicator variables collected at the time of enrolment. Mortality data will be collected until December 2020 and recorded at 6- and 12-month intervals post-assessment of prognostic indicator variables (t0). All study data will be recorded using the Research Electronic Data Capture tool (REDCAP) [18] in a secure online database administered by the University of Melbourne, Australia. The research database can only be accessed by research staff working on the project and all records will be stored for a minimum of 5 years after study completion.

Participants

The cohort will comprise a minimum of 900 residents with dementia. Only residents who have been admitted to the RACF for a period of at least 90 days prior to enrolment will be eligible for inclusion if they have a documented diagnosis of dementia based on ICD-10 dementia definitions. Evidence of moderate to severe dementia will be required for study inclusion based on the cognitive skills assessment contained within the Aged Care Funding Instrument (ACFI) and dementia FAST staging.

The ACFI is a mandatory assessment instrument used to determine care needs and funding allocation for all residents of RACFs in Australia. Cognitive skills within the ACFI are divided into four groups (A, B, C, D) based on increasing degree of impairment such that group A has minimal impairment and group D has the most severe level of impairment. People with dementia with cognitive skills classified as group C or D (moderate to severe cognitive impairment) will be eligible for inclusion in the study. ACFI assessment of cognition uses the Psychogeriatric Assessment Scales—Cognitive Impairment Scale (PAS-CIS). This scale has been demonstrated to correlate well with the Mini-Mental State Examination (r = −0.77) [19] with higher scores indicating more severe impairment. Those with a PAS-CIS score of 10-15 are classified as cognitive skills C and those with a score of 16 or above as cognitive skills D. If the PAS-CIS score is not complete, the resident will be included if the ACFI appraisal determines that the resident meets the criteria to be classified as cognitive skills C or D based on evidence that they need assistance with the performance of activities of daily living due to cognitive impairment. In addition to ACFI criteria, study participants will need to meet the criteria for FAST stage 6e dementia at study entry. FAST staging correlates well with the trajectory of cognitive decline in moderate to advanced stages of dementia [20, 21] and stage 6e has been chosen as it represents the threshold for transition to the most advanced stage of dementia (FAST stage 7) for whom prognostic information may be particularly clinically relevant.

Baseline data collected will also include comorbid health conditions identified from diagnoses listed in RACF files matched to ICD-10 codes. Comorbidities will be clustered for analysis into the following groups: chronic lower respiratory diseases (J40-J47), chronic heart failure and cardiomyopathy (I11.0, I42, I50), chronic renal failure (N18-19), chronic liver disease (K70-K74), malignant neoplasms (C00-C97), and ischemic or hemorrhagic stroke (I60-I64).

The evolving Covid-19 (SARS-COV-2) pandemic [22] appears likely to impact RACFs in Australia during follow-up. Given the high mortality rate for Covid-19 among older adults and the unprecedented nature of the pandemic [23], participants who contract Covid-19 during follow-up will be excluded from the model development cohort.

Outcomes

Mortality data will be collected prospectively through a review of RACF files to identify all residents who died during the follow-up period. For any study participants who leave the RACF prior to 12 months of follow-up mortality information will be requested from the Department of Births Deaths and Marriages. Mortality will be divided for analysis into those that occurred within 6 months of study entry and those that occurred within 12 months of study entry. These mortality end points were chosen as they were considered most clinically meaningful. Estimation of the likelihood of death within 6 months is required for hospice eligibility in the USA [24] and is the end point for which the ADEPT model was developed. The Australian Commission on Safety and Quality in Healthcare focuses on those who are “likely to die within the next 12 months” in guidelines regarding end of life care [25] and whether a clinician would be surprised by death within 12 months (“the surprise question”) is often used for end of life identification [26].

Candidate predictor variables

The prognostic indicators for consideration in the multivariable model were identified from a literature review (unpublished) examining clinical features associated with increased mortality for people with dementia (see Table 1). Given the aim is to create a model that could be readily incorporated into routine clinical care, a parsimonious approach was taken to a selection of prognostic indicators with ten variables selected that could be easily assessed by RACF staff through a brief audit of the patient record. The number of variables chosen was also informed by consideration of the minimum number of events per variable required for model development (see sample size below).

Table 1 Candidate predictor variables
Full size table

Pressure injuries, infections, falls, and hospital admissions are recorded through mandatory clinical documentation during routine care at the participating RACF sites. The frequency of these clinical episodes will be assessed for 3 months prior to study entry. More than 10% weight loss in 6 months has been identified as a predictor of mortality in previous studies and thus a 6-month period was chosen for calculation of percentage weight loss [10, 30].

The level of staff assistance for oral intake and transferring out of bed will be assessed from care documented in RACF files and quantified using descriptors from the Minimum Data Set ADL Scale (MDS ADL). The MDS ADL scale has been validated against other functional assessment scales in long-term care [35] and is able to detect change in function for people with cognitive impairment living in RACFs [36]. A decline in MDS ADL scale scores for oral intake and transferring ability, in particular, occurs more commonly in the last months of life for people with advanced dementia [31]. The MDS ADL scale divides the level of assistance required to complete a task into five categories of increasing dependence. A score of zero is given for independence, increasing to a score of four for total dependence on staff to complete the activity.

Sample size

The study cohort will be derived from 24 RACFs comprising a minimum of 2400 residents receiving long-term care. Assuming that 50% of residents will have a diagnosis of dementia based on previous published data from long-term care in Australia [37], there will be an estimated minimum of 1200 residents with dementia. Three quarters (77.3%) of people with dementia in RACFs in Australia have moderate to severe cognitive impairment [38] equating to a minimum of 900 people with dementia who would meet the criteria for inclusion in the cohort.

A minimum of 10 events per variable has been proposed as a reasonable sample size for the development of predictive models [39] and increasing the sample size to 20 events per variable appears to improve the reliability of results [40]. For the ten prognostic indicator variables, a minimum of 200 events (deaths) are therefore required to reach a minimum of 20 events per variable. In RACFs in Australia, the 12-month mortality rate for people with dementia is approximately 30% [37], which is similar to mortality rates found in cohort studies of people with dementia in long-term care in the USA [41, 42]. Assuming a mortality rate of 30%, the required minimum cohort size for the model development cohort is therefore 667 people with dementia to observe a minimum of 200 deaths.

An alternative method for estimating the minimum sample size required for model development has been recently proposed by Riley et al. [43]. Using the optimism corrected c statistic for 12-month mortality reported for the ADEPT model (c = 0.68) [42], a R2D value of 0.208 can be derived. This value can then be used to estimate sample size when combined with a prespecified level of shrinkage for the final model along with the expected event rate and the number of candidate predictor variables. Using the pmsampsize package in R version 3.6.2 with an R2 of 0.208, shrinkage factor of 0.9, event rate of 0.3, and 10 predictor variables gives a minimum sample size of 381 with 11.43 events per variable. The estimated minimum study cohort of 900 people will therefore exceed this figure and also the more conservative 20 events per variable estimate.

Missing data

Missing data will be reported for each variable and addressed through multiple imputation using chained equations (MICE) [44]. Assuming that data is missing at random, multiple imputation allows analysis of variables with missing data and is preferable to restricting analysis to only include those with complete data [45, 46]. The number of imputations will be determined based on the fraction of missing information (FMI) such that the number of imputations undertaken equals the percentage value of the FMI for example using 20 imputations if the FMI is 0.2 [44]. When the FMI is greater than 0.5, this relationship does not hold and greater than 100 imputations may be needed [47]. Given the uncertainty with multiple imputation when the FMI is greater than 0.5, if greater than 50% of cases having missing data, a complete case analysis will be undertaken for sensitivity analysis.

Statistical analysis

Multivariable logistic regression will be used for model development rather than time-to-event methods such as the cox proportional hazards model. We expect to have complete outcome data for all participants at 12 months and have chosen the end points of 6- and 12-months for model development as these have particular clinical relevance. Using logistic regression to model these outcomes does not require an assumption of proportional hazards that may not apply to the prognostic indicators included in the model. The model will be developed through backwards elimination with a nominal level of alpha for variable exclusion set at 0.1 (10%). Using overly stringent levels of alpha for backwards elimination such as 0.05 is more likely to create an overly simplified model that eliminates relevant prognostic variables [48]. Non-linearity of continuous variables will be addressed by using a multivariable fractional polynomial approach, an established technique for transforming non-linear continuous variables when developing a backwards elimination model [49, 50]. The effect of exposure to the IMPETUS-D palliative care education intervention will be analyzed as an additional variable in multivariable analysis to assess whether the intervention influenced mortality. This approach does not require exclusion of those who received the intervention from model development reducing the potential for over-fitting of the model which is more likely to occur if model development is limited to the control group only [51]. A sensitivity analysis of model performance in both the intervention and control groups will also be undertaken.

Performance of the model will be assessed through calculating c statistics and receiver operating curves describing model discrimination for 6 and 12 months mortality. Internal validation will be undertaken using bootstrapping resampling methods [52], which account for bias due to over-fitting more accurately than split sample cross-validation approaches [53]. The model development process will be repeated in 400 bootstrap samples to allow calculation of optimism adjusted calibration slopes and c statistics. Internal calibration will be assessed through comparing observed and predicted event rates for each decile of risk predicted by the model and plotting flexible calibration curves using loess-based smoothers [54]. This approach is considered more informative than the Hosmer-Lemeshow test regarding potential miscalibration [55, 56].

In addition to the model building process, a narrative analysis will also be presented describing the cohort at baseline with regard to age, gender, time since admission to residential care, level of functional impairment on MDS-ADL scale, and comorbidity burden. The spread of mortality rates across RACFs involved in the study will also be examined to explore heterogeneity between facilities. To examine heterogeneity between study sites further, a leave-center-out cross-validation approach will be applied using each RACF as an individual center (n = 24) to allow analysis of variability in the developed model in settings of differing baseline mortality risk.

Reporting of results

Results will be reported in accordance with the Tripod checklist for reporting studies developing multivariable predictive models [17]. The flow of participants through the study will be presented along with their baseline characteristics and the number of participants with missing data. The distribution of participants between intervention and control arms of the IMPETUS-D palliative care education trial will be reported and analysis of the effect of exposure to the intervention on mortality outcomes will be reported. The unadjusted association between each predictor variable and mortality outcomes will be presented in addition to the results of the multivariable analysis and details of how the final prediction model was developed.

Discussion

This study aims to develop a mortality prediction model for people with dementia using prognostic indicators assessed during routine care provided in Australian RACFs. Rather than previous models that have been developed from minimum data set (MDS) variables in the USA, this model will be developed from predefined prognostic indicator variables that may better identify people with dementia at an increased risk of mortality. We believe the inclusion of variables that identify features of recent health instability such as infections, falls, and hospitalizations will identify people with dementia whose health is deteriorating better than a model that only includes factors describing health status at the time of assessment.

One of the limitations of this study is that prognostic indicator variables will be collected retrospectively from RACF files and there is a risk of under detection of variables if documentation is incomplete. While relying on routinely documented clinical information as the source of prognostic information has limitations, this approach reflects how the model would likely be used in clinical practice. A model that requires additional prospective assessment of residents outside of usual care is unlikely to be implemented in the RACF care environment in Australia given that uptake of prospective assessment tools for aspects of dementia care such as pain and behavioral assessment has been very limited unless mandated for use [57, 58].

The developed model should be considered preliminary and not be incorporated into clinical care without further study. In the current study design, heterogeneity in the duration of time the cohort has been living in long-term care at study entry (t0) may introduce survivorship bias. People with dementia newly admitted to long-term care have higher mortality rates within the first 3 months [42, 59] and excluding this group aims to develop a model that only applies to survivors of this high-risk period. To address the issue of survivorship bias, further study is needed involving a cohort followed prospectively from 3 months after RACF admission. Future research combining serial assessment of prognostic indicator variables with dynamic modeling techniques would also allow the model to be utilized across multiple time points. Comparing the performance of the developed model to the ADEPT model in an Australian RACF cohort will also be an important aspect of further validation of the model. The variables required for the ADEPT model are not routinely assessed during clinical care at RACFs in Australia and require additional assessment of residents that is beyond the scope of this model development study.

Even after further validation, there will always be uncertainty with predictive models and the aim is to provide guidance about potential illness trajectory to health care providers rather than replace clinical judgment. It is hoped that, once externally validated, a clinical tool could be developed to enable better identification of residents with dementia at greatest risk of mortality over the following 12 months for whom access to resources such as specialist geriatric medicine and palliative care support may be most critically needed to optimize care and facilitate anticipatory end of life care planning. Future development of a decision support tool would require the involvement of health professionals working in RACFs, people with dementia, and their caregiver’s in order to ensure that mortality risk information is utilized appropriately to meet the needs of the population that the tool intends to support.

Availability of data and materials

Not applicable.

Change history

References

  1. Birch D, Draper J. A critical literature review exploring the challenges of delivering effective palliative care to older people with dementia. Journal of clinical nursing. 2008;17(9):1144–63.

    PubMed  Google Scholar 

  2. Sachs GA, Shega JW, Cox-Hayley D. Barriers to excellent end-of-life care for patients with dementia. Journal of General Internal Medicine. 2004;19(10):1057–63.

    PubMed  PubMed Central  Google Scholar 

  3. Jayes RL, Arnold RM, Fromme EK. Does this dementia patient meet the prognosis eligibility requirements for hospice enrollment? Journal of Pain and Symptom Management. 2012;44(5):750–6.

    PubMed  Google Scholar 

  4. Hill E, Savundranayagam MY, Zecevic A, Kloseck M. Staff perspectives of barriers to access and delivery of palliative care for persons with dementia in long-term care. American Journal of Alzheimer's Disease & Other Dementias. 2018;33(5):284–91.

    Google Scholar 

  5. Morin L, Johnell K, Van den Block L, Aubry R. Discussing end-of-life issues in nursing homes: a nationwide study in France. Age & Ageing. 2016;45(3):395–402.

    Google Scholar 

  6. Sampson EL, Candy B, Davis S, Gola AB, Harrington J, King M, et al. Living and dying with advanced dementia: a prospective cohort study of symptoms, service use and care at the end of life. Palliative Medicine. 2018;32(3):668–81.

    PubMed  Google Scholar 

  7. Bamford C, Lee R, McLellan E, Poole M, Harrison-Dening K, Hughes J, et al. What enables good end of life care for people with dementia? A multi-method qualitative study with key stakeholders. BMC Geriatrics. 2018;18(1):302.

    PubMed  PubMed Central  Google Scholar 

  8. Loizeau AJ, Shaffer ML, Habtemariam DA, Hanson LC, Volandes AE, Mitchell SL. Association of prognostic estimates with burdensome interventions in nursing home residents with advanced dementia. JAMA Internal Medicine. 2018;178(7):922–9.

    PubMed  PubMed Central  Google Scholar 

  9. Mann E, Goff SL, Colon-Cartagena W, Bellantonio S, Rothberg MB. Do-not-hospitalize orders for individuals with advanced dementia: healthcare proxies’ perspectives. Journal of the American Geriatrics Society. 2013;61(9):1568–73.

    PubMed  PubMed Central  Google Scholar 

  10. Mitchell SL, Kiely DK, Hamel MB, Park PS, Morris JN, Fries BE, et al. Estimating prognosis for nursing home residents with advanced dementia. JAMA. 2004;291(22):2734–40.

    CAS  PubMed  Google Scholar 

  11. Mitchell SL, Miller SC, Teno JM, Kiely DK, Davis RB, Shaffer ML. Prediction of 6-month survival of nursing home residents with advanced dementia using ADEPT vs hospice eligibility guidelines. JAMA. 2010;304(17):1929–35.

    CAS  PubMed  PubMed Central  Google Scholar 

  12. Hutchinson AM, Milke DL, Maisey S, Johnson C, Squires JE, Teare G, et al. The Resident Assessment Instrument-Minimum Data Set 2.0 quality indicators: a systematic review. BMC Health Serv Res. 2010;10(1):166.

    PubMed  PubMed Central  Google Scholar 

  13. Rahman AN, Applebaum RA. The nursing home Minimum Data Set assessment instrument: manifest functions and unintended consequences—past, present, and future. The Gerontologist. 2009;49(6):727–35.

    PubMed  Google Scholar 

  14. Australian Government Department of Health. Aged Care Funding Instrument (ACFI) User Guide 2016 [Available from: https://agedcare.health.gov.au/funding/aged-care-subsidies-and-supplements/residential-care-subsidy/basic-subsidy-amount-aged-care-funding-instrument/aged-care-funding-instrument-acfi-user-guide.] Accessed 9 Dec 2019.

  15. Hillen JB, Vitry A, Caughey GE. Disease burden, comorbidity and geriatric syndromes in the Australian aged care population. Australas J Ageing. 2017;36(2):E14–E9.

    PubMed  Google Scholar 

  16. Tropea J, Johnson CE, Nestel D, Paul SK, Brand CA, Hutchinson AF, et al. A screen-based simulation training program to improve palliative care of people with advanced dementia living in residential aged care facilities and reduce hospital transfers: study protocol for the IMproving Palliative care Education and Training Using Simulation in Dementia (IMPETUS-D) cluster randomised controlled trial. BMC Palliative Care. 2019;18(1):86.

    PubMed  PubMed Central  Google Scholar 

  17. Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. British journal of cancer. 2015;112(2):251–9.

    CAS  PubMed  PubMed Central  Google Scholar 

  18. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap): a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.

    PubMed  Google Scholar 

  19. Jorm A, Mackinnon A, Christensen H, Henderson A, Jacomb P, Korten A. The psychogeriatric assessment scales (PAS): further data on psychometric properties and validity from a longitudinal study of the elderly. Int J Geriatr Psychiatry. 1997;12(1):93–100.

    CAS  PubMed  Google Scholar 

  20. Sclan SG, Reisberg B. Functional assessment staging (FAST) in Alzheimer’s disease: reliability, validity, and ordinality. International Psychogeriatrics. 1992;4(3):55–69.

    PubMed  Google Scholar 

  21. Auer S, Reisberg B. The GDS/FAST staging system. International Psychogeriatrics. 1997;9(S1):167–71.

    PubMed  Google Scholar 

  22. Velavan TP, Meyer CG. The COVID-19 epidemic. Trop Med Int Health. 2020;25(3):278–80.

    CAS  PubMed  PubMed Central  Google Scholar 

  23. Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72314 cases from the Chinese Center for Disease Control and Prevention. JAMA. Published online February 24, 2020. https://doi.org/10.1001/jama.2020.2648.

  24. Fine PG. Hospice Underutilization in the U.S.: The misalignment of regulatory policy and clinical reality. Journal of Pain and Symptom Management. 2018;56(5):808–15.

    PubMed  Google Scholar 

  25. Australian Comission on Safety and Quality in Healthcare. National Consensus Statement: essential elements for safe and high-quality end-of-life care. Sydney: ACSQHC. 2015. [Available from https://www.safetyandquality.gov.au/sites/default/files/migrated/National-Consensus-Statement-Essential-Elements-forsafe-high-quality-end-of-life-care.pdf] Accessed 25 Mar 2020.

  26. White N, Kupeli N, Vickerstaff V, Stone P. How accurate is the ‘Surprise Question’ at identifying patients at the end of life? A systematic review and meta-analysis. BMC Medicine. 2017;15(1):139.

    PubMed  PubMed Central  Google Scholar 

  27. Allers K, Hoffmann F. Mortality and hospitalization at the end of life in newly admitted nursing home residents with and without dementia. Soc Psychiatry Psychiatr Epidemiol. 2018;53(8):833–9.

    PubMed  Google Scholar 

  28. Brown MA, Sampson EL, Jones L, Barron AM. Prognostic indicators of 6-month mortality in elderly people with advanced dementia: a systematic review. Palliative medicine. 2013;27(5):389–400.

    PubMed  Google Scholar 

  29. Hsieh P-C, Wu S-C, Fuh J-L, Wang Y-W, Lin L-C. The prognostic predictors of six-month mortality for residents with advanced dementia in long-term care facilities in Taiwan: a prospective cohort study. International Journal of Nursing Studies. 2019;96:9–17.

    PubMed  Google Scholar 

  30. Hanson LC, Ersek M, Lin FC, Carey TS. Outcomes of feeding problems in advanced dementia in a nursing home population. Journal of the American Geriatrics Society. 2013;61(10):1692–7.

    PubMed  PubMed Central  Google Scholar 

  31. Chen J, Chan D, Kiely DK, Morris JN, Mitchell SL. Terminal trajectories of functional decline in the long-term care setting. J Gerontol Series A Biol Sci Med Sci. 2007;62(5):531–6.

    Google Scholar 

  32. Meier DE, Ahronheim JC, Morris J, Baskin-Lyons S, Morrison RS. High short-term mortality in hospitalized patients with advanced dementia: lack of benefit of tube feeding. Archives of Internal Medicine. 2001;161(4):594–9.

    CAS  PubMed  Google Scholar 

  33. de Souto BP, Cadroy Y, Kelaiditi E, Vellas B, Rolland Y. The prognostic value of body-mass index on mortality in older adults with dementia living in nursing homes. Clin Nutr. 2017;36(2):423–8.

    Google Scholar 

  34. Iaboni A, Van Ooteghem K, Marcil MN, Cockburn A, Flint AJ, Grossman D, et al. A palliative approach to falls in advanced dementia. Am J Geriatr Psychiatry. 2018;26(4):407–15.

    PubMed  Google Scholar 

  35. Morris JN, Fries BE, Morris SA. Scaling ADLs within the MDS. J Gerontol Series A. 1999;54(11):M546–M53.

    CAS  Google Scholar 

  36. Carpenter GI, Hastie CL, Morris JN, Fries BE, Ankri J. Measuring change in activities of daily living in nursing home residents with moderate to severe cognitive impairment. BMC geriatrics. 2006;6:7.

    PubMed  PubMed Central  Google Scholar 

  37. Harrison SL, Lang C, Whitehead C, Crotty M, Ratcliffe J, Wesselingh S, et al. Trends in prevalence of dementia for people accessing aged care services in Australia. The Journals of Gerontology: Series A. 2019. Available from: https://doi.org/10.1093/gerona/glz032 (Epub ahead of print, 15 Mar 2019).

  38. Australian Institute of Health and Welfare. Dementia among aged care residents: first information from the Aged Care Funding Instrument. Aged care statistics series no 32. Canberra: Australian Institute of Health and Welfare; 2011.

    Google Scholar 

  39. Moons KGM, Kengne AP, Woodward M, Royston P, Vergouwe Y, Altman DG, et al. Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart. 2012;98(9):683–90.

    PubMed  Google Scholar 

  40. Austin PC, Steyerberg EW. Events per variable (EPV) and the relative performance of different strategies for estimating the out-of-sample validity of logistic regression models. Stat Methods Med Res. 2017;26(2):796–808.

    PubMed  Google Scholar 

  41. Mitchell SL, Morris JN, Park PS, Fries BE. Terminal care for persons with advanced dementia in the nursing home and home care settings. Journal of Palliative Medicine. 2004;7(6):808–16.

    PubMed  Google Scholar 

  42. Mitchell SL, Miller SC, Teno JM, Davis RB, Shaffer ML. The advanced dementia prognostic tool: a risk score to estimate survival in nursing home residents with advanced dementia. J Pain Symptom Manage. 2010;40(5):639–51.

    PubMed  PubMed Central  Google Scholar 

  43. Riley RD, Snell KI, Ensor J, Burke DL, Harrell FE Jr, Moons KG, et al. Minimum sample size for developing a multivariable prediction model: PART II - binary and time-to-event outcomes. Stat Med. 2019;38(7):1276–96.

    PubMed  Google Scholar 

  44. White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Statistics in Medicine. 2011;30(4):377–99.

    PubMed  Google Scholar 

  45. Li P, Stuart EA, Allison DB. Multiple imputation: a flexible tool for handling missing data. JAMA. 2015;314(18):1966–7.

    CAS  PubMed  PubMed Central  Google Scholar 

  46. Sterne JAC, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338:b2393.

    PubMed  PubMed Central  Google Scholar 

  47. Graham JW, Olchowski AE, Gilreath TD. How many imputations are really needed? Some Practical Clarifications of Multiple Imputation Theory. Prevention Science. 2007;8(3):206–13.

    PubMed  Google Scholar 

  48. Steyerberg EW, Eijkemans MJC, Harrell FE Jr, Habbema JDF. Prognostic modelling with logistic regression analysis: a comparison of selection and estimation methods in small data sets. Stat Med. 2000;19(8):1059–79.

    CAS  PubMed  Google Scholar 

  49. Sauerbrei W, Royston P, Binder H. Selection of important variables and determination of functional form for continuous predictors in multivariable model building. Statistics in Medicine. 2007;26(30):5512–28.

    PubMed  Google Scholar 

  50. Royston P, Moons KGM, Altman DG, Vergouwe Y. Prognosis and prognostic research: developing a prognostic model. BMJ. 2009;338:b604.

    PubMed  Google Scholar 

  51. Groenwold RHH, Moons KGM, Pajouheshnia R, Altman DG, Collins GS, Debray TPA, et al. Explicit inclusion of treatment in prognostic modeling was recommended in observational and randomized settings. Journal of Clinical Epidemiology. 2016;78:90–100.

    PubMed  Google Scholar 

  52. Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.

    PubMed  Google Scholar 

  53. Smith GCS, Seaman SR, Wood AM, Royston P, White IR. Correcting for optimistic prediction in small data sets. American Journal of Epidemiology. 2014;180(3):318–24.

    PubMed  PubMed Central  Google Scholar 

  54. Austin PC, Steyerberg EW. Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers. Statistics in Medicine. 2014;33(3):517–35.

    PubMed  Google Scholar 

  55. Van Calster B, Nieboer D, Vergouwe Y, De Cock B, Pencina MJ, Steyerberg EW. A calibration hierarchy for risk models was defined: from utopia to empirical data. Journal of Clinical Epidemiology. 2016;74:167–76.

    PubMed  Google Scholar 

  56. Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW, Bossuyt P, et al. Calibration: the Achilles heel of predictive analytics. BMC Med. 2019;17(1):230.

    PubMed  PubMed Central  Google Scholar 

  57. Peisah C, Weaver J, Wong L, Strukovski JA. Silent and suffering: a pilot study exploring gaps between theory and practice in pain management for people with severe dementia in residential aged care facilities. Clinical Interventions in Aging. 2014;9:1767–74.

    PubMed  PubMed Central  Google Scholar 

  58. Loi SM, Lautenschlager NT. Investigating the current methods of assessing behavioral and psychological symptoms in residential aged care facilities in a metropolitan city. International Psychogeriatrics. 2017;29(5):855–8.

    PubMed  Google Scholar 

  59. Aneshensel CS, Pearlin LI, Levy-Storms L, Schuler RH. The transition from home to nursing home mortality among people with dementia. J Gerontol Series B. 2000;55(3):S152–62.

    CAS  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

As a sub-study within the IMPETUS-D project, this study is partially supported by the Australian Government Department of Health through a Dementia and Aged Care Services Grant Opportunity. This funding body had no input into study design, data collection, analysis, or manuscript preparation.

Author information

Authors and Affiliations

  1. Department of Medicine and Aged Care, @AgeMelbourne, Melbourne Health–Royal Melbourne Hospital, University of Melbourne, 6 North Main Building, Royal Melbourne Hospital, 300 Grattan Street, Parkville, Victoria, 3050, Australia

    Ross Bicknell, Wen Kwang Lim, Andrea B. Maier & Dina LoGiudice

  2. Department of Human Movement Sciences, @AgeAmsterdam, Amsterdam Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands

    Andrea B. Maier

Authors
  1. Ross Bicknell
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen Kwang Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andrea B. Maier
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dina LoGiudice
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RB and WKL developed the initial study design with ABM and DL contributing to study methodology. RB drafted the initial study manuscript and WKL, ABM, and DL contributed to revising the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ross Bicknell.

Ethics declarations

Ethics approval and consent to participate

Ethics approval was granted by the Melbourne Health Human Research and Ethics Committee (HREC/17/MH/336) as a sub-study within the IMPETUS-D project ethics application. Individual consent of RACF residents was not required; given data is extracted from electronic medical records with no additional assessment of residents outside of usual care.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original version of this article was revised: The family name of Dina LoGiudice has been corrected.

Rights and permissions

, Corrected publication 2021. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bicknell, R., Lim, W.K., Maier, A.B. et al. A study protocol for the development of a multivariable model predicting 6- and 12-month mortality for people with dementia living in residential aged care facilities (RACFs) in Australia. Diagn Progn Res 4, 17 (2020). https://doi.org/10.1186/s41512-020-00085-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41512-020-00085-0

Keywords

Diagnostic and Prognostic Research

ISSN: 2397-7523

Contact us