Simple Science

Cutting edge science explained simply

# Health Sciences # Health Informatics

Predicting CLABSI: New Models for Patient Safety

Research on predicting CLABSI risk could improve patient outcomes.

Elena Albu, Shan Gao, Pieter Stijnen, Frank E. Rademakers, Christel Janssens, Veerle Cossey, Yves Debaveye, Laure Wynants, Ben Van Calster

― 7 min read


CLABSI Risk Prediction CLABSI Risk Prediction Models hospital infections. New models could prevent serious
Table of Contents

Have you ever been in a hospital where you felt like you were waiting forever to leave? Well, for some patients, there's a good reason for that-Central Line-Associated Bloodstream Infection, or CLABSI for short. It's like getting a ticket to the hospital stay that you definitely didn’t want. CLABSI occurs when bacteria get into the bloodstream through a central venous catheter (a fancy tube that’s inserted into a big vein). This infection usually pops up at least 48 hours after being admitted, and it doesn't come from another infection that you already had. Sadly, CLABSI can lead to longer hospital stays, increased medical bills, and a higher chance of serious health problems or even death. Not what anyone wants while they are trying to get better.

The Quest for Risk Predictions

Now, wouldn’t it be great if doctors could predict who might be at risk for getting CLABSI? Well, that’s what many healthcare professionals are working on. By developing a Risk Prediction Model, they can assess patients’ risks more quickly and take action to prevent these pesky infections. This might help save lives and reduce the dreaded hospital bill.

In the past, researchers looked at different models to predict CLABSI risks. Most were like old flip phones: static and unable to adapt. They did not consider how a patient's condition might change during their hospital stay. Only one model was dynamic, but it was limited to patients in a specific area of the hospital.

Thanks to the growing use of Electronic Health Records (EHRs), researchers now have access to more continuous data about patients. This means they can have updates at all hours, just like your social media feed. More data can help create better models for predicting risks.

Our Study: A New Approach to Predictions

In this study, we harnessed the power of EHR data to create models that keep up with changes in patient health. We aimed to predict the 7-day risk of CLABSI for patients with central venous catheters at University Hospitals Leuven. We developed and evaluated six models, like a chef testing different recipes. These models were built using a mix of complex statistical techniques. Among them, we had regression models, random forests, extreme gradient boosting, and a superlearner ensemble model. Just picture that superlearner as the ultimate superhero of risk prediction, gathering the best powers from its friends!

Gathering the Data

We gathered patient data from the hospital's EHR system from January 2014 to December 2020. The patients included all age groups-neonates to geriatrics-who had central catheters. No one was left out of this party.

The details we collected included all sorts of information: demographics, laboratory tests, medications, and vital signs. Think of it as creating a detailed profile for each patient. Although we ran into some missing data (who hasn't lost their phone charger at least once?), we had a solid method for filling in those gaps.

What Were We Looking For?

For our study, we defined CLABSI as any infection confirmed by a lab test for a patient who had a central catheter. This infection had to pop up within 48 hours after the catheter was removed. Our operation for classifying what was a CLABSI and what wasn’t was pretty meticulous.

We also had to consider when patients were discharged from the hospital or if they passed away. This information was crucial in determining how long a patient would be monitored for CLABSI.

How We Built Our Models

With our data in hand, we got down to the nitty-gritty of creating our models. We decided to build five dynamic models that could adapt to new information over time. We looked at factors like patient death and discharge as competing outcomes, just like a game of musical chairs.

Some models used fewer variables, while others used the entire range of information at our disposal. We even created a superlearner model that combined predictions from multiple models for better results. It was like assembling an all-star team!

Evaluating Our Models

Just like getting feedback on a new hairstyle, we needed to evaluate how our models performed. We looked at metrics to see how well each model predicted the risk of CLABSI. Some models performed better than others, and we also checked how well they matched up with real-life outcomes.

To make it more relatable, think about how when you predict it will rain, you want to see if it actually does. If your prediction was accurate, great! If not, well, you might want to rethink your weather app!

Results & Observations

We ran the models through a series of tests to see how they performed. The best-performing model was the XGB-ALL model, which achieved a great score on the prediction scale. On the other hand, some models tended to overestimate the risk of CLABSI, kind of like expecting to win the lottery every week.

It seemed like our models were good at spotting potential risks, especially at medium-risk thresholds. However, when it came to high-risk thresholds, they weren't quite as reliable. This is where our models could use a bit more work.

The Shift Over Time

As we compared our results, we noticed that the models didn’t perform as well in recent years compared to the earlier data. It was like watching a movie sequel that wasn’t as good as the original.

One reason for this could be changes in patient care practices or how hospitals manage catheters. We also discovered that the D-dimer values (a lab test) had major shifts which could affect predictions.

Moreover, we noted that CLABSI cases had been declining over the years. This might be a good sign, but it also meant that predicting CLABSI was becoming trickier over time.

Practical Applications of Our Models

So, what does all this mean in real life? Well, if implemented properly, these models could help inform nurses and doctors about patients who might need more attention regarding their central catheters. It’s like having a warning system that helps staff act quickly to prevent infections.

By using medium-risk alerts, healthcare teams can check on catheter maintenance and ensure that everything is in order. High-risk alerts, however, didn’t show much practical value.

Limitations and Room for Growth

Like any good invention, our models do have some limitations. For instance, while we gathered a ton of data, we didn’t focus much on predictors for death and discharge. More work could improve the models and refine what data we actually need to use.

Also, our predictions only relied on the most recent data, ignoring previous trends over time. This might not paint the full picture of a patient’s health.

Lastly, we didn’t consider race, ethnicity, or socioeconomic status in our models. These factors can lead to different risks for infections, meaning our models might not apply to everyone equally.

The Future of CLABSI Models

As we look ahead, more studies are needed to see if these models can be useful in other hospital settings. Would they do as well outside of our data bubble?

The way hospitals record data also comes into play. For our models to be more widely applicable, they would need to adapt to other EHR systems. That means making sure data can be standardized and easily interpreted across various platforms.

Conclusion: The Road Ahead

We took a swing at predicting the 7-day risk of CLABSI in patients with central catheters and came away with a better understanding, even if the results were a bit mixed. While we created dynamic models and saw some successes, there’s still plenty of work to be done.

The good news is, with continued research and improvements, we can help healthcare teams catch that pesky infection known as CLABSI before it sneaks up on patients. As they say, an ounce of prevention is worth a pound of cure, and no one wants to be stuck in the hospital any longer than necessary!

Original Source

Title: Hospital-wide, dynamic, individualized prediction of central line-associated bloodstream infections - development and temporal evaluation of six prediction models

Abstract: BackgroundCentral line-associated bloodstream infections (CLABSI) are preventable hospital-acquired infections. Predicting CLABSI helps improve early intervention strategies and enhance patient safety. AimTo develop and temporally evaluate dynamic prediction models for continuous CLABSI risk monitoring. MethodsData from hospitalized patients with central catheter(s) admitted to University Hospitals Leuven between 2014 and 2017 were used to develop five dynamic models (a cause-specific landmark supermodel, two random forest models, and two XGBoost models) to predict 7-day CLABSI risk, accounting for competing events (death, discharge, and catheter removal). The models predictions were then combined using a superlearner model. All models were temporally evaluated on data from the same hospital from 2018 to 2020 using performance metrics for discrimination, calibration, and clinical utility. FindingsAmong 61629 catheter episodes in the training set, 1930 (3.1%) resulted in CLABSI, while in the test set of 44544 catheter episodes, 1059 (2.4%) experienced CLABSI. Among individual models, one XGBoost model reached an AUROC of 0.748. Calibration was good for predicted risks up to 5%, while the cause-specific and XGBoost models overestimated higher predicted risks. The superlearner displayed a modest improvement in discrimination (AUROC up to 0.751) and better calibration than the cause-specific and XGBoost models, but worse than the random forest models. The models showed clinical utility to support standard care interventions (at risk thresholds between 0.5-4%), but not to support advanced interventions (at thresholds 15-25%). A deterioration in model performance over time was observed on temporal evaluation. ConclusionHospital-wide CLABSI prediction models offer clinical utility, though temporal evaluation revealed dataset shift.

Authors: Elena Albu, Shan Gao, Pieter Stijnen, Frank E. Rademakers, Christel Janssens, Veerle Cossey, Yves Debaveye, Laure Wynants, Ben Van Calster

Last Update: 2024-11-04 00:00:00

Language: English

Source URL: https://www.medrxiv.org/content/10.1101/2024.11.04.24316689

Source PDF: https://www.medrxiv.org/content/10.1101/2024.11.04.24316689.full.pdf

Licence: https://creativecommons.org/licenses/by/4.0/

Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.

Thank you to medrxiv for use of its open access interoperability.

More from authors

Similar Articles