The Importance of Measurement in Science
Measurement is essential in science for accurate data collection and analysis.
Rok Blagus, Bojan Leskošek, Francisco B. Ortega, Grant R. Tomkinson, Gregor Jurak
― 6 min read
Table of Contents
- Criterion-Referenced Tests
- Norm-Referenced Tests
- Growth Charts in Pediatric Health
- Understanding Norms
- GAMLSS: The Modeling Superstar
- Publishing Norms with Privacy in Mind
- Tools for Norm Publication
- How GAMLSS Works
- The Need for Standardization
- Key Components of Norm Papers
- How to Use GAMLSS for Norms
- Example: The FitBack Dataset
- Making Interactive Tools
- Conclusion
- Original Source
- Reference Links
Measurement is key in science. It helps us figure out the traits of things we can see, touch, or even the things we can't. To do this, scientists use tests, tools, or scales to collect data. There are two main types of tests: those that compare to fixed criteria and those that compare to a group.
Criterion-Referenced Tests
Criterion-referenced tests check how something performs against a set standard. For example, if we look at adult body weight using the body mass index (BMI), we have specific numbers to help us classify individuals. A BMI under 18.5 is considered underweight, a BMI from 18.5 to 24.9 is normal, from 25 to 29.9 is overweight, and 30 and above is obese. This helps us understand where someone stands regarding health based on clear lines in the sand.
Norm-Referenced Tests
On the other hand, norm-referenced tests compare a person's performance against a broader group. This might be a national or global crowd. These tests are common in areas like psychology, education, and health care. For instance, a popular test in psychology is the WISC, which checks how smart children are compared to others. In schools, the SAT and ACT tests help teachers figure out where to place students for college readiness.
Growth Charts in Pediatric Health
In pediatric health, growth charts are a big deal. They help doctors keep an eye on how kids grow. By looking at height and weight norms for kids, pediatricians can tell if children are developing as expected. For sports, norms help coaches understand how players perform based on standard measures of fitness and skill.
Understanding Norms
In scientific writing, norms, or normative data, are often shown in tables or graphs. Tables might list specific centile values at different ages, while graphs can show centile curves. However, sometimes the data isn't super detailed. For example, if you want to know exactly where a 10-year-old stands compared to their peers, it might take some digging.
When we introduce complex terms, the task becomes even trickier. Add in some fancy tools called P-splines for smooth curves, and now we’re talking about the need for detailed information. Unfortunately, this is often not shared when studies are published. The lack of clear and precise data makes it hard for experts and test-takers to do their jobs.
GAMLSS: The Modeling Superstar
Among the tools scientists use to create norms, one favorite is the gamlss library in R. It uses a method called Generalized Additive Models for Location, Scale, and Shape. With this, researchers can create better centile curves, giving us a clearer view of how measurements relate to growth, fitness, or other attributes.
However, there’s a hitch. Researchers often can’t share their models due to laws that protect individuals’ data, like the General Data Protection Regulation (GDPR) in Europe. So, while the tools exist to evaluate test performance accurately, many do not have access to the models.
Publishing Norms with Privacy in Mind
To address this, new standards are proposed for publishing norms. The goal is to provide a way to evaluate scores without sharing personal information. To achieve this, scientists need tools to help them communicate their findings more clearly.
Tools for Norm Publication
A few cool tools have been developed to help researchers. These include:
- A tool for creating clear reports that others can read easily.
- A tool for making machine-readable formats so others can use the data without building it from scratch.
- A tool that helps authors, even if they aren't tech-savvy, create web apps enabling easy score calculations for users.
How GAMLSS Works
The GAMLSS system models various traits of a distribution, offering a detailed picture of data. When creating norms, scientists often look at four key parameters: location, variation, skewness, and kurtosis. These terms might sound fancy, but they help frame the data within a specific context. This allows researchers to predict results based on given factors, such as age, and understand growth trends better.
In norm construction, researchers often use smooth terms, which help model relationships that aren’t simple lines. One popular method is called P-splines. These make it easier to fit data without getting too caught up in small details that could lead to errors.
The Need for Standardization
A paper that presents norms should follow a set format to help readers understand the underlying model better. This will make it easier to compare different studies and models.
Key Components of Norm Papers
- Model Details: Information about how the model was built and details like the chosen family of distributions should be shared.
- Link Functions: The link functions, which connect the distribution parameters to the explanatory variables, should be clearly laid out.
- Coefficients: The estimated coefficients used for each parameter need to be shared too.
- Additive Terms: If any smooth terms are used, the details about them should be included.
- User-Friendly Tools: The publication should also come with tools that allow users, even those with limited programming skills, to use the norms effortlessly.
These steps help ensure that people can interpret the data accurately while keeping personal information safe.
How to Use GAMLSS for Norms
Let’s break down how to use GAMLSS to publish norms in a practical way. Imagine we have a dataset of fitness scores, like how far kids can jump. After cleaning this data, researchers can use GAMLSS to analyze it.
Example: The FitBack Dataset
A fun example is the FitBack dataset, which collects jumping scores from kids across Europe. This dataset includes tons of results, giving a rich source of information to analyze.
After the model is fitted, researchers can use the function to extract all necessary details about the model. This is where the gamlssReport function shines, making it easy to get everything from how the model is built to predictions it can make.
When we want to find out how a specific score ranks, we can plug in our values using the appropriate functions, like centile.gamlssReport. If we want to see what score corresponds to a specific centile, there’s a function for that too!
Making Interactive Tools
Another cool aspect of the tools is the ability to create a web app. This is where any user, even one who hasn’t written a single line of code, can enter their age and score to see where they stand. It’s like having a friendly calculator that makes you feel like a math genius!
By using these tools, we can ensure that no one has to sift through mountains of data. They just need to enter some simple values, and voilà! They get their results.
Conclusion
In conclusion, establishing clear standards for publishing norms in scientific work is vital. This ensures that professionals can interpret results accurately without stepping on the toes of privacy laws.
With user-friendly tools like gamlssReport, researchers can produce practical, accessible information that benefits everyone. This way, we take measurement and data processing from the realms of the experts and put it into the hands of those eager to learn.
So, while the task of creating norms may seem daunting, with the right tools, it can be as easy as pie-or should we say, as easy as jumping over a bar!
Title: Standards for reporting norms in the scientific literature and the development of free-access tools to apply them in practice
Abstract: Norm-referenced tests compare individuals to a group. While norms are often presented in tables and graphs, exact score evaluation relies on model parameters, often undisclosed. These models, like those from the R gamlss package, include individual data protected by law and consent, hindering full transparency. Thus, this paper proposes standards for publishing test norms that allow precise score evaluation while protecting participant privacy. We outline specific requirements for norms publications: a) the exact presentation of the fitted model that contains the estimates of all model parameters and other information required for exact evaluation; b) computer sharable fit of the model that does not contain any sensitive information and can be used by those with programming skills to evaluate scores; and c) a web-based application that can be used by those without programming skills to use the results of the fitted model. To facilitate publication and utilization of norms, we have developed and provided in this manuscript an open-source R package of tools for authors and users alike.
Authors: Rok Blagus, Bojan Leskošek, Francisco B. Ortega, Grant R. Tomkinson, Gregor Jurak
Last Update: 2024-11-15 00:00:00
Language: English
Source URL: https://www.medrxiv.org/content/10.1101/2024.11.12.24317147
Source PDF: https://www.medrxiv.org/content/10.1101/2024.11.12.24317147.full.pdf
Licence: https://creativecommons.org/licenses/by-nc/4.0/
Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.
Thank you to medrxiv for use of its open access interoperability.