Ratings are present in many areas of assessment including peer review of research proposals and journal articles, teacher observations, university admissions and selection of new hires. One feature present in any rating process with multiple raters is that different raters often assign different scores to the same assessee, with the potential for bias and inconsistencies related to rater or assessee covariates. This paper analyzes disparities in ratings of internal and external applicants to teaching positions using applicant data from Spokane Public Schools. We first test for biases in rating while accounting for measures of teacher applicant qualifications and quality. Then, we develop model-based inter-rater reliability (IRR) estimates that allow us to account for various sources of measurement error, the hierarchical structure of the data, and to test whether covariates, such as applicant status, moderate IRR. We find that applicants external to the district receive lower ratings for job applications compared to internal applicants. This gap in ratings remains significant even after including measures of qualifications and quality such as experience, state licensure scores, or estimated teacher value added. With model-based IRR, we further show that consistency between raters is significantly lower when rating external applicants. We conclude the paper by discussing policy implications and possible applications of our model-based IRR estimate for hiring and selection practices in and out of the teacher labor market.

• MeSH
• lidé MeSH
• posudkové řízení normy   MeSH
• školy normy   MeSH
• učení fyziologie   MeSH
• učitelé normy   MeSH
• veřejný sektor MeSH
• výběr pracovníků normy   MeSH
• zaměstnanost normy   MeSH
• zkreslení výsledků (epidemiologie) MeSH
• Check Tag
• lidé MeSH
• Publikační typ
• časopisecké články MeSH
• práce podpořená grantem MeSH

BACKGROUND: A wide variety of interventions exists in physical therapy (PT), but knowledge about their use across different geographical regions is limited. This study investigated the use of PT interventions in people with multiple sclerosis (MS) across Europe. It aimed to determine whether regions differ in applying interventions, and explore whether factors other than regions play a role in their use. METHODS: In an online cross-sectional survey, 212 respondents from 115 European workplaces providing PT services to people with MS representing 26 countries (four European regions) participated. Cluster analysis, Pearson Chi-squared test and a Poisson regression model were used to analyze the data. RESULTS: Thirteen of 45 listed PT interventions were used by more than 75% of centers, while nine interventions were used by less than 25%. For 12 interventions, regions differed markedly in their use. Cluster analysis of centers identified four clusters similar in their intervention use. Cluster assignment did not fully align with regions. While center region was important, center size, number and gender of physical therapists working in the center, and time since qualification also played a role. Cluster analysis exploring the use of the interventions provided the basis for a categorization of PT interventions in line with their primary focus: 1. Physical activity (fitness/endurance/resistance) training; 2. Neuroproprioceptive "facilitation/inhibition"; 3. Motor/skill acquisition (individualized therapy led); 4. Technology based interventions. CONCLUSIONS: To our knowledge this is the first study that has explored this topic in MS. The results broaden our understanding of the different PT interventions used in MS, as well as the context of their use.

• MeSH
• lidé MeSH
• průřezové studie MeSH
• regresní analýza MeSH
• roztroušená skleróza terapie   MeSH
• shluková analýza MeSH
• techniky fyzikální terapie * MeSH
• Check Tag
• lidé MeSH
• mužské pohlaví MeSH
• ženské pohlaví MeSH
• Publikační typ
• časopisecké články MeSH
• Geografické názvy
• Evropa MeSH