Inconsistent ratings
Dotaz
Zobrazit nápovědu
- MeSH
- alkoholismus MeSH
- fertilizace in vitro MeSH
- indukovaný potrat MeSH
- lidé MeSH
- plod MeSH
- poruchy spojené s užíváním psychoaktivních látek MeSH
- samovolný potrat MeSH
- zákonodárství jako téma MeSH
- Check Tag
- lidé MeSH
- Geografické názvy
- Švédsko MeSH
Ratings are present in many areas of assessment including peer review of research proposals and journal articles, teacher observations, university admissions and selection of new hires. One feature present in any rating process with multiple raters is that different raters often assign different scores to the same assessee, with the potential for bias and inconsistencies related to rater or assessee covariates. This paper analyzes disparities in ratings of internal and external applicants to teaching positions using applicant data from Spokane Public Schools. We first test for biases in rating while accounting for measures of teacher applicant qualifications and quality. Then, we develop model-based inter-rater reliability (IRR) estimates that allow us to account for various sources of measurement error, the hierarchical structure of the data, and to test whether covariates, such as applicant status, moderate IRR. We find that applicants external to the district receive lower ratings for job applications compared to internal applicants. This gap in ratings remains significant even after including measures of qualifications and quality such as experience, state licensure scores, or estimated teacher value added. With model-based IRR, we further show that consistency between raters is significantly lower when rating external applicants. We conclude the paper by discussing policy implications and possible applications of our model-based IRR estimate for hiring and selection practices in and out of the teacher labor market.
- MeSH
- lidé MeSH
- posudkové řízení normy MeSH
- školy normy MeSH
- učení fyziologie MeSH
- učitelé normy MeSH
- veřejný sektor MeSH
- výběr pracovníků normy MeSH
- zaměstnanost normy MeSH
- zkreslení výsledků (epidemiologie) MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
- práce podpořená grantem MeSH
BACKGROUND: Mitigating rating inconsistency can improve measurement fidelity and detection of treatment response. METHODS: The International Society for CNS Clinical Trials and Methodology convened an expert Working Group that developed consistency checks for ratings of the Hamilton Anxiety Rating Scale (HAM-A) and Clinical Global Impression of Severity of anxiety (CGIS) that are widely used in studies of mood and anxiety disorders. Flags were applied to 40,349 HAM-A administrations from 15 clinical trials and to Monte Carlo-simulated data as a proxy for applying flags under conditions of inconsistency. RESULTS: Thirty-three flags were derived these included logical consistency checks and statistical outlier-response pattern checks. Twenty-percent of the HAM-A administrations had at least one logical scoring inconsistency flag, 4 % had two or more. Twenty-six percent of the administrations had at least one statistical outlier flag and 11 % had two or more. Overall, 35 % of administrations had at least one flag of any type, 19 % had one and 16 % had 2 or more. Most of administrations in the Monte Carlo- simulated data raised multiple flags. LIMITATIONS: Flagged ratings may represent less-common presentations of administrations done correctly. Conclusions-Application of flags to clinical ratings may aid in detecting imprecise measurement. Flags can be used for monitoring of raters during an ongoing trial and as part of post-trial evaluation. Appling flags may improve reliability and validity of trial data.
- MeSH
- lidé MeSH
- psychiatrické posuzovací škály MeSH
- psychometrie MeSH
- reprodukovatelnost výsledků MeSH
- úzkost * MeSH
- úzkostné poruchy * diagnóza farmakoterapie MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
BACKGROUND: Symptom manifestations in mood disorders can be subtle. Cumulatively, small imprecisions in measurement can limit our ability to measure treatment response accurately. Logical and statistical consistency checks between item responses (i.e., cross-sectionally) and across administrations (i.e., longitudinally) can contribute to improving measurement fidelity. METHODS: The International Society for CNS Clinical Trials and Methodology convened an expert Working Group that assembled flags indicating consistency/inconsistency ratings for the Hamilton Rating Scale for Depression (HAM-D17), a widely-used rating scale in studies of depression. Proposed flags were applied to assessments derived from the NEWMEDS data repository of 95,468 HAM-D administrations from 32 registration trials of antidepressant medications and to Monte Carlo-simulated data as a proxy for applying flags under conditions of known inconsistency. RESULTS: Two types of flags were derived: logical consistency checks and statistical outlier-response pattern checks. Almost thirty percent of the HAMD administrations had at least one logical scoring inconsistency flag. Seven percent had flags judged to suggest that a thorough review of rating is warranted. Almost 22% of the administrations had at least one statistical outlier flag and 7.9% had more than one. Most of the administrations in the Monte Carlo- simulated data raised multiple flags. LIMITATIONS: Flagged ratings may represent less-common presentations of administrations done correctly. CONCLUSIONS: Application of flags to clinical ratings may aid in detecting imprecise measurement. Reviewing and addressing these flags may improve reliability and validity of clinical trial data.
BACKGROUND: Mitigating rating inconsistency can improve measurement fidelity and detection of treatment response. METHODS: The International Society for CNS Clinical Trials and Methodology convened an expert Working Group that developed logical consistency (LC) checks for ratings of the Young Mania Rating Scale (YMRS), which is widely used in studies of mood and bipolar disorders. LC and statistical outlier-response pattern checks (SC) were applied to 63,228 YMRS administrations from 14 clinical trials evaluating treatments for bipolar disorder. Checks were also applied to Monte Carlo-simulated data as a proxy for their use under conditions of inconsistency. RESULTS: 42 LC flags were developed, and four SC flags were created from the data set (n = 14). Almost 20 % of the rating administrations had at least one LC flag, 6.7 % had two or more, 1.7 % had three or more; 17.3 % percent of the administrations had at least one SC flag and 4.6 % percent had two or more. Overall, 31 % of administrations had at least one flag of any type, 12.1 % had two or more and 5.3 % had three or more. In acute antimanic treatment trials (n = 10) there were more flags of any type compared to relapse prevention trials (n = 4). LIMITATIONS: Flagged ratings may represent less-common presentations assessed correctly. CONCLUSIONS: Using established methods, we illustrate development and application of consistency flags for YMRS ratings. Applying flags and mitigation during trials may improve the value of YMRS data, help focus attention on rater training, and improve reliability and validity of trial data.
International Society for CNS Clinical Trials and Methodology convened an expert Working Group that assembled consistency/inconsistency flags for the Personal and Social Performance Scale (PSP). One hundred and forty seven flags were identified, 16 flag errors in deriving the PSP decile (i.e., total) score from the four individual domain scores, 74 flag inconsistencies between domain scores relative to Positive and Negative Symptom Scale (PANSS) item ratings and 57 flag inconsistencies between PSP decile score and PANSS items ratings. The flags were applied to assessments from randomized clinical trial data of antipsychotics in schizophrenia from almost 18,000 ratings. Twenty-two flags were raised in at least 5 of 1000 ratings. Nearly 20% of the PSP ratings had at least one inconsistency flag raised. Application of flags to clinical ratings may improve the reliability of ratings and validity of trials.
Ivabradine is generally considered to be a safe drug with well-established and substantial benefits. Nevertheless, recently published results from the SIGNIFY trial suggest that ivabradine has rather inconsistent effects on cardiovascular outcomes. In addition, careful examination of all available data from ivabradine trials reveals signals of harm that have not yet been appropriately addressed, including a markedly increased incidence of atrial fibrillation and increased risk of cardiovascular events in patients with heart rates below 70 bpm. These concerns warrant consideration, since they could have implications for the future use of ivabradine.
- MeSH
- benzazepiny terapeutické užití MeSH
- lidé MeSH
- nemoci koronárních tepen farmakoterapie MeSH
- srdeční frekvence účinky léků MeSH
- Check Tag
- lidé MeSH
- mužské pohlaví MeSH
- ženské pohlaví MeSH
- Publikační typ
- časopisecké články MeSH
- komentáře MeSH
In the cultures of the alga Chlamydomonas reinhardtii, division rhythms of any length from 12 to 75 h were found at a range of different growth rates that were set by the intensity of light as the sole source of energy. The responses to light intensity differed in terms of altered duration of the phase from the beginning of the cell cycle to the commitment to divide, and of the phase after commitment to cell division. The duration of the pre-commitment phase was determined by the time required to attain critical cell size and sufficient energy reserves (starch), and thus was inversely proportional to growth rate. If growth was stopped by interposing a period of darkness, the pre-commitment phase was prolonged corresponding to the duration of the dark interval. The duration of the post-commitment phase, during which the processes leading to cell division occurred, was constant and independent of growth rate (light intensity) in the cells of the same division number, or prolonged with increasing division number. It appeared that different regulatory mechanisms operated through these two phases, both of which were inconsistent with gating of cell division at any constant time interval. No evidence was found to support any hypothetical timer, suggested to be triggered at the time of daughter cell release.
- MeSH
- buněčný cyklus účinky záření MeSH
- časové faktory MeSH
- Chlamydomonas reinhardtii cytologie růst a vývoj účinky záření MeSH
- cirkadiánní proteiny Period metabolismus MeSH
- cirkadiánní rytmus genetika účinky záření MeSH
- kultivované buňky MeSH
- mutace genetika MeSH
- světlo MeSH
- tma MeSH
- Publikační typ
- časopisecké články MeSH
- práce podpořená grantem MeSH
Scaling laws relating body mass to species characteristics are among the most universal quantitative patterns in biology. Within major taxonomic groups, the 4 key ecological variables of metabolism, abundance, growth, and mortality are often well described by power laws with exponents near 3/4 or related to that value, a commonality often attributed to biophysical constraints on metabolism. However, metabolic scaling theories remain widely debated, and the links among the 4 variables have never been formally tested across the full domain of eukaryote life, to which prevailing theory applies. Here we present datasets of unprecedented scope to examine these 4 scaling laws across all eukaryotes and link them to test whether their combinations support theoretical expectations. We find that metabolism and abundance scale with body size in a remarkably reciprocal fashion, with exponents near ±3/4 within groups, as expected from metabolic theory, but with exponents near ±1 across all groups. This reciprocal scaling supports "energetic equivalence" across eukaryotes, which hypothesizes that the partitioning of energy in space across species does not vary significantly with body size. In contrast, growth and mortality rates scale similarly both within and across groups, with exponents of ±1/4. These findings are inconsistent with a metabolic basis for growth and mortality scaling across eukaryotes. We propose that rather than limiting growth, metabolism adjusts to the needs of growth within major groups, and that growth dynamics may offer a viable theoretical basis to biological scaling.
- MeSH
- biologické modely * MeSH
- energetický metabolismus fyziologie MeSH
- Eukaryota fyziologie MeSH
- hustota populace MeSH
- mortalita MeSH
- růst a vývoj fyziologie MeSH
- velikost těla fyziologie MeSH
- zvířata MeSH
- Check Tag
- zvířata MeSH
- Publikační typ
- časopisecké články MeSH
- práce podpořená grantem MeSH
- Research Support, U.S. Gov't, Non-P.H.S. MeSH
Nízký příjem vlákniny ve stravě západních civilizací je svázán se vznikem civilizačních nemocí, kromě jiného se vznikem ischemické choroby srdeční a kolorektálního karcinomu. Doporučená denní dávka vlákniny 25–30?g je naplňována sotva z poloviny, podle studie amerických vědců 15?g, dle recentního českého průzkumu 12?g denně. V epidemiologických studiích je obtížné rozlišit vliv nedostatku vlákniny, nedostatku vitaminů a antioxidantů, vysoké energetické denzity a vysokého příjmu saturovaných tuků. V intervenčních studiích jsou výsledky rozporuplné, přesto zvýšení příjmu vlákniny snižuje incidenci akutních koronárních příhod a mortality na ischemickou chorobu a v určitých věkových skupinách i celkové mortality. Stejně tak zvýšený příjem vlákniny, nejvíce v zelenině, snižuje incidenci vzniku adenomů a kolorektálního karcinomu.
In western countries low intake of fiber is connected with high incidence of coronary heart disease and colon cancer. Recommended daily allowance of fiber is about 25–30 grams, in American studies is daily intake of fiber about 15?g and recent Czech study showed only 12 grams daily. There is very difficult to distinguish the influence of lack of fiber, lack of vitamins and antioxidants, high energy intake and high intake of saturated fats. The results of intervention studies are inconsistent, but the increase of daily fiber intake leads to reduction of coronary heart attacks and coronary heart disease mortality, as well as of reduction of general mortality. The high intake of fiber, mostly in vegetables, reduces incidence of colon adenoma and cancer.
- MeSH
- antioxidancia fyziologie terapeutické užití MeSH
- cholesterol fyziologie imunologie metabolismus MeSH
- infarkt myokardu dietoterapie metabolismus prevence a kontrola MeSH
- ischemická choroba srdeční dietoterapie metabolismus prevence a kontrola MeSH
- lidé MeSH
- metabolismus sacharidů genetika účinky léků MeSH
- mortalita trendy MeSH
- potravní vláknina metabolismus terapeutické užití MeSH
- střevní nádory dietoterapie metabolismus prevence a kontrola MeSH
- tlusté střevo metabolismus patofyziologie patologie MeSH
- vitaminy metabolismus terapeutické užití MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- přehledy MeSH
