question 4

question 4

by Laura Koth -
Number of replies: 3

the question states

The Brier Scores for these two indexes were 0.199 and 0.017.  Which one was the Brier Score for the RQI?  Explain your choice


what do you mean by "two indexes"? can you help me by defining this? are you referring to the unlabeled plots as 2 indexes? or something else?

I don't recall hearing about a Brier score until the last day of class review. can you provide some insight about this score because I did not follow your discussion in class at all.

In reply to Laura Koth

Re: question 4

by Michael Kohn -

The two indexes are the Risk Quantification Index (RQI) and Risk Stratification Index (RSI) mentioned in the first sentence of the problem.

This problem including the question about Brier Scores was modified from one submitted by students.  

The relevant section in the book is on Mean Bias, Mean Absolute Error, and  Brier Score, Chapter 6 pages 6-7.


In reply to Michael Kohn

Re: question 4

by Laura Koth -

are these scores a mean of all the values in the calibration plot or is the score a squared mean of just a randomly chosen data point?



In reply to Laura Koth

Re: question 4

by Thomas Newman -

Hi, Laura --

If you are referring to question 4e, which refers to Brier scores, they are calculated for the entire cohort, not a randomly chosen data point.

Tom