tag:blogger.com,1999:blog-3829599.post4363567207130579289..comments2024-01-28T00:20:40.933-08:00Comments on Agoraphilia: Musing about CorrelationsUnknownnoreply@blogger.comBlogger9125tag:blogger.com,1999:blog-3829599.post-87620711018269351462008-05-12T20:20:00.000-07:002008-05-12T20:20:00.000-07:00What does the numerical correlation signify? Do w...What does the numerical correlation signify? Do we know what the "expected" grade was for each student? Do we know what the "expected" average grade for the class was? And when we know those things, what do they tell us?<BR/><BR/>There are many variable factors, many of them entirely random, that enter into the exam grades. Is there some account taken of these factors, such as weather, individual student sense of well-being, individual student's actual health on exam day, etc, etc.?<BR/><BR/>So, again, I ask: what do those numbers tell you and of what use is that knowledge to you? The confounding and unaccounted-for factors sure to be present make it impossible to claim some useful knowledge from these numbers, without wholesale disregard for all the other factors leading to those results.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3829599.post-65670604999224320612008-05-09T09:40:00.000-07:002008-05-09T09:40:00.000-07:00So this question has been floating in the back of ...So this question has been floating in the back of my mind, and I think I've reached the conclusion that no, there's no right answer. Imagine a class where all the students are exactly identical and interchangeable, but not deterministic. You'd then expect some score variation in both sections, but no correlation, because there's no reason that the students who happen to do better in one section would also happen to do better in the other. Conversely, imagine a class with only five students, one being a straight-A student, one a straight-B student, etc. You'd then expect a perfect correlation between the two sections; but then, in this case you could theoretically give <I>neither</I> section, and simply assign each student the grade you know (s)he'd otherwise get. (Obviously that's not <I>fair</I>, since students don't even get a chance to prove themselves, but you didn't ask about fairness — and I think if we're considering fairness, then we can ignore the question of redundancy, since the fair approach is to give students both kinds of opportunities.)<BR/><BR/>Now, this doesn't rule about the possibility that for any given group of students, an optimal test design would have a certain correlation (i.e. that if there are multiple equally optimal tests, they'd all have the same correlation); but certainly there's no way to fully investigate that for a given group. At least, no way without actually giving them various tests …Ranhttps://www.blogger.com/profile/01369980917358096502noreply@blogger.comtag:blogger.com,1999:blog-3829599.post-58391436275623650682008-04-07T11:01:00.000-07:002008-04-07T11:01:00.000-07:00A high correlation only makes grading, not giving ...A high correlation only makes grading, not giving the second section, redundant.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3829599.post-86390471006646764202008-04-02T18:41:00.000-07:002008-04-02T18:41:00.000-07:00I don't think you can rule out one so easily - the...I don't think you can rule out one so easily - the real point of a test is the studying it induces, and maybe their studying would be different if they knew in advance that it would be only mc.Dr. Zeusshttps://www.blogger.com/profile/17604250204753682276noreply@blogger.comtag:blogger.com,1999:blog-3829599.post-76120377445794677192008-03-28T22:59:00.000-07:002008-03-28T22:59:00.000-07:00I think you're conflating the average correlation ...I think you're conflating the average correlation with the tightness of the correlation. For example: suppose half the class scores 25% less on the multiple choice, and half score 25% more. The correlation (as I understand your use of the term) would be 1, but the results aren't actually that predictive, and there's clearly value in having both parts of the test.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3829599.post-37943472379157204232008-03-28T21:35:00.000-07:002008-03-28T21:35:00.000-07:00Even if the correlation were perfect, I wouldn't s...Even if the correlation were perfect, I wouldn't say that the two-part test is redundant. I tend to view test taking as part of the learning experience. I believe adequate time should be alloted for the exam and that students shouldn't be rushed. I don't agree that a test is just a place for the students to "dump" everything they've memorized, but rather an opportunity to think about what they've learned more or less well and form a gestalt of the subject matter to achieve greater understanding, and one hopes, as well, to come up with the right answer (or close to it) when it's being graded.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3829599.post-8682543938048024702008-03-28T14:59:00.000-07:002008-03-28T14:59:00.000-07:00This comment has been removed by the author.Michael Schwartzhttps://www.blogger.com/profile/07373446001050223428noreply@blogger.comtag:blogger.com,1999:blog-3829599.post-12804943830098552642008-03-28T13:52:00.000-07:002008-03-28T13:52:00.000-07:00At least you do know something: You didn't get any...At least you do know something: You didn't get any negative correlations. The argument that certain "types" of students do better on multiple choice and other "types" do better on short answer must not apply to your students.Jennyhttps://www.blogger.com/profile/11046641822669890457noreply@blogger.comtag:blogger.com,1999:blog-3829599.post-2965739624045231582008-03-28T13:28:00.000-07:002008-03-28T13:28:00.000-07:00sqrt(2)/2I have a truly marvellous proof of this p...sqrt(2)/2<BR/><BR/>I have a truly marvellous proof of this proposition which this margin is too narrow to contain.Gilhttps://www.blogger.com/profile/16905127825110313631noreply@blogger.com