Posted by nyarlathotep
Now that I have read it, I can tell you the major difference between Randi's protocol for Sylvia Brown and the protocol described in the article. The difference is the addition of a control group, in the form of the people for whom the reading was not done.
Nyarlathotep,
Well, we agree that the Sylvia Challenge is too subjective, but I don't see how this group of 9 works, iyo, as a control group.
Maybe I'm wrong, but I can't imagine anyone here thinking this Sylvia test would be a good test if it was proposed by Schwartz rather than Randi. It is riddled with subjectivity and doesn't measure what it is supposed to.
For example...the idea of putting so much emphasis on how 9 people (who know the reading wasn't for them anyway) are going to score it, "as if it is" for them. That's a terrible way to evaluate it it and makes no effort to rule out the chance of collusion.
Second, Randi claims there will be "no need for judging", that the results are "self evident". But this is hardly the case with this 0-10 scale, as it is highly subjective--plus the scorers already know what their rating will mean to the test results if they've read the protocol he's published.
Simply put, if the subject of the reading scores the relevancy at an 8 (for example) , and the control group also averages around an eight, it shows a greater likelyhood that the high score was due to the human tendency to see relvance in things, rather than due to any special ability on the Ms. Brown's part.
Not at all. The scorers can simply throw the test results, one way or the other, due to bias, either intentionally or subconsciously. (And it shows nothing about mediumship).
The addition of the control group makes a world of difference.
Again, the nine -don't- function as a control group.
Beyond that, the biggest flaws are (1) the scoring itself (which statistically makes no sense as representing "50:1 odds") and (2) the intent of the test itself--which obviously isn't testing the claim (mediumship) at all. Its testing Randi's theory that Sylvia is a cold reader. That is completely different.
Robertson and Roy were testing the claim of mediumship, with people selected randomly and who evaluated readings without knowing which reading was for them.
Overall, R&R's is a much better design and avoids some of the really serious design flaws with Randi's Sylvia protocol.