• Quick note - the problem with Youtube videos not embedding on the forum appears to have been fixed, thanks to ZiprHead. If you do still see problems let me know.

Remote healing

Gr8wight said:
You are so far out in left field, you can no longer see the batter.

example: (using a ridiculously small sample size) Bob receives prayer during your study from a group of 12 people. Tom does not receive any prayer from your study. Do either Bob or Tom receive any prayer from outside your test group? You have absolutely no idea, and no way of finding out without unblinding the experiment by asking them explicitly. Maybe Bob receives no additional prayer, but maybe Tom receives prayer from the entire congregation of his church, 150-200 people. How is Tom's group 'controlled?' It is entirely possible that, acounting for all prayer sources, every member of your test group and of your control group receive exactly the same amount of prayer. But you don't know, because you have absolutely no way of knowing. How can you draw any results from your data if you do not know, can not know, the comparison between how much prayer your test group received compared to how much prayer your control group received?

Even if you attempted to control the study by requesting the friends and family of the control group not to pray for thier loved ones, how successful do you think that would be? How many friends and loved ones, who desired to pray, could be convinced not to. You cannot draw meaningful conclusions from a study when you do not know the values of all the variables. Indeed, when you do not even know what all the variables might be.

Your example is specious in the same way as CFLarsen's.

I control for this with the universally accepted method for designing a controlled experiment: randomization.

If you do not understand the workings of this, I suggest you look at the links I posted earlier, or any elementary statistics or experimental design book.

If you can show that this (majority established) method is flawed, I would of course be delighted to hear your logic.

What you would need to prove, is that an outside factor - any outside variable whatsoever - would be able to cause a difference between control and test groups, when items (trials, people, whatever) have been added to the two groups entirely at random.

If you can do that, you will have invalidated the logic behind every single trial investigating the effects of new medicines in the last couple centuries.

I consider myself to be in the majority scientific concensus on this point, so the burden of proof is on you.

You are of course also welcome to point out how I am improperly applying said methodology in a way that admits a confound.

[Edit:] ... or to claim that randomization is *not* a methodology that is considered sound by a majority of scientists. In which case, I refer you to scholar.google.com - just find a study that investigates the effect of a new drug, which does not use it.
 
Oh, also, since it is a point that amuses me:

You cannot draw meaningful conclusions from a study when you do not know the values of all the variables. Indeed, when you do not even know what all the variables might be.

Then I would ask you to please explain how it is that any study you consider to be methodologically sound controls for the effect of the invisible pink unicorn, Harry, who has an odd sense of humor and a bit of omnipotence, and likes to mess with scientists' heads by randomly modifying their measures. Sometimes, for spite, he actually modifies their measures precisely enough that they show the opposite of what would otherwise be intended.

Harry is perfectly identical in logical argument to your claim that third-party prayer invalidates my methodology. He is silly to prove the point.


I believe my physics teacher described this as the "martian argument".

Namely, I have this theory called "gravity" that says that when I hold a heavy object in my hand above the earth, and let go of it, that it will immediately fall down.

This theory fails to take into account the possibility that a Martian will, at that very moment, zip down and pull the object upwards instead.

This fact does not preclude our trust in gravity.
 
Re: Version two

saizai said:
The question of what disease to target is still an open one.
I suggest insanity. Can we make sure you get in the treatment group? Then at least we would have a prayer of a chance. :D
 
Re: Re: Version two

SezMe said:
I suggest insanity. Can we make sure you get in the treatment group? Then at least we would have a prayer of a chance. :D

Amusing, though rude.

I'm starting to belive ye commenters here are more interested in being critical regardless of logical support than actually aiming for a good methodology.
 
Re: Re: Re: Version two

saizai said:
Amusing, though rude.

I'm starting to belive ye commenters here are more interested in being critical regardless of logical support than actually aiming for a good methodology.

I'm starting to believe you are more interested in being right than actually aiming for a good methodology.

Why not just show us your calculations?
 
I've been reading this thread, and I'm puzzled at the point being argued. It seems to me Sai's randomization *does* control for others praying. The test is so narrow as to be almost worthless (see, I'm not really on his side :) ), but it's a valid test for what it does.

It's testing to see if a little extra prayer makes any difference. Not if prayer makes a difference, period.

One could compare it to testing for anything that can't be reduced to zero. Let's say, noise. Or exercise. Or sunlight.

Everyone is exposed to a certain amount of sound or sunlight or experiences a certain amount of movement each day. You can't reduce it to zero, by telling the control group not to move or never to go outside or to wear earplugs for a month, but by picking two random groups that are large enough, it's reasonable to assume that the "background exposure" is going to average out the same for both.

So then you add the variable. In addition to their normal activities, one group has to be exposed to 20 minutes of loud noise every other day, or has to walk on a treadmill for half an hour three times a week, or has to be in the sun for an hour each day, or whatever. You'd need to make sure the variable didn't make them change their normal activities to compensate--almost impossible in my hypothetical examples--but with double-blind prayer, that wouldn't be a problem.

So now you've got a control group getting X amount of whatever you're testing for, due to normal "background exposure," and another group getting X+1. It seems a valid way to test whether getting X amount of prayer +1 makes people heal better than just getting X amount of prayer.

Which is a test so narrow that it hardly seems useful. The example of the Pope (or any famous person) who gets more prayers than an unknown sufferer, indicates that extra prayers apparently don't help, since famous people appear to suffer the same ills as non-famous people. And as someone else said, if X is large and 1 is small, it would be like trying to hear a whisper in a football stadium.

But I honestly don't see the objection to using randomization to equalize the amount of "background prayer" in both groups. Maybe I'm missing something. :confused:
 
Thank you. Finally, someone who understand such a basic concept.

Re. narrowness: are you talking about the amount of prayer involved, or the fact that it can't capture non-directed effects?

In either case, how would you suggest designing it to be better?

Re. pope: one could certainly make a speculative theological claim that it's something like a time-dropoff log scale - the more the better, but with decreasing efficiency. And people *have* made assertions that prayer worked for the Pope - after all, it kept him alive etc etc in the face of papal medicinal pressures, when if not he might not've etc. Not testable either way, though, which is the point.
 
saizai said:
Re. narrowness: are you talking about the amount of prayer involved, or the fact that it can't capture non-directed effects?


Well, if prayer has an effect, then I think there are so many possibilities that are missed by this test, that the effort may be high for little potential of positive result. I'm really just consolidating ideas that others have already expressed, but some things not being tested are:

--The quality of the pray-er(s). Maybe a prayer by a priest trumps any prayers by laymen. Or prayers by strangers are almost useless compared to prayers by family members.

--The god being prayed to. Maybe Buddhism works but Christianity doesn't.

--The method of prayer. Maybe only laying on of hands, or sacrificing a chicken, or burning incense works.

--Prayer vs. no-prayer. Maybe all it takes is one prayer to work, and added ones don't help.

--The volume of prayers. Maybe critical mass is reached by the average number of prayers already received, and a few more beyond that have no effect.

--The worthiness of the pray-ee. Randomization of the subjects would solve that, but if almost all of the pray-ees are sinners because they haven't sacrificed to Zeus lately, the "whisper in a stadium" problem might mask any positive effect.

--What exactly is being prayed for and what counts as a success? If there are some basic laws of nature that god won't repeal, like curing all illnesses to the point of making someone immortal, a prayer for a quick and painless death may be the only kind that god will answer in cases where healing would be unrealistic.

In either case, how would you suggest designing it to be better?

That's the big question! I guess it would be like a pharmaceutical company testing if a new medicine works. They already have an idea of the specifics of how it would work, so they're not going to test whether a topical medicine works when taken orally, or if an antibiotic will cure impotence, or whatever. They'll test it in a way that they perceive it will have the best chance of success.

If you're convinced that prayer will work in the way you're testing for it, then it's worth the time and effort for you. Others may think it's more likely that prayer works in some other way, if it works at all, so they'd be motivated to design a test that looks for other possibilities.
 
Pup said:
--Prayer vs. no-prayer. Maybe all it takes is one prayer to work, and added ones don't help.
But, Pup, that is precisely the point. We don't know if prayer works and, if it does, how. If prayer is binary, then, using your example, trying to find out if x+1 is more efficacious than x through sai's protocol WILL NOT WORK.

Now, if sai were willing to say, "My protocol is designed to test if prayer works ASSUMING IT IS ADDITIVE then we might have more to talk about. But he doesn't. So the protocol yields no useful data.

See, sai, I can be crude and constructive....makes you read my posts more carefully, eh? :) :)
 
The JREF does not accept religious claims for The Challenge.

Remote healing through intercessionary prayer would seem to be, by definition, a religious claim.

That's how I view it. Does anyone else have an opinion on this?

Sai, if you are serious about The Challenge, would you please submit a properly filled out and notarized application to KRAMER as soon as possible?

If your application is accepted, then the details of your protocol can be negotiated in the usual fashion.

We need to know whether or not KRAMER and James Randi view your idea as Challenge-worthy.

I don't think it meets the criteria that Randi has set out in the rules.

1. Sai is not making a paranormal, supernatural or psychic claim for herself. She wants to run an experiment. She says...
It isn't about any *personal* supernatural powers, but is about them in general, and run *by* me.

2. Her experiment is based on intercessionary prayer. Sai says...
First, I want to be clear on what this study is designed to examine: remote prayer.

Prayer is, by definition, a religious claim, no matter to whom or what or where the prayers are aimed or addressed.


3. Her experiment does not provide verified evidence of a paranormal, supernatural or psychic power viewed under proper conditions. She says that whether or not her pray-ers actually pray for the subjects doesn't really matter.
As I said: the fact that I am checking [that the pray-ers pray] at all is purely superfluous. If you want to, you can elimintae it altogether, and merely go by this: do I ask them to be prayed for, or not?

In summary, what we have here is a person who is not making a paranormal, psychic or supernatural claim for herself, but who wants to run an experiment. The experiment will test remote prayer, which is a religious claim. There will be no verified evidence, produced under proper observation, that remote prayer actually takes place.

In the opening post, Sai asked...

Would this qualify for the challenge?

I don't think so. But I'm not the person who makes the decisions.

Sai, you need to apply to KRAMER in order to get an answer to your question. The sooner the better.


Gayle

From the application page...

IMPORTANT: Only claims that can be verified by evidence under proper observing conditions will be accepted. JREF will NOT accept claims of the existence of deities or demons/angels, the validity of exorcism, religious claims, cloudbusting, causing the Sun to rise or the stars to move, etc.
 
SezMe said:
But, Pup, that is precisely the point. We don't know if prayer works and, if it does, how. If prayer is binary, then, using your example, trying to find out if x+1 is more efficacious than x through sai's protocol WILL NOT WORK.

Now, if sai were willing to say, "My protocol is designed to test if prayer works ASSUMING IT IS ADDITIVE then we might have more to talk about. But he doesn't. So the protocol yields no useful data.

See, sai, I can be crude and constructive....makes you read my posts more carefully, eh? :) :)

I think we're in full agreement here. The test will only show a positive result if prayer acts in a certain, limited way. If Sai is convinced that's the way it acts, then the test is a good one, from Sai's point of view.

However, if the test is designed to convince most people that prayer does (or doesn't) work, it's flawed because "most people" have widely differing views of how prayer works, many of which won't even be touched on in the test.

Gayle brings up an excellent point, though, that may make all this moot, at least as far as it concerns the challenge.
 
Actually, Sai, the pseudocode for your the experimental protocol AS YOU HAVE DESIGNED looks much more like this:

x<-0
y<-0
p<- study subjects population size
q<- study pray-ers population size
r<- total number of active pray-ers in the world

repeat z
x+= rand(p)*q
y+= rand(p)*q
if (some-random-time) then x+= rand(p)*r
if (some-other-random-time) then y+= rand(p)*r
end repeat

output (x - y)

You will notice that the output is likely to be all over the shop with huge numbers, and thus totally meaningless.
 
Excellent work Sai.

I have been following this post very closely, and commend you for your clarity, and also your patience with those (few) openly rude posters.

Though I am no statistics boffin, it seems that your proposal is pretty sound, and these attempts by you to firm up the method can only improve it.

Thank you for your efforts so far.
 
Excellent work Sai.

I have been following this post very closely, and commend you for your clarity, and also your patience with those (few) openly rude posters.

Though I am no statistics boffin, it seems that your proposal is pretty sound, and these attempts by you to firm up the method can only improve it.

Thank you for your efforts so far.
 
Flange Desire said:
Excellent work Sai.

I have been following this post very closely, and commend you for your clarity, and also your patience with those (few) openly rude posters.

Though I am no statistics boffin, it seems that your proposal is pretty sound, and these attempts by you to firm up the method can only improve it.

Thank you for your efforts so far.
If you are no statistics boffin, how do you know the proposal is sound?
 
Flange Desire said:
I have been following this post very closely, and commend you for your clarity, and also your patience with those (few) openly rude posters.
Aw shucks. No similar kudos for the "openly rude posters" for THEIR clarity AND patience with a mule-headed poster. :(

Too make matters worse, no mention of our good looks, impeccable dress, and manners when it comes to umbrella etiquitte.

Crushed, I tell you, crushed.
 
Gayle said:
The JREF does not accept religious claims for The Challenge.

Remote healing through intercessionary prayer would seem to be, by definition, a religious claim.

That's how I view it. Does anyone else have an opinion on this?

*raises hand*

I've repeatedly said: I make no claims whatsoever as to mechanism. YOU are assuming that it is religious or spiritual in nature; I make no such statement. My study design makes no religious assumptions that are required for interpretation of its results. This being the reason "religious claims" are prohibited - e.g. exorcism, as stated earlier, because it claims to change something that, itself, JREF would not accept. So I see no cogent reason to deny it on this ground.

Sai, if you are serious about The Challenge, would you please submit a properly filled out and notarized application to KRAMER as soon as possible?

If your application is accepted, then the details of your protocol can be negotiated in the usual fashion.

I am in no rush. I have school to do, and many other commitments; this is purely a side interest. Additionally, it would take more time to, e.g., start sending out and compiling willing volunteers, etc. I will send in application when I am prepared to begin within a short period of time; I am not, presently.

Additionally, I'd like my university IRB to sign off on this, for additional credibility. It may surprise you, but I am not doing this for JREF's sake, but purely for my own. JREF is purely a bonus, and a check on my methodological soundness; I would be doing this regardless.

And I expect the challenge will be waiting for me whenever I decide to divert my energy into beginning this in full. ;-)

That is not to say that I will not try some initial queries to Kramer / Randi to see that they are willing to entertain the idea in general; I have already done so.

1. Sai is not making a paranormal, supernatural or psychic claim for herself. She wants to run an experiment. She says...

I am not female.

I am curious, though; what gave you the impression I was?

Prayer is, by definition, a religious claim, no matter to whom or what or where the prayers are aimed or addressed.

Not at all. Note that I am using the word "prayer" purely for the sake of convenience. I imagine that some religions - like, say, atheists - would have different ideas of what they are doing when they follow the directions. I only ask that they do whatever they wish, so long as it conforms to the basic request: wishing the person well, and (depending) specifically wishing particulars about their health and disease course etc.

3. Her experiment does not provide verified evidence of a paranormal, supernatural or psychic power viewed under proper conditions. She says that whether or not her pray-ers actually pray for the subjects doesn't really matter.

Sorry?

I consider this to be "proper conditions". Just because I do not claim *what* the mechanism is, I would hope that you will agree that no matter what it is, if it exists at all under my design, it must necessarily be "paranormal"?

As I've said, it is unnecessary for a purely mundane-world skeptic to examine anything beyond the double-blind. So long as it exists, there is no mundane mechanism for any effect to occur.

QED.

Please explain how this design, if it produced an effect (as I've repeatedly defined), would not qualify as a fully controlled and verifiable (assuming you trust hospital records etc) demonstration of a paranormal event? To a 95% certainty even. ;-)
 
Pup said:
Well, if prayer has an effect, then I think there are so many possibilities that are missed by this test, that the effort may be high for little potential of positive result. I'm really just consolidating ideas that others have already expressed, but some things not being tested are:

As I've said, I am willing to accept that my study does not - nor can any study do so at all - encompass every possible theological framework for how prayer (or prayer-like activity) might exist.

--The quality of the pray-er(s). Maybe a prayer by a priest trumps any prayers by laymen. Or prayers by strangers are almost useless compared to prayers by family members.

Possibly. The first part would screen for this - if it finds that there is any difference by skill level, then I would make that requirement for admission into the second part.

(And yes, I realize that any results generated in the first part would be not perfectly sound [by selection bias]; it's sufficient to make such a judgement, though.)

--The god being prayed to. Maybe Buddhism works but Christianity doesn't.

Ditto. I hope to have a number of different religions participating; if I find that some work better than others, then those are the ones I'd pick to continue.

--The method of prayer. Maybe only laying on of hands, or sacrificing a chicken, or burning incense works.

That is encompassed in the previous. Of course, I cannot claim to encompass every religion. After all, perhaps only Bob Edward McFizzle, age 4, in Siberia has the "true religion", and is capable of having effect. I have no way of telling this.

But I'm willing to settle for representation from the majors and any minors that strike my fancy.

Laying on of hands, however, is excluded; I hope you can see why it would be methodologically much more difficult to control as a double-blind.

--Prayer vs. no-prayer. Maybe all it takes is one prayer to work, and added ones don't help.

Then no prayer in the word for anyone's health should work at all, as of a couple days ago, forever. Viz. my previous post in which I claimed a prayer for the health and well-being for every human in existence from then onwards.

I think this is a somewhat amusing, but not terribly useful, objection.

I also think it is completely impossible to test for as a theological argument, and akin to other apologism that asserts untestability - ignorable as a matter of faith alone. You are welcome to believe whatever you like on it.

Do you have any suggestion to how this is untrue? E.g., do you have any way to test for it?

--The volume of prayers. Maybe critical mass is reached by the average number of prayers already received, and a few more beyond that have no effect.

Also possible. Not possible to detect without a very large study in which you can give a graded amount, if you want to be encompassing in your tested-for spectrum.

As I noted in the study spec, this would be an interesting thing to do as a followup, should there be proof of this part.

If critical mass is already achieved as a *baseline*, then this is equivalent to the previous point.

--The worthiness of the pray-ee. Randomization of the subjects would solve that, but if almost all of the pray-ees are sinners because they haven't sacrificed to Zeus lately, the "whisper in a stadium" problem might mask any positive effect.

Possible. This, however, *would* be encompassed - "worthiness" (assuming it occurs in sufficient quantity to generate a large enough sub-population of worthy candidates) would be merely another uncontrolled variable.

If there aren't enough, oh well. :-P

--What exactly is being prayed for and what counts as a success? If there are some basic laws of nature that god won't repeal, like curing all illnesses to the point of making someone immortal, a prayer for a quick and painless death may be the only kind that god will answer in cases where healing would be unrealistic.

This is determined in part 1 - the measure. I am not making any upfront assumptions; I take a shotgun approach as much as possible practically. Within that, I'll choose what *does* appear to improve, and use that as the measure for part 2.

It is possible that I don't collect enough data - e.g. that something improves I'm not testing for. That's an acceptable risk.

If you're convinced that prayer will work in the way you're testing for it, then it's worth the time and effort for you. Others may think it's more likely that prayer works in some other way, if it works at all, so they'd be motivated to design a test that looks for other possibilities.

I am not "convinced". As I have said - I am agnostic on this issue, and doing this out of curiousity.

As I said - if you can suggest a way to design the study to encompass other views of prayer, please do so.

So far you have only mentioned things that are encompassed, or untestable - either in principle or because I cannot practically do a study of infinite scope.
 
saizai said:
I take a shotgun approach as much as possible practically. Within that, I'll choose what *does* appear to improve, and use that as the measure for part 2.
And herein your protocol loses all semblance of claim to being rational.

To summarise:

1. You are allowing all sorts of uncontolled variables to influence the experiment;

2. You will accept any data at all as being significant, regardless of whether it is a product of your protocol;

3. You intend to data-mine the situation at your own discretion.

Sorry, but I wish you good luck getting more than amused chuckle responses from anyone working in REAL science. You might try PEAR though - this sort of approach is right up their street.
 
Zep said:
1. You are allowing all sorts of uncontolled variables to influence the experiment;

You have yet to prove this.

To do so, you would need to explain how the method of randomization is incapable of controlling for uncontrolled variables.

Go on, I dare you.

2. You will accept any data at all as being significant, regardless of whether it is a product of your protocol;

3. You intend to data-mine the situation at your own discretion.

Sorry? I don't think you've read the protocol that I wrote. Perhaps you have written your own, straw-man version, and that is what you are debating against?

If you do, you will discover that these do not influence the final results, and that the steps I take at the end of part one specifically control for the possible biases you mention.
 

Back
Top Bottom