drkitten said:
An easier solution : Have the Feng Shui expert prepare several rearrangements for each guinea pig, one optimizing for health, one optimizing for wealth, and another optimizing for "luck," et cetera. Give each subject one of the rearrangements, without telling them what it optimizes for. After three months, subjects are asked to evaluate their lives on various categories such as "health," "wealth," "luck."
My main concern is that trying to measure things like luck and health objectively is impossible as far as I can tell. Especially luck: will test subjects attribute every life improvement to paranormal "luck" or to skill, determination, or other prosaic factors? It's up to them individually--subjectively--to decide what is meant by luck and how it applies to their lives, and that doesn't really sit well with me. I think for that reason, if at all possible, the test should avoid using questionnaires asking about the subjects' feelings of improvements, especially in fuzzy areas like "luck".
Tax returns OTOH would give us hard numbers that would allow us to calculate out to several decimal places the percent of improvement in the area of wealth for each test subject, and wealth is one area that FS supposedly improves. Obviously not all changes in wealth will be due to FS, but assuming
ceterus paribus between the control group and the real group, a marked improvement in the real test subjects' bottom lines above and beyond any improvement in the control group's wealth would give us a clear enough positive result that additional tests would be warranted, while a result showing no significant difference between the two groups would be a clear negative.
In addition, a negative result would seem to me at least to be "stronger" if one group had received FS consulting and one group did not than if one group received FS "optimized" for one thing and the other group received FS "optimized" for something else. In that scenario the FS expert could of course argue after the fact that merely "optimizing" for wealth doesn't necessarily preclude FS-related improvements in health or other areas, and would interpret a slight average improvement in all areas for all groups as a
positive, or at least inconclusive, result, whereas a result of slight average improvement for all groups in my system could only be interpreted as a negative result.
Also giving each subject multiple arrangements from which to choose is probably a big departure from the usual method--perhaps a big enough departure to let adherants claim that what was tested wasn't "true" Feng Shui (in the likely event of a negative result). What actually gets tested should resemble the actual FS methods used by this practitioner under normal circumstances as much as possible IMO.
And of course giving each guinea pig three different arrangements instead of just one would greatly increase the cost to whoever foots the bill for all of this. FS practitioners sometimes recommend things like aquariums and such that aren't exactly cheap, and steps should be taken to keep costs under control, at least for this preliminary test.