## Ranked Data

This calculator can be used to analyse data from parapsychological experiments in which data represent rank order judgments of the match between a target and a response.

This procedure is widely used in free response ESP experiments in which recorded "impressions" about a possible target are later ranked on the basis of their similarity to a judging set of several possible targets (the actual target plus one or more decoys).

The ranking may be done either by the person whose impressions are being examined, or by one or more independent judges. Of course it is vital that when the ranking is done, the actual target is not known by the person making the judgments. If using more than one judge, the rankings from the different judges should be averaged. The average ranks may then be used to determine the majority rank position. The following examples illustrate the procedure.

TrialSetRanks (One Judge)Ranks (Several Judges)(Target = Green) J1J1J2J3MeanRank of Mean1 A 3 3 1 2 2.00 2 B 2 1 2 1 1.33 1 C 1 2 3 4 3.00 3 D 4 4 4 3 3.67 4 2 E 4 4 3 3 3.33 3 F 3 3 4 4 3.67 4 G 1 2 1 1 1.33 1 H 2 1 2 2 1.67 2 3 I 2 1 1 1 1.00 1 J 3 3 4 4 3.67 4 K 1 2 2 3 2.33 3 L 4 4 3 2 3.00 2 Sum of Target Ranks5 3

## Ranking Procedure

First, select the procedure used to rank the data. If a rank of 1 was used to indicate the preferred target, choose "Hit = low rank". If the preferred target was given the top rank (e.g., 4 in the above example), choose "Hit = high rank".

## Number of Targets in Judging Set

Next, select the number of targets used in the judging set (this must be the same for all trials). In the above example, this = 4.

## Trials and Sum of Ranks

Next enter the total number of

trialsand theSum of Ranks(across all trials) given to theactual target. Then click "Calculate".

In the above example, trials = 3, Sum of Ranks = 5 (for one judge), Sum of Ranks = 3 (for several judges).

If there are sufficient data (at least 10 trials), statistical analysis will be performed.

for Ranked Data Psi Tests

Hit = Low Rank

Hit = High Rank

in each Judging Set

2

3

4

5

6

8

10

12

Two-Tailed

One-Tailed

MCE* Sum of Ranks: | |

Critical ratio (z): | |

Probability: | |

Significance Level: | |

Evidence for Psi-Hitting: | |

Evidence for Psi-Missing: |

*MCE = Mean Chance Expectation (sum of ranks by chance)

The statistical procedure used is the

z-testperformed on the Sum of Ranks (sometimes called the "Sum of Ranks Test"). This compares the obtained Sum of Ranks with the Sum of Ranks expected by chance. The latter is known as theMean Chance Expectation(MCE) and is equal to (number of trials) x (average of the ranks in the judging set). For example, if there are 4 targets in the judging set, the average rank = (1+2+3+4)/4 = 2.5. If 50 trials are completed, MCE = 50 x 2.5 = 125.

The z test calculates the probability (

p) of obtaining results which differ from the MCE to the extent observed. If this probability is low (generally 0.05 or less), the results are said to bestatistically significantand are therefore possible evidence of psi, or paranormal ability. Depending on the direction of the results, the analysis reports the results for either psi-hitting or psi-missing, as appropriate.

If there is a strong prior expectation of either psi-hitting or psi-missing, the statistical analysis may be carried out on the basis of a

one-tailedtest. A one-tailed test does not examine the possibility that the non-expected outcome may result. Although the probabilities obtained will be halved, a one-tailed test is not generally recommended and, in most cases, statistical analysis should betwo-tailed(which tests for both psi-hitting and psi-missing).