Statistical Calculator

for Ranked Data Psi Tests

Statistical Calculator
for Ranked Data Psi Tests

by Psychic Science

Procedure and Data

Ranking

 Hit = Low Rank

 Hit = High Rank

Number of items
in each Judging Set


  2
  3
  4
  5
  6
  8
  10
  12

Total Trials





Sum of Ranks







Statistical Analysis

  Two-Tailed
  One-Tailed
MCE* Sum of Ranks:
Critical ratio (z):
Probability:
Significance Level:
Evidence for Psi-Hitting:
Evidence for Psi-Missing:



*MCE = Mean Chance Expectation (sum of ranks by chance)

About this Calculator


Ranked Data


This calculator can be used to analyse data from parapsychological experiments in which data represent rank order judgments of the match between a target and a response.


This procedure is widely used in free response ESP experiments in which recorded "impressions" about a possible target are later ranked on the basis of their similarity to a judging set of several possible targets (the actual target plus one or more decoys).


The ranking may be done either by the person whose impressions are being examined, or by one or more independent judges. Of course it is vital that when the ranking is done, the actual target is not known by the person making the judgments. If using more than one judge, the rankings from the different judges should be averaged. The average ranks may then be used to determine the majority rank position. The following examples illustrate the procedure.



Trial Set Ranks (One Judge) Ranks (Several Judges)
(Target = Green) J1 J1 J2 J3 Mean Rank of Mean
1 A 3 3 1 2 2.00 2
B 2 1 2 1 1.33 1
C 1 2 3 4 3.00 3
D 4 4 4 3 3.67 4
2 E 4 4 3 3 3.33 3
F 3 3 4 4 3.67 4
G 1 2 1 1 1.33 1
H 2 1 2 2 1.67 2
3 I 2 1 1 1 1.00 1
J 3 3 4 4 3.67 4
K 1 2 2 3 2.33 3
L 4 4 3 2 3.00 2
Sum of Target Ranks 5 3

Using Ranked Data Statistical Calculator



Ranking Procedure


First, select the procedure used to rank the data. If a rank of 1 was used to indicate the preferred target, choose "Hit = low rank". If the preferred target was given the top rank (e.g., 4 in the above example), choose "Hit = high rank".



Number of Targets in Judging Set


Next, select the number of targets used in the judging set (this must be the same for all trials). In the above example, this = 4.



Trials and Sum of Ranks


Next enter the total number of trials and the Sum of Ranks (across all trials) given to the actual target. Then click "Calculate".


In the above example, trials = 3, Sum of Ranks = 5 (for one judge), Sum of Ranks = 3 (for several judges).


If there are sufficient data (at least 10 trials), statistical analysis will be performed.

About the Statistical Analysis


The statistical procedure used is the z-test performed on the Sum of Ranks (sometimes called the "Sum of Ranks Test"). This compares the obtained Sum of Ranks with the Sum of Ranks expected by chance. The latter is known as the Mean Chance Expectation (MCE) and is equal to (number of trials) x (average of the ranks in the judging set). For example, if there are 4 targets in the judging set, the average rank = (1+2+3+4)/4 = 2.5. If 50 trials are completed, MCE = 50 x 2.5 = 125.


The z test calculates the probability (p) of obtaining results which differ from the MCE to the extent observed. If this probability is low (generally 0.05 or less), the results are said to be statistically significant and are therefore possible evidence of psi, or paranormal ability. Depending on the direction of the results, the analysis reports the results for either psi-hitting or psi-missing, as appropriate.


If there is a strong prior expectation of either psi-hitting or psi-missing, the statistical analysis may be carried out on the basis of a one-tailed test. A one-tailed test does not examine the possibility that the non-expected outcome may result. Although the probabilities obtained will be halved, a one-tailed test is not generally recommended and, in most cases, statistical analysis should be two-tailed (which tests for both psi-hitting and psi-missing).


Psychic Science
Exclusive Card Decks