Monday, November 30, 2009

Paranormal investigation and kidneys

I don't know if any of the regular readers noticed or remembered, but over a month ago I wrote something about the Independent Investigations Group (IIG), and the reasons why we need to investigate paranormal claims. And then I removed the post. But now it's up again. There's a funny story behind this.

Back in October, I sat in on an IIG meeting. One of the things they talked a lot about was this woman, Anita Ikonen, who was flying in from North Carolina next month to have her ability tested. Her claim? She can tell whether someone is missing internal organs by just looking at them. So IIG proposed the following test: Given six people with eleven kidneys, determine which person is missing a kidney, and also determine whether it is the left or right kidney. Perform this test three times. If she gets all three correct, she would move on to formal testing for the $50,000 prize. If she gets one or more incorrect, she fails the test.

It may seem like a simple enough test, but there are all sorts of things that could go wrong. For example, if people lost their kidney through disease, this might change their smell or skin color slightly. Therefore IIG only used kidney donors. What if the kidney donors have scars? Let's give all the subjects identical clothing which would hide those scars. At the IIG meeting, they were talking about bunny suits, but it seems in the end they just used t-shirts, jeans, and straw hats. with sheets covering their hair. Also, they all have their back facing Anita, to reduce the possibility for cold reading.

Furthermore, the audience should not know beforehand who is missing their kidney. We didn't want Anita cold reading the audience. Nor should the experimenter know. And ideally, nor should the test subjects themselves. The test subjects would be told: "Each of the other five people are missing a different internal organ. Anita will be looking for one particular missing organ. You are the control group, without any missing organs." Or that was the plan, anyways. I'm not sure whether they were able to pull it off, or if information leaked to the test subjects.

At the IIG meeting, I pointed out that the test subjects could determine that she was looking for kidneys if they just looked at the IIG website. It was in the public meeting summary from the previous month. They agreed that they should probably remove that information. Actually, I don't think they ever did remove the information. Oh well.

Anyways, I remembered that I had mentioned the kidneys on my own blog. So I decided to take it down. My blog is probably too obscure to really leak the information, but I figured that there was no harm in taking it down to be safe.

The post has been put up again because Anita Ikonen has already been tested on November 21.* The results? You can see a video of the entire test on UStream. She got one trial correct out of three. Therefore she failed. End of story.

Or not. As Jim Underdown said, "If there’s one thing more frustrating than trying to get paranormal claimants to prove their abilities, it’s getting them to admit they failed after flunking a legitimate test." Though Anita Ikonen admitted that she failed the test, she felt still felt as if she probably had something special. After all, she did get that one trial correct, and supposedly that was the one trial she felt sure about. She also got the correct person and wrong kidney in another trial. So as she put it, it's like she got half right.

I think it's very human to cling onto closely held beliefs as Anita is doing. I don't blame her for it. But she's still wrong.

Getting "half correct" does not mean there is a 50% chance that she still has some ability. By pure guessing, getting half correct is exponentially more likely than getting all correct. By pure guessing, there's a 23% chance of getting at least one trial correct. There's a 1/1728 chance of getting all three correct, which sounds small, but IMO is not nearly small enough. It's an acceptable false alarm rate only because this is the preliminary test.

And furthermore, she did not get half correct. She got one third correct. If her claims really were true, we would expect her to get the right person and right kidney. If anything, the fact that she got the right person but wrong kidney suggests cold reading. Cold reading is much more effective at determining the correct person than it is at determining the correct kidney. For example, you might be able to guess the right person by their fidgeting (one audience member claimed to have guessed two correctly based on fidgeting), but fidgeting probably tells you very little about which kidney is missing.

And there is another caveat. Most kidney donors donate their left kidney. Anita guessed the left kidney every time.

Note that cold reading is possible even if the reader is unaware of it. For example, when she guessed the left kidney every time, was this because she was intentionally playing the numbers, or because experience had taught her intuition to expect missing left kidneys?

So looking at the results, I think it's quite likely that she got one just by chance. It's also possible that she was doing cold reading. Either way, she failed to pass the test. End of story.

*See the IIG website for more information on the Anita Ikonen test. Regrettably, I was not available to see the test myself, though I did skim the UStream video. I was otherwise occupied.

Friday, November 27, 2009

I go to a conference

The other day, I attended an undergraduate research conference. Fun! I made a presentation on my summer research on classification of gravitational wave candidates. I try to make at least the first few slides very easy to understand, and here's a little peek.

This is a basic picture of what my research was about. You have a bunch of events, some of which may be spiraling binary black holes or neutron stars, and some of which may be noise caused by something entirely different. Each event has multiple associated parameters (such as "x" and "y" shown in the diagram, but there could be many more). So to classify them, we need to choose some dividing line. In two dimensions, finding a dividing line is easy. In twelve dimensions, not so much.

Anyways, that's just the introduction to my presentation, and there's obviously a lot more to it than that.

Funny thing about research, often the topics can get mind-numbingly specific. When people ask me what I did research on, I tell them, "gravitational waves", but of course that couldn't really have been my research topic. There's far too broad a subject for just one research project. If I want to elaborate further on my research, I explain that I worked on data analysis for LIGO. Still too broad. I could explain that I worked on the classification of candidate gravitational wave events for inspiraling compact binary systems. Still too broad, but now also incomprehensible to a general audience.

It makes me think of how pseudosciences often try to imitate science's use of complicated technical words. In my experience, the abstruseness of science and scientific language isn't placed there to provide an air of authority, it's there out of necessity.

Ironically, the presentations at the conference that interested me the most were not in my own field, physics, but in pure math.

In a strange coincidence, I encountered a poster all about a two-player game that I had once posted on my blog, Puppies and Kittens! Apparently the game is known to mathematicians as Wythoff's Game. The poster was about a generalization of Wythoff's Game, called Linear Nimhoff. The game starts with a set of vectors, such as {(1,0),(0,1),(1,1)}. There are two piles, which will be henceforth referred to as puppies and kittens in a pet store. (1,0) corresponds to buying one puppy; (0,1) corresponds to buying one kitten; (1,1) corresponds to buying one puppy and one kitten. During each player's turn the player selects one of the vectors, and buys an integer multiple of that vector. Whoever buys the last pet wins the game.

If you mathematically analyze the game, you find that there are "winning" and "losing" positions. If, for example, you are able to leave one puppy and two kittens in the pet store at the end of your turn, then you have won the game (provided that everyone plays the game perfectly). If you can determine what all the winning and losing positions are, then you have solved the game!

If you start with the vector set {(1,0),(0,1),(1,1)}, then it is called Wythoff's Game. But in general, you can have any set of vectors. Wythoff's Game is solved, but the general game is not solved. The poster did not have some amazing new general solution, but it was able to characterize the solution. Apparently, all the winning positions lie "near" one of several lines in the plane. The slopes of these lines can be determined from the initial vector set. Sounds pretty exciting if you ask me. But don't ask me what the practical applications are. I have no clue.

Another cool coincidence was that I saw a presentation on intrinsically knotted graphs. It's a coincidence because a fellow blogger (hi Susan!) did undergraduate research on the same thing, and had named her blog Intrinsically Knotted. Click the link for an explanation of what that is. The presentation I saw was about proving graphs to be "minor minimal"--that is, removing any edge of the graph will remove the intrinsically knotted property.

In summary, research in physics and math are a lot of fun. And if you like, you can extrapolate this hypothesis to other fields represented at the conference, like chemistry, biology, or even the social sciences.