"Paraphraser" Game


Paraphrases Generation

The paraphrases we need in experiments have two requiremetns:
First, they should be queries that people will use when they do searching. Queries are normally short and may not correct in grammar. It’s hard to use NLP techniques like multiple sequence alignment (MSA) or cosine similarity, since parallel queries share too few words or sequences.
Second, they should be able to expand to other object.  We can’t draw any conclusion by examining the returned URLs from different search engines with only 10 parallel queries. We need many groups of parallel queries.

We implemented the "Rephraser" game to collect paraphrases.
The Rephraser game which we prototyped at Ask.com is intended to produce massive number of equivalent rephrases by a real-time competition played by two or more players. The objective of playing the game is to guess a hidden phrase which is “semantically equivalent" to the start phrase. When a game starts, the start phrase is given to all participants of the game at the same time. All players try their best to enter as many equivalent phrases as possible until the game ends.  Each game lasts 15 minutes.  Players receive points from two ways: by getting votes of their rephrases from other players, and by matching the hidden phrase.
game
Above figure is a snapshot from the game. We used NASCAR racing theme as the design for the game. During  the game, the progress of each player is shown by the position of his/her racing car. Each round of the game has a start query and lasts 15 minutes. Participants win scores if their answer matches the hidden phrase or matches other players' answers.  In below table we selected part of  paraphrases  we collected from one round of game.
 
Start query: how many di erent kinds of snakes exist
how many di erent kinds of snakes exist 7
how many di erent kinds of snakes are there 6
how many kinds of snakes exist 5
how many kinds of snakes are there 5
how many di erent types of snakes are there 4
how many di erent snakes are there 4
how many kinds of snakes exist in the world 3
how many types of snakes exist 3
how many types of snakes are there in the world 3
how many di erent kinds of snakes 3
how many di erent kinds of snakes are there in the world 3
How many di erent species of snakes are there in the world 3
species of snakes 2
snake species 2