Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- -- Query ID 1 --
- In both the Lucene result, and my search engine "Global warming" is the first result, for the query "global warming potential".
- More than likely, this is because the weight of each term is different for Lucene and my Search Engine.
- However, I would argue for this query my result is better. If you look at the second result for Lucene, it is: EnergyConsumption
- Mine is: 88888_Lights_Out.
- Lucene's result is a nearly empty page with links to various energy consumption pages in Wikipedia.
- Mine result is a campaign to raise awareness of global warming.
- Therefore, my result is more relevent to the query.
- If I were searching for "global warming potential" I would prefer to get a page about a campaign to raise its awareness, than a page with energy consumption links.
- I did not search for "energy consumption", I searched for "global warming potential".
- This trend continues for the 3rd result for Lucenece: Environmental_impact_of_the_energy_industry while mine is: Joseph_Romm, a leading scientist of global warming.
- This trend continues for the rest of the results.
- It would seem this is due to Lucene's customized scoring algorithm which is a combination of the Vector Space Model and the Boolean Model.
- -- Query ID 2 --
- --Query ID 3 --
- --Query ID 4 --
- ---- Generic ----
- One thing that appears to be true is the ranking of the outputs are rather similar.
- While they are not identical, they are within a reasonable margin of error.
- This could be due to a number of causes, my implementation could not be calculating the cosine similarity the same way as Lucene.
- However, the fact that the outputs are relatively similar is reassuring.
- Furthermore, Lucene could be weighing certain terms differently than I am.
- Lucene could know that "the" for example, can be dropped from the query or removed from the results entirely.
- In my implementation, this is not done.
- Another important thing to note is that in QueryID 4, there are plurals and singular versions of the same words:
- "bulb" - "bulbs" and "alternative" - "alternatives"
- The stem of these words could be obtained and the outputs would be much different.
- Furthermore, we are not considering the correlation between the terms in the query.
- We are not forcing "global warming potential" to all be in the same document.
- We are also not considering synonyms for words.
- An example would be "california" -> "The Golden State"
- Documents could mention one or the other, or both.
Advertisement
Add Comment
Please, Sign In to add comment