Advertisement
Guest User

Untitled

a guest
Jul 26th, 2014
317
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 3.08 KB | None | 0 0
  1. What will happen tomorrow is not random. In other words it is at least somewhat predictable. I mean not entirely to be sure, but somethings will happen for certain and other things definetly won't. For example the sun will rise, water will freeze at zero degrees and you won't become Michael Stevens. We know this because the everything in the Universe is made of 12 fundamental particles and they interact in 4 predictable ways. What if I were able to determine the positions and velocities of every single one of these particles in the Universe? Well, you would be the intelligence envisioned by Laplace who thought if you could really figure out where everything is and how fast it's moving you would know the entire future of the Universe because you know how every particle interacts with the other particle. Wow, so nothing would be unpredictable which means nothing would be random. Not even human behavior since we are made of the same fundamental particles as everything in the rest of the Universe. Everything we will ever do and have ever done will determined by the state of the Uiniverse at one time. But what is information, well it seems to be fundamentaly about order. The order of molecules in your DNA contain the information needed to make you. It is the order of '0' and '1' streaming through the Internet that contians all the information required to play this video. It is the order of letters that make a word and the order of words that make a sentence that carries information. So fundamentaly information seems to be about order, regularity. That is until you really think about it. Does every letter of a word carries the same amount of information? No. I mean, after a 'q' you know almost for certain that the next letter will be a 'u', after a 'th' there will probably be an 'e'. So this letters carry very little information because you can predict them beforehand; they are redundant. In fact the founder of information theory Claud Shannon estimated the redundancy of English at about 75% percent, which is why we can make sense of things like 'if u cn rd ths u cn gt a gd jb w hi pa!'. So English can be compressed because it is not random, it has patterns. Similarly video is compressed because of its regularityies. In the same frame pixels of similar colors cluster together. Plus from frame to frame most of the pixels dont change, so you only need to record those who do change. You can take advantage of this technique tan average video can be compressed to one thousandth of its original size. But what is the most you can compress something? Well, anything that is not random, any patterns and regularities can be reduced because they are predictable. So you can continue shrinking a file down until what you are left with is totally random and that will contain all the information from the original data but still pure information. So pure information is randomness. If you need to know how much information something contains you need to know how random it is. And randomness is disorder, what we also call entropy.
  2.  
  3. All is just Fine until here.
  4.  
  5. > And randomness is disorder, what we also call entropy.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement