Pastebin launched a little side project called HostCabi.net, check it out ;-)Don't like ads? PRO users don't see any ads ;-)
Guest

Untitled

By: a guest on Feb 27th, 2012  |  syntax: None  |  size: 0.27 KB  |  hits: 20  |  expires: Never
download  |  raw  |  embed  |  report abuse  |  print
Text below is selected. Please press Ctrl+C to copy to your clipboard. (⌘+C on Mac)
  1. $ time python fastq-unique.py < /usr/local/src/methylcode/data/dme/en.wt.1.fastq > unique.fastq
  2. 36754782 records in file
  3. checking 2525155 potential duplicates in a python set
  4. 4699 false-positive duplicates in the bloom filter
  5.  
  6. real    11m31.077s
  7. user    11m1.937s
  8. sys 0m23.093s