open output file
for each file in folder
    open file
    for each line in current file
        if line not in array_lines
             write line to output file
             add line to array_lines
    close file
close output file