bash command magic
Since I can’t upvote the question or answer, I thought I’d just give a shout-out to this question on unix.stackexchange.com. To delete duplicate rows from a CSV file using the command line: awk -F, '!seen[$0]++' inputfile.csv > outputfile.csv Fantastic.