bash command magic

PUBLISHED ON FEB 18, 2015 — IMPORTED FROM TUMBLR, TEXT

Since I can’t upvote the question or answer, I thought I’d just give a shout-out to this question on unix.stackexchange.com.

To delete duplicate rows from a CSV file using the command line:

awk -F, '!seen[$0]++' inputfile.csv > outputfile.csv

Fantastic.