How to create a file without duplicates (not sorted) with Linux commands?

Question

(I know there's a similar post about this, but the solution given is not working for me as it only works for that case in particular.)

I have something like this (File1.txt):

digraph G {
1 [shape="oval" label= "Open"] 
... 
8->9 [style="dashed" label= "true"]
...
2 [shape="oval" label= "Close"] 
8->9 [style="dashed" label= "true"]
...
}

And I want a new file that looks like this (File.txt):

digraph G {
...
1 [shape="oval" label= "Open"]  
8->9 [style="dashed" label= "true"]
...
}

I tried using sort -u File1.txt >> File.txt but I don't want it sorted, I need it in the original order.

Thanks in advance

@n.m. I think he wants the original order (cause that's the only thing that makes any sense) — keyser
– keyser, Commented May 14, 2012 at 18:04
That's it. I need it in the original order after removing the duplicates. — LaFeeVerte
– LaFeeVerte, Commented May 14, 2012 at 18:05
And how do you want 1 and 2 matched, just on shape="oval"? — Kevin
– Kevin, Commented May 14, 2012 at 18:12

keyser · Accepted Answer · 2012-05-14 18:07:21Z

1

You can do this without sorting with AWK:

awk '!x[$0]++' file > newfile

answered May 14, 2012 at 18:07

keyser

19.3k16 gold badges62 silver badges103 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to create a file without duplicates (not sorted) with Linux commands?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related