Removing duplicate lines

Question

I’m developing my TCC,

My TCC, it searches emails in google collection, makes bulk sending etc,

I’m having a problem, In this search for emails he collects repeated emails and invalid emails, then I’m performing an email separator, I would like help, I’ve performed the provider checker, but I’m not able to remove duplicate emails,

The Code is like this:

print ("\nBUNITO\n")

palavra = input("Digite o provedor:")

arq = open('arquivo.txt','r')
contador = 0

for linha in arq:

    linha = linha.rstrip()
    if palavra in linha:
        contador = contador +1
        print(linha)
print ("\nForam Retornados", contador, "emails")
arq.close()

If on my list you have emails like this:

• [email protected]
• [email protected]
• [email protected]

he should just return like this:

• [email protected]
• [email protected]

But I can’t make it through.

Answer 1

You can do it like this:

lista_duplicada = ['[email protected]', '[email protected]', '[email protected]']
lista_unica = list(set(lista_duplicada))
print(lista_unica) 
# ['[email protected]', '[email protected]']