Read XML tag blocks based on a search

Question

I have a folder where insert logs are stored in the database. Log files follow this structure:

             <item xsi:type="tns:StatusResultReport">
                <id xsi:type="xsd:int">1569692</id>
                <placa xsi:type="xsd:string">XXX</placa>
                <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
                <msg xsi:type="xsd:string">Adicionado</msg>
                <sucesso xsi:type="xsd:boolean">true</sucesso>
            </item>
            <item xsi:type="tns:StatusResultReport">
                <placa xsi:type="xsd:string">XXX</placa>
                <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
                <msg xsi:type="xsd:string">Não encontrado</msg>
                <sucesso xsi:type="xsd:boolean">false</sucesso>
            </item>
            <item xsi:type="tns:StatusResultReport">
                <id xsi:type="xsd:int">1569693</id>
                <placa xsi:type="xsd:string">XXX</placa>
                <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
                <msg xsi:type="xsd:string">Adicionado</msg>
                <sucesso xsi:type="xsd:boolean">true</sucesso>
            </item>
            <item xsi:type="tns:StatusResultReport">
                <id xsi:type="xsd:int">1569694</id>
                <placa xsi:type="xsd:string">XXX</placa>
                <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
                <msg xsi:type="xsd:string">Adicionado</msg>
                <sucesso xsi:type="xsd:boolean">true</sucesso>
            </item>
            <item xsi:type="tns:StatusResultReport">
                <id xsi:type="xsd:int">1569695</id>
                <placa xsi:type="xsd:string">XXX</placa>
                <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
                <msg xsi:type="xsd:string">Adicionado</msg>
                <sucesso xsi:type="xsd:boolean">true</sucesso>
            </item>

Currently, I know a record was entered when the tag sucesso comes with the value true, and I know that you failed when the value is false.

What I want to do is through a Python program, read these files and extract the blocks <item></item> successful=false

I tried with the code below, but it extracts only the line false

search = 'false'

def check():
    datafile = open('C:\\TESTE\\LCL_20170420_30052.67.XML')
    for line in datafile:
        if search in line:
            found = True
            print(line)
            break
        else:
            found = False
    return found


check()

Answer 1

You can use the library BeautifulSoup to browse between the tags of your XML file.

It could use other libraries as well, such as xml.etree.ElementTree, minidom or the lxml, for example.

Code:

s = '''
<item xsi:type="tns:StatusResultReport">
    <id xsi:type="xsd:int">1569692</id>
    <placa xsi:type="xsd:string">XXX</placa>
    <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
    <msg xsi:type="xsd:string">Adicionado</msg>
    <sucesso xsi:type="xsd:boolean">true</sucesso>
</item>
<item xsi:type="tns:StatusResultReport">
    <placa xsi:type="xsd:string">XXX</placa>
    <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
    <msg xsi:type="xsd:string">Não encontrado</msg>
    <sucesso xsi:type="xsd:boolean">false</sucesso>
</item>
<item xsi:type="tns:StatusResultReport">
    <id xsi:type="xsd:int">1569693</id>
    <placa xsi:type="xsd:string">XXX</placa>
    <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
    <msg xsi:type="xsd:string">Adicionado</msg>
    <sucesso xsi:type="xsd:boolean">true</sucesso>
</item>
<item xsi:type="tns:StatusResultReport">
    <id xsi:type="xsd:int">1569694</id>
    <placa xsi:type="xsd:string">XXX</placa>
    <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
    <msg xsi:type="xsd:string">Adicionado</msg>
    <sucesso xsi:type="xsd:boolean">true</sucesso>
</item>
<item xsi:type="tns:StatusResultReport">
    <id xsi:type="xsd:int">1569695</id>
    <placa xsi:type="xsd:string">XXX</placa>
    <ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
    <msg xsi:type="xsd:string">Adicionado</msg>
    <sucesso xsi:type="xsd:boolean">true</sucesso>
</item>
'''

from bs4 import BeautifulSoup

soup = BeautifulSoup(s, 'lxml')

item_tags = soup.find_all('item')

for item in item_tags:
    if item.sucesso.text == 'true':
        print(item)
        print('='*5)

Output:

<item xsi:type="tns:StatusResultReport">
<id xsi:type="xsd:int">1569692</id>
<placa xsi:type="xsd:string">XXX</placa>
<ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
<msg xsi:type="xsd:string">Adicionado</msg>
<sucesso xsi:type="xsd:boolean">true</sucesso>
</item>
=====
<item xsi:type="tns:StatusResultReport">
<id xsi:type="xsd:int">1569693</id>
<placa xsi:type="xsd:string">XXX</placa>
<ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
<msg xsi:type="xsd:string">Adicionado</msg>
<sucesso xsi:type="xsd:boolean">true</sucesso>
</item>
=====
<item xsi:type="tns:StatusResultReport">
<id xsi:type="xsd:int">1569694</id>
<placa xsi:type="xsd:string">XXX</placa>
<ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
<msg xsi:type="xsd:string">Adicionado</msg>
<sucesso xsi:type="xsd:boolean">true</sucesso>
</item>
=====
<item xsi:type="tns:StatusResultReport">
<id xsi:type="xsd:int">1569695</id>
<placa xsi:type="xsd:string">XXX</placa>
<ocorrencia_id xsi:type="xsd:string">00</ocorrencia_id>
<msg xsi:type="xsd:string">Adicionado</msg>
<sucesso xsi:type="xsd:boolean">true</sucesso>
</item>
=====

Other Examples:

• Example c/ minidom
• Example c/ Elementtree