Using Python to merge and deduplicate XML data

Use Python to merge and deduplicate XML data

XML (eXtensible Markup Language) is a markup language used to store and transmit data. When processing XML data, sometimes we need to merge multiple XML files into one, or remove duplicate data. This article will introduce how to use Python to implement XML data merging and deduplication, and give corresponding code examples.

1. XML data merging

When we have multiple XML files and need to merge them into one file, we can use Python's ElementTree module to operate. The following is a simple example, assuming we have two XML files file1.xml and file2.xml, with the following contents:

file1.xml:

<root>
  <data>file1_data1</data>
  <data>file1_data2</data>
</root>

file2.xml:

<root>
  <data>file2_data1</data>
  <data>file2_data2</data>
</root>

We can merge two XML files into one merged.xml file through the following Python code:

import xml.etree.ElementTree as ET

# 创建一个新的根节点
merged_root = ET.Element('root')

# 读取file1.xml
tree1 = ET.parse('file1.xml')
root1 = tree1.getroot()

# 将file1.xml的数据添加到merged.xml中
for data in root1.findall('data'):
    merged_root.append(data)

# 读取file2.xml
tree2 = ET.parse('file2.xml')
root2 = tree2.getroot()

# 将file2.xml的数据添加到merged.xml中
for data in root2.findall('data'):
    merged_root.append(data)

# 创建一个新的XML文档并写入文件
merged_tree = ET.ElementTree(merged_root)
merged_tree.write('merged.xml', encoding='utf-8', xml_declaration=True)

Run the above code After that, a merged.xml file will be generated with the following content:

merged.xml:

<root>
  <data>file1_data1</data>
  <data>file1_data2</data>
  <data>file2_data1</data>
  <data>file2_data2</data>
</root>

2. XML data deduplication

When we There is an XML file that contains duplicate data. When you need to deduplicate it, you can use Python's set data structure to operate. The following is a simple example, assuming we have an XML file file.xml with the following content:

file.xml:

<root>
  <data>data1</data>
  <data>data2</data>
  <data>data1</data>
</root>

We can use the following Python code to Deduplication of duplicate data in XML files:

import xml.etree.ElementTree as ET

# 读取file.xml
tree = ET.parse('file.xml')
root = tree.getroot()

# 使用set去重
unique_data = set()

# 遍历所有data节点
for data in root.findall('data'):
    unique_data.add(data.text)

# 创建一个新的根节点
uniq_root = ET.Element('root')

# 将去重后的数据添加到uniq_root中
for data in unique_data:
    element = ET.SubElement(uniq_root, 'data')
    element.text = data

# 创建一个新的XML文档并写入文件
uniq_tree = ET.ElementTree(uniq_root)
uniq_tree.write('unique.xml', encoding='utf-8', xml_declaration=True)

After running the above code, a unique.xml file will be generated with the following content:

unique.xml:

<root>
  <data>data2</data>
  <data>data1</data>
</root>

The above is how to use Python to merge and deduplicate XML data. Through the ElementTree module, we can easily operate on XML data to achieve various processing needs. Hope this article can help you.

The above is the detailed content of Using Python to merge and deduplicate XML data. For more information, please follow other related articles on the PHP Chinese website!