{"id":61366,"date":"2024-11-29T15:44:11","date_gmt":"2024-11-29T15:44:11","guid":{"rendered":"https:\/\/proxidize.com\/?post_type=blog&p=61366"},"modified":"2025-10-23T12:13:44","modified_gmt":"2025-10-23T11:13:44","slug":"parse-xml-in-python","status":"publish","type":"blog","link":"https:\/\/proxidize.com\/blog\/parse-xml-in-python\/","title":{"rendered":"How to Parse XML in Python"},"content":{"rendered":"\n

Learning to parse XML in Python<\/a> is a good skill to have when working with structured data. XML is used for data storage and transfer because of its flexibility and readability. It comes in handy for extracting data from a website, processing configuration files, and analyzing large datasets. In this article, we will explain what XML is, understand the structure of it, and explore five different ways to parse XML in Python. With this guide, you will find more options to help you with your next project.<\/p>\n\n\n\n

<\/div>\n\n\n\n
\"Image<\/figure>\n\n\n\n
<\/div>\n\n\n\n

What is XML?<\/h2>\n\n\n\n

XML or Extensible Markup Language<\/a> is a language used in an array of applications and systems. It is a structured and hierarchical data format that allows data storage and exchange between platforms and applications. XML was designed to be readable by both humans and machines which is why the design goals of XML emphasize simplicity, generality, and usability. It is organized in a tree which makes it simple to store and find data. XML is generally a preferred format due to its ability to be used with any operating system, its simplicity, and how readable it is, given that non-developers can read and understand it without worry.<\/p>\n\n\n\n

<\/p>\n\n\n\t\t

\n\t\t\t\t
\n\t\t
\n\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

A completely anonymous profile starts
\nwith the highest quality mobile proxies<\/p>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\tBuy Proxies Now<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\n\n\n\n

<\/p>\n\n\n\n

Understanding the Structure<\/h3>\n\n\n\n

Before we go into how you could parse XML in Python, it is best to understand the structure of an XML file. For the purposes of this example, we will be using an XML file from Microsoft<\/a> that shows a list of books. There are two ways that you can parse XML files; through a link that contains an XML document or by using an XML document saved on your device. The principal remains the same except for the source of the file. For the purposes of this article, we will be conducting all our examples off of the link to the XML file from Microsoft. However, as the URL is an HTML page with an XML file embedded code snippet, all our scripts will need to extract the XML from the HTML using BeautifulSoup<\/a>.\u00a0<\/p>\n\n\n\n

XML files consist of four sections: <\/p>\n\n\n\n

    \n
  1. Root Element<\/strong>: At the very top of the list is the root element. This is the descriptor of what the list will entail and will contain all the other elements within it. In the case of our example, this is the <catalog> tag.<\/li>\n\n\n\n
  2. Attribute<\/strong>: The attribute is the specific ID or title of the element. For our example, this would be <book id>. This is the categorical attribute assigned to the specific subject. Where catalog is the main identifier, book id is the item. <\/li>\n\n\n\n
  3. Child Elements<\/strong>: These are the elements that include details about the root. For our example <book> would be the child element as each contains details about the books. <\/li>\n\n\n\n
  4. Sub-Elements<\/strong>: A child element can contain more information within the structure. The <book> child element contains the sub-elements of author, title, genre, price, publication date, and description. <\/li>\n<\/ol>\n\n\n\n
    <\/div>\n\n\n\n
    \"An<\/figure>\n\n\n\n
    <\/div>\n\n\n\n

    Ways to Parse XML in Python<\/h2>\n\n\n\n

    There are internal and external libraries that can help parse XML in Python. The three internal libraries are ElementTree, MiniDOM, and SAX Parser while the external libraries are BeautifulSoup, Lmxl, and Untangle. We will go through what each library is and how it can be used. <\/p>\n\n\n\n

    ElementTree<\/h3>\n\n\n\n

    ElementTree is a built-in Python XML parser that provides functions to read, alter, and modify XML files. It creates a tree-like structure that stores the data in a hierarchical format. The first step to using it is to import xml.etree.ElementTree<\/code> and call the XML file\u2019s parse()<\/code> function. You can also provide the input file in a str format using the fromstring()<\/code> function. After the parsed tree is analyzed, users can retrieve the root tag using the root()<\/code> function.<\/p>\n\n\n\n

    <\/p>\n\n\n\n

    Copy<\/span><\/span>
    import<\/span> xml<\/span>.<\/span>etree<\/span>.<\/span>ElementTree <\/span>as<\/span> <\/span>ET<\/span><\/span>\nimport<\/span> requests<\/span><\/span>\nfrom<\/span> bs4 <\/span>import<\/span> BeautifulSoup<\/span><\/span>\n<\/span>\n#<\/span> Fetch and extract XML content from the URL<\/span><\/span>\nurl <\/span>=<\/span> <\/span>"https:\/\/learn.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/ms762271(v=vs.85)"<\/span><\/span>\nresponse <\/span>=<\/span> requests<\/span>.<\/span>get<\/span>(<\/span>url<\/span>)<\/span><\/span>\nsoup <\/span>=<\/span> BeautifulSoup<\/span>(<\/span>response<\/span>.<\/span>content<\/span>,<\/span> <\/span>"html.parser"<\/span>)<\/span><\/span>\nxml_content <\/span>=<\/span> soup<\/span>.<\/span>find<\/span>(<\/span>"pre"<\/span>).<\/span>text  <\/span>#<\/span> Locate the <pre> tag containing the XML<\/span><\/span>\n<\/span>\n#<\/span> Parse the XML content<\/span><\/span>\nroot <\/span>=<\/span> <\/span>ET<\/span>.<\/span>fromstring<\/span>(<\/span>xml_content<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Example: Print all child tags<\/span><\/span>\nfor<\/span> child <\/span>in<\/span> root<\/span>:<\/span><\/span>\n    <\/span>print<\/span>(<\/span>child<\/span>.<\/span>tag<\/span>,<\/span> child<\/span>.<\/span>attrib<\/span>)<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    Output:
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    book <\/span>{<\/span>'id'<\/span>:<\/span> <\/span>'bk101'<\/span>}<\/span><\/span>\nbook <\/span>{<\/span>'id'<\/span>:<\/span> <\/span>'bk102'<\/span>}<\/span><\/span>\nbook <\/span>{<\/span>'id'<\/span>:<\/span> <\/span>'bk103'<\/span>}<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    Similarly, using the iter()<\/code> function would help you find any element you wish to extract in the tree. As an example, let us extract the description of each book in the file. This will look like this:
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    import<\/span> xml<\/span>.<\/span>etree<\/span>.<\/span>ElementTree <\/span>as<\/span> <\/span>ET<\/span><\/span>\nimport<\/span> requests<\/span><\/span>\nfrom<\/span> bs4 <\/span>import<\/span> BeautifulSoup<\/span><\/span>\n<\/span>\n#<\/span> Fetch and extract XML content from the URL<\/span><\/span>\nurl <\/span>=<\/span> <\/span>"https:\/\/learn.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/ms762271(v=vs.85)"<\/span><\/span>\nresponse <\/span>=<\/span> requests<\/span>.<\/span>get<\/span>(<\/span>url<\/span>)<\/span><\/span>\nsoup <\/span>=<\/span> BeautifulSoup<\/span>(<\/span>response<\/span>.<\/span>content<\/span>,<\/span> <\/span>"html.parser"<\/span>)<\/span><\/span>\nxml_snippet <\/span>=<\/span> soup<\/span>.<\/span>find<\/span>(<\/span>"pre"<\/span>)<\/span>  <\/span>#<\/span> Locate the <pre> tag containing the XML<\/span><\/span>\n<\/span>\n#<\/span> Check if the XML snippet was found<\/span><\/span>\nif<\/span> <\/span>not<\/span> xml_snippet<\/span>:<\/span><\/span>\n    <\/span>raise<\/span> <\/span>Exception<\/span>(<\/span>"Could not find the XML snippet on the webpage."<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Parse the XML content<\/span><\/span>\nxml_content <\/span>=<\/span> xml_snippet<\/span>.<\/span>text<\/span>.<\/span>strip<\/span>()<\/span><\/span>\nroot <\/span>=<\/span> <\/span>ET<\/span>.<\/span>fromstring<\/span>(<\/span>xml_content<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Iterate through all books<\/span><\/span>\nfor<\/span> book <\/span>in<\/span> root<\/span>.<\/span>findall<\/span>(<\/span>"book"<\/span>):<\/span><\/span>\n    book_id <\/span>=<\/span> book<\/span>.<\/span>attrib<\/span>.<\/span>get<\/span>(<\/span>"id"<\/span>,<\/span> <\/span>"N\/A"<\/span>)<\/span>  <\/span>#<\/span> Access the 'id' attribute<\/span><\/span>\n    author <\/span>=<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"author"<\/span>).<\/span>text<\/span>.<\/span>strip<\/span>()<\/span> <\/span>if<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"author"<\/span>)<\/span> <\/span>is<\/span> <\/span>not<\/span> <\/span>None<\/span> <\/span>else<\/span> <\/span>"Unknown Author"<\/span><\/span>\n    title <\/span>=<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"title"<\/span>).<\/span>text<\/span>.<\/span>strip<\/span>()<\/span> <\/span>if<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"title"<\/span>)<\/span> <\/span>is<\/span> <\/span>not<\/span> <\/span>None<\/span> <\/span>else<\/span> <\/span>"Unknown Title"<\/span><\/span>\n    genre <\/span>=<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"genre"<\/span>).<\/span>text<\/span>.<\/span>strip<\/span>()<\/span> <\/span>if<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"genre"<\/span>)<\/span> <\/span>is<\/span> <\/span>not<\/span> <\/span>None<\/span> <\/span>else<\/span> <\/span>"Unknown Genre"<\/span><\/span>\n    price <\/span>=<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"price"<\/span>).<\/span>text<\/span>.<\/span>strip<\/span>()<\/span> <\/span>if<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"price"<\/span>)<\/span> <\/span>is<\/span> <\/span>not<\/span> <\/span>None<\/span> <\/span>else<\/span> <\/span>"Unknown Price"<\/span><\/span>\n    publish_date <\/span>=<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"publish_date"<\/span>).<\/span>text<\/span>.<\/span>strip<\/span>()<\/span> <\/span>if<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"publish_date"<\/span>)<\/span> <\/span>is<\/span> <\/span>not<\/span> <\/span>None<\/span> <\/span>else<\/span> <\/span>"Unknown Publish Date"<\/span><\/span>\n    description <\/span>=<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"description"<\/span>).<\/span>text<\/span>.<\/span>strip<\/span>()<\/span> <\/span>if<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"description"<\/span>)<\/span> <\/span>is<\/span> <\/span>not<\/span> <\/span>None<\/span> <\/span>else<\/span> <\/span>"Unknown Description"<\/span><\/span>\n<\/span>\n    <\/span>#<\/span> Print the extracted data<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"ID: <\/span>{<\/span>book_id<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Author: <\/span>{<\/span>author<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Title: <\/span>{<\/span>title<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Genre: <\/span>{<\/span>genre<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Price: <\/span>{<\/span>price<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Publish Date: <\/span>{<\/span>publish_date<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Description: <\/span>{<\/span>description<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>()<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    Output:<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    ID<\/span>:<\/span> bk101<\/span><\/span>\nAuthor<\/span>:<\/span> Gambardella<\/span>,<\/span> Matthew<\/span><\/span>\nTitle<\/span>:<\/span> <\/span>XML<\/span> Developer<\/span>'s Guide<\/span><\/span>\nGenre<\/span>:<\/span> Computer<\/span><\/span>\nPrice<\/span>:<\/span> <\/span>44.95<\/span><\/span>\nPublish Date<\/span>:<\/span> <\/span>2000<\/span>-<\/span>10<\/span>-<\/span>0<\/span>1<\/span><\/span>\nDescription<\/span>:<\/span> An <\/span>in-<\/span>depth look at creating applications <\/span><\/span>\n      <\/span>with<\/span> <\/span>XML<\/span>.<\/span><\/span>\n<\/span>\nID<\/span>:<\/span> bk102<\/span><\/span>\nAuthor<\/span>:<\/span> Ralls<\/span>,<\/span> Kim<\/span><\/span>\nTitle<\/span>:<\/span> Midnight Rain<\/span><\/span>\nGenre<\/span>:<\/span> Fantasy<\/span><\/span>\nPrice<\/span>:<\/span> <\/span>5.95<\/span><\/span>\nPublish Date<\/span>:<\/span> <\/span>2000<\/span>-<\/span>12<\/span>-<\/span>16<\/span><\/span>\nDescription<\/span>:<\/span> A former architect battles corporate zombies<\/span>,<\/span> <\/span><\/span>\n      an evil sorceress<\/span>,<\/span> <\/span>and<\/span> her own childhood to become queen <\/span><\/span>\n      of the world<\/span>.<\/span><\/span>\n<\/span>\nID<\/span>:<\/span> bk103<\/span><\/span>\nAuthor<\/span>:<\/span> Corets<\/span>,<\/span> Eva<\/span><\/span>\nTitle<\/span>:<\/span> Maeve Ascendant<\/span><\/span>\nGenre<\/span>:<\/span> Fantasy<\/span><\/span>\nPrice<\/span>:<\/span> <\/span>5.95<\/span><\/span>\nPublish Date<\/span>:<\/span> <\/span>2000<\/span>-<\/span>11<\/span>-<\/span>17<\/span><\/span>\nDescription<\/span>:<\/span> After the collapse of a nanotechnology <\/span><\/span>\n      society <\/span>in<\/span> England<\/span>,<\/span> the young survivors lay the <\/span><\/span>\n      foundation <\/span>for<\/span> a new society<\/span>.<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    <\/div>\n\n\n\n
    MiniDOM<\/h3>\n\n\n\n
    miniDOM or Minimal Document Object Model<\/a> loads the input XML file into memory and creates a tree-like structure referred to as a \u201cDOM Tree\u201d to store elements, attributes, and text content. Since XML files already have a hierarchical tree structure, using miniDOM is convenient for navigating and retrieving information. To start it off, you must import xml.dom.minidom.parse()<\/code> to start parsing and get the root element.<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    import<\/span> xml<\/span>.<\/span>dom<\/span>.<\/span>minidom<\/span><\/span>\nimport<\/span> requests<\/span><\/span>\nfrom<\/span> bs4 <\/span>import<\/span> BeautifulSoup<\/span><\/span>\n<\/span>\n#<\/span> Fetch and extract XML content from the URL<\/span><\/span>\nurl <\/span>=<\/span> <\/span>"https:\/\/learn.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/ms762271(v=vs.85)"<\/span><\/span>\nresponse <\/span>=<\/span> requests<\/span>.<\/span>get<\/span>(<\/span>url<\/span>)<\/span><\/span>\nsoup <\/span>=<\/span> BeautifulSoup<\/span>(<\/span>response<\/span>.<\/span>content<\/span>,<\/span> <\/span>"html.parser"<\/span>)<\/span><\/span>\nxml_content <\/span>=<\/span> soup<\/span>.<\/span>find<\/span>(<\/span>"pre"<\/span>).<\/span>text<\/span><\/span>\n<\/span>\n#<\/span> Parse the XML content<\/span><\/span>\nxml_doc <\/span>=<\/span> xml<\/span>.<\/span>dom<\/span>.<\/span>minidom<\/span>.<\/span>parseString<\/span>(<\/span>xml_content<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Example: Print the root element<\/span><\/span>\nroot <\/span>=<\/span> xml_doc<\/span>.<\/span>documentElement<\/span><\/span>\nprint<\/span>(<\/span>"Root is"<\/span>,<\/span> root<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Example: Print each book's title and author<\/span><\/span>\nbooks <\/span>=<\/span> xml_doc<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>"book"<\/span>)<\/span><\/span>\nfor<\/span> book <\/span>in<\/span> books<\/span>:<\/span><\/span>\n    title <\/span>=<\/span> book<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>"title"<\/span>)[<\/span>0<\/span>].<\/span>childNodes<\/span>[<\/span>0<\/span>].<\/span>data<\/span><\/span>\n    author <\/span>=<\/span> book<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>"author"<\/span>)[<\/span>0<\/span>].<\/span>childNodes<\/span>[<\/span>0<\/span>].<\/span>data<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Title: <\/span>{<\/span>title<\/span>}<\/span>, Author: <\/span>{<\/span>author<\/span>}<\/span>"<\/span>)<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    Output:<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    Root <\/span>is<\/span> <\/span><DOM<\/span> Element<\/span>:<\/span> catalog at <\/span>0x<\/span>1829286fbf0<\/span>><\/span><\/span>\nTitle<\/span>:<\/span> <\/span>XML<\/span> Developer<\/span>'s Guide, Author: Gambardella, Matthew<\/span><\/span>\nTitle<\/span>:<\/span> Midnight Rain<\/span>,<\/span> Author<\/span>:<\/span> Ralls<\/span>,<\/span> Kim<\/span><\/span>\nTitle<\/span>:<\/span> Maeve Ascendant<\/span>,<\/span> Author<\/span>:<\/span> Corets<\/span>,<\/span> Eva<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    If you wish to print each book\u2019s author, genre, title, and price, you would need to use the getAttribute()<\/code> function. To access all the elements under a tag, use the getElementsByTagName()<\/code> method and provide the tag as input.\u00a0<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    import<\/span> xml<\/span>.<\/span>dom<\/span>.<\/span>minidom<\/span><\/span>\nimport<\/span> requests<\/span><\/span>\nfrom<\/span> bs4 <\/span>import<\/span> BeautifulSoup<\/span><\/span>\n<\/span>\n#<\/span> Fetch and extract XML content from the URL<\/span><\/span>\nurl <\/span>=<\/span> <\/span>"https:\/\/learn.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/ms762271(v=vs.85)"<\/span><\/span>\nresponse <\/span>=<\/span> requests<\/span>.<\/span>get<\/span>(<\/span>url<\/span>)<\/span><\/span>\nsoup <\/span>=<\/span> BeautifulSoup<\/span>(<\/span>response<\/span>.<\/span>content<\/span>,<\/span> <\/span>"html.parser"<\/span>)<\/span><\/span>\nxml_content <\/span>=<\/span> soup<\/span>.<\/span>find<\/span>(<\/span>"pre"<\/span>).<\/span>text<\/span><\/span>\n<\/span>\n#<\/span> Parse the XML content<\/span><\/span>\nxml_doc <\/span>=<\/span> xml<\/span>.<\/span>dom<\/span>.<\/span>minidom<\/span>.<\/span>parseString<\/span>(<\/span>xml_content<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Get all the book elements<\/span><\/span>\nbooks <\/span>=<\/span> xml_doc<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>'book'<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Loop through the books and extract the data<\/span><\/span>\nfor<\/span> book <\/span>in<\/span> books<\/span>:<\/span><\/span>\n    book_id <\/span>=<\/span> book<\/span>.<\/span>getAttribute<\/span>(<\/span>'id'<\/span>)<\/span>  <\/span>#<\/span> Access the 'id' attribute<\/span><\/span>\n    author <\/span>=<\/span> book<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>'author'<\/span>)[<\/span>0<\/span>].<\/span>childNodes<\/span>[<\/span>0<\/span>].<\/span>data<\/span>.<\/span>strip<\/span>()<\/span><\/span>\n    title <\/span>=<\/span> book<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>'title'<\/span>)[<\/span>0<\/span>].<\/span>childNodes<\/span>[<\/span>0<\/span>].<\/span>data<\/span>.<\/span>strip<\/span>()<\/span><\/span>\n    genre <\/span>=<\/span> book<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>'genre'<\/span>)[<\/span>0<\/span>].<\/span>childNodes<\/span>[<\/span>0<\/span>].<\/span>data<\/span>.<\/span>strip<\/span>()<\/span><\/span>\n    price <\/span>=<\/span> book<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>'price'<\/span>)[<\/span>0<\/span>].<\/span>childNodes<\/span>[<\/span>0<\/span>].<\/span>data<\/span>.<\/span>strip<\/span>()<\/span><\/span>\n    publish_date <\/span>=<\/span> book<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>'publish_date'<\/span>)[<\/span>0<\/span>].<\/span>childNodes<\/span>[<\/span>0<\/span>].<\/span>data<\/span>.<\/span>strip<\/span>()<\/span><\/span>\n    description <\/span>=<\/span> book<\/span>.<\/span>getElementsByTagName<\/span>(<\/span>'description'<\/span>)[<\/span>0<\/span>].<\/span>childNodes<\/span>[<\/span>0<\/span>].<\/span>data<\/span>.<\/span>strip<\/span>()<\/span><\/span>\n<\/span>\n    <\/span>#<\/span> Print the extracted data<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"ID: <\/span>{<\/span>book_id<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Author: <\/span>{<\/span>author<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Title: <\/span>{<\/span>title<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Genre: <\/span>{<\/span>genre<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Price: <\/span>{<\/span>price<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Publish Date: <\/span>{<\/span>publish_date<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Description: <\/span>{<\/span>description<\/span>}<\/span>"<\/span>)<\/span><\/span>\n    <\/span>print<\/span>()<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    Output: <\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    ID<\/span>:<\/span> bk101<\/span><\/span>\nAuthor<\/span>:<\/span> Gambardella<\/span>,<\/span> Matthew<\/span><\/span>\nTitle<\/span>:<\/span> <\/span>XML<\/span> Developer<\/span>'s Guide<\/span><\/span>\nGenre<\/span>:<\/span> Computer<\/span><\/span>\nPrice<\/span>:<\/span> <\/span>44.95<\/span><\/span>\nPublish Date<\/span>:<\/span> <\/span>2000<\/span>-<\/span>10<\/span>-<\/span>0<\/span>1<\/span><\/span>\nDescription<\/span>:<\/span> An <\/span>in-<\/span>depth look at creating applications <\/span><\/span>\n      <\/span>with<\/span> <\/span>XML<\/span>.<\/span><\/span>\n<\/span>\nID<\/span>:<\/span> bk102<\/span><\/span>\nAuthor<\/span>:<\/span> Ralls<\/span>,<\/span> Kim<\/span><\/span>\nTitle<\/span>:<\/span> Midnight Rain<\/span><\/span>\nGenre<\/span>:<\/span> Fantasy<\/span><\/span>\nPrice<\/span>:<\/span> <\/span>5.95<\/span><\/span>\nPublish Date<\/span>:<\/span> <\/span>2000<\/span>-<\/span>12<\/span>-<\/span>16<\/span><\/span>\nDescription<\/span>:<\/span> A former architect battles corporate zombies<\/span>,<\/span> <\/span><\/span>\n      an evil sorceress<\/span>,<\/span> <\/span>and<\/span> her own childhood to become queen <\/span><\/span>\n      of the world<\/span>.<\/span><\/span>\n<\/span>\nID<\/span>:<\/span> bk103<\/span><\/span>\nAuthor<\/span>:<\/span> Corets<\/span>,<\/span> Eva<\/span><\/span>\nTitle<\/span>:<\/span> Maeve Ascendant<\/span><\/span>\nGenre<\/span>:<\/span> Fantasy<\/span><\/span>\nPrice<\/span>:<\/span> <\/span>5.95<\/span><\/span>\nPublish Date<\/span>:<\/span> <\/span>2000<\/span>-<\/span>11<\/span>-<\/span>17<\/span><\/span>\nDescription<\/span>:<\/span> After the collapse of a nanotechnology <\/span><\/span>\n      society <\/span>in<\/span> England<\/span>,<\/span> the young survivors lay the <\/span><\/span>\n      foundation <\/span>for<\/span> a new society<\/span>.<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    <\/div>\n\n\n\n
    SAX Parser<\/h3>\n\n\n\n
    SAX is another way you could parse XML in Python. It is a step above miniDOM as it can read the document sequentially. It does not need to load the entire tree into its memory which allows you to discard items and save memory space and resources. To set up a SAX parser, you would need to create a SAX parser object and register callback functions for the different events that you want to handle. This can be done by defining a custom BooksHandler class by sub-classing SAX\u2019s ContentHandler.<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    import<\/span> xml<\/span>.<\/span>sax<\/span><\/span>\nimport<\/span> requests<\/span><\/span>\nfrom<\/span> bs4 <\/span>import<\/span> BeautifulSoup<\/span><\/span>\n<\/span>\n#<\/span> Fetch and extract XML content from the URL<\/span><\/span>\nurl <\/span>=<\/span> <\/span>"https:\/\/learn.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/ms762271(v=vs.85)"<\/span><\/span>\nresponse <\/span>=<\/span> requests<\/span>.<\/span>get<\/span>(<\/span>url<\/span>)<\/span><\/span>\nsoup <\/span>=<\/span> BeautifulSoup<\/span>(<\/span>response<\/span>.<\/span>content<\/span>,<\/span> <\/span>"html.parser"<\/span>)<\/span><\/span>\nxml_content <\/span>=<\/span> soup<\/span>.<\/span>find<\/span>(<\/span>"pre"<\/span>).<\/span>text<\/span><\/span>\n<\/span>\n#<\/span> Define a custom SAX ContentHandler<\/span><\/span>\nclass<\/span> <\/span>BookstoreHandler<\/span>(<\/span>xml<\/span>.<\/span>sax<\/span>.<\/span>ContentHandler<\/span>):<\/span><\/span>\n    <\/span>def<\/span> <\/span>__init__<\/span>(<\/span>self<\/span>):<\/span><\/span>\n        <\/span>self<\/span>.<\/span>current_element <\/span>=<\/span> <\/span>""<\/span><\/span>\n        <\/span>self<\/span>.<\/span>current_book <\/span>=<\/span> <\/span>{}<\/span><\/span>\n        <\/span>self<\/span>.<\/span>books <\/span>=<\/span> <\/span>[]<\/span><\/span>\n        <\/span>self<\/span>.<\/span>buffer <\/span>=<\/span> <\/span>""<\/span><\/span>\n<\/span>\n    <\/span>def<\/span> <\/span>startElement<\/span>(<\/span>self<\/span>,<\/span> <\/span>name<\/span>,<\/span> <\/span>attrs<\/span>):<\/span><\/span>\n        <\/span>self<\/span>.<\/span>current_element <\/span>=<\/span> name<\/span><\/span>\n        <\/span>if<\/span> name <\/span>==<\/span> <\/span>"book"<\/span>:<\/span><\/span>\n            <\/span>self<\/span>.<\/span>current_book <\/span>=<\/span> <\/span>{<\/span>"id"<\/span>:<\/span> attrs<\/span>.<\/span>get<\/span>(<\/span>"id"<\/span>,<\/span> <\/span>"N\/A"<\/span>)}<\/span><\/span>\n<\/span>\n    <\/span>def<\/span> <\/span>characters<\/span>(<\/span>self<\/span>,<\/span> <\/span>content<\/span>):<\/span><\/span>\n        <\/span>self<\/span>.<\/span>buffer <\/span>+=<\/span> content<\/span>.<\/span>strip<\/span>()<\/span><\/span>\n<\/span>\n    <\/span>def<\/span> <\/span>endElement<\/span>(<\/span>self<\/span>,<\/span> <\/span>name<\/span>):<\/span><\/span>\n        <\/span>if<\/span> name <\/span>in<\/span> <\/span>[<\/span>"title"<\/span>,<\/span> <\/span>"author"<\/span>,<\/span> <\/span>"price"<\/span>,<\/span> <\/span>"description"<\/span>]:<\/span><\/span>\n            <\/span>self<\/span>.<\/span>current_book<\/span>[<\/span>name<\/span>]<\/span> <\/span>=<\/span> <\/span>self<\/span>.<\/span>buffer<\/span><\/span>\n        <\/span>if<\/span> name <\/span>==<\/span> <\/span>"book"<\/span>:<\/span><\/span>\n            <\/span>self<\/span>.<\/span>books<\/span>.<\/span>append<\/span>(<\/span>self<\/span>.<\/span>current_book<\/span>)<\/span><\/span>\n        <\/span>self<\/span>.<\/span>buffer <\/span>=<\/span> <\/span>""<\/span>  <\/span>#<\/span> Reset buffer after each element<\/span><\/span>\n<\/span>\n#<\/span> Parse the XML content<\/span><\/span>\nparser <\/span>=<\/span> xml<\/span>.<\/span>sax<\/span>.<\/span>make_parser<\/span>()<\/span><\/span>\nhandler <\/span>=<\/span> BookstoreHandler<\/span>()<\/span><\/span>\nxml<\/span>.<\/span>sax<\/span>.<\/span>parseString<\/span>(<\/span>xml_content<\/span>,<\/span> handler<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Print parsed books<\/span><\/span>\nfor<\/span> book <\/span>in<\/span> handler<\/span>.<\/span>books<\/span>:<\/span><\/span>\n    <\/span>print<\/span>(<\/span>book<\/span>)<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    Output:<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    {<\/span>'id'<\/span>:<\/span> <\/span>'bk101'<\/span>,<\/span> <\/span>'author'<\/span>:<\/span> <\/span>'Gambardella, Matthew'<\/span>,<\/span> <\/span>'title'<\/span>:<\/span> <\/span>"XML Developer's Guide"<\/span>,<\/span> <\/span>'price'<\/span>:<\/span> <\/span>'44.95'<\/span>,<\/span> <\/span>'description'<\/span>:<\/span> <\/span>'An in-depth look at creating applicationswith XML.'<\/span>}<\/span><\/span>\n{<\/span>'id'<\/span>:<\/span> <\/span>'bk102'<\/span>,<\/span> <\/span>'author'<\/span>:<\/span> <\/span>'Ralls, Kim'<\/span>,<\/span> <\/span>'title'<\/span>:<\/span> <\/span>'Midnight Rain'<\/span>,<\/span> <\/span>'price'<\/span>:<\/span> <\/span>'5.95'<\/span>,<\/span> <\/span>'description'<\/span>:<\/span> <\/span>'A former architect battles corporate zombies,an evil sorceress, and her own childhood to become queenof the world.'<\/span>}<\/span><\/span>\n{<\/span>'id'<\/span>:<\/span> <\/span>'bk103'<\/span>,<\/span> <\/span>'author'<\/span>:<\/span> <\/span>'Corets, Eva'<\/span>,<\/span> <\/span>'title'<\/span>:<\/span> <\/span>'Maeve Ascendant'<\/span>,<\/span> <\/span>'price'<\/span>:<\/span> <\/span>'5.95'<\/span>,<\/span> <\/span>'description'<\/span>:<\/span> <\/span>'After the collapse of a nanotechnologysociety in England, the young survivors lay thefoundation for a new society.'<\/span>}<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    <\/div>\n\n\n\n
    BeautifulSoup and lmxl<\/h3>\n\n\n\n
    BeautifulSoup, one of the most popular Python libraries for web scraping<\/a>, is typically used for parsing HTML. However, it can also handle XML. Using BeautifulSoup provides a more user-friendly interface to traverse, search, and modify XML documents. It is ideal for quickly extracting specific elements without requiring deep knowledge of XML\u2019s parsing libraries. BS4 includes a built-in XML parser so it does not need any additional dependencies to parse XML in Python. If you need a faster parse, you can introduce lxml to help boost performance for larger XML files.<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    from<\/span> bs4 <\/span>import<\/span> BeautifulSoup<\/span><\/span>\nimport<\/span> requests<\/span><\/span>\n<\/span>\n#<\/span> Fetch and extract XML content from the URL<\/span><\/span>\nurl <\/span>=<\/span> <\/span>"https:\/\/learn.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/ms762271(v=vs.85)"<\/span><\/span>\nresponse <\/span>=<\/span> requests<\/span>.<\/span>get<\/span>(<\/span>url<\/span>)<\/span><\/span>\nsoup <\/span>=<\/span> BeautifulSoup<\/span>(<\/span>response<\/span>.<\/span>content<\/span>,<\/span> <\/span>"html.parser"<\/span>)<\/span><\/span>\nxml_content <\/span>=<\/span> soup<\/span>.<\/span>find<\/span>(<\/span>"pre"<\/span>).<\/span>text<\/span><\/span>\n<\/span>\n#<\/span> Parse the XML content using BeautifulSoup<\/span><\/span>\nsoup <\/span>=<\/span> BeautifulSoup<\/span>(<\/span>xml_content<\/span>,<\/span> <\/span>"lxml-xml"<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Example: Find and print all book titles and authors<\/span><\/span>\nfor<\/span> book <\/span>in<\/span> soup<\/span>.<\/span>find_all<\/span>(<\/span>"book"<\/span>):<\/span><\/span>\n    title <\/span>=<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"title"<\/span>).<\/span>text <\/span>if<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"title"<\/span>)<\/span> <\/span>else<\/span> <\/span>"N\/A"<\/span><\/span>\n    author <\/span>=<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"author"<\/span>).<\/span>text <\/span>if<\/span> book<\/span>.<\/span>find<\/span>(<\/span>"author"<\/span>)<\/span> <\/span>else<\/span> <\/span>"N\/A"<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Title: <\/span>{<\/span>title<\/span>}<\/span>, Author: <\/span>{<\/span>author<\/span>}<\/span>"<\/span>)<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    Output:<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    Title<\/span>:<\/span> <\/span>XML<\/span> Developer<\/span>'s Guide, Author: Gambardella, Matthew<\/span><\/span>\nTitle<\/span>:<\/span> Midnight Rain<\/span>,<\/span> Author<\/span>:<\/span> Ralls<\/span>,<\/span> Kim<\/span><\/span>\nTitle<\/span>:<\/span> Maeve Ascendant<\/span>,<\/span> Author<\/span>:<\/span> Corets<\/span>,<\/span> Eva<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    <\/div>\n\n\n\n
    Untangle<\/h3>\n\n\n\n
    Untangle is a lightweight library used to parse XML in Python. While traditional parsers need to navigate through hierarchical structures, untangle allows you to access XML elements and attributes as Python objects. Untangle can help convert XML documents into Python dictionaries so the elements in the document can be represented as dictionary keys and their attributes and text content can be stored as corresponding values. Untangle does need to be installed into your IDE so you would need to enter pip install untangle<\/code> into your terminal before you do anything else.<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    import<\/span> untangle<\/span><\/span>\nimport<\/span> requests<\/span><\/span>\nfrom<\/span> bs4 <\/span>import<\/span> BeautifulSoup<\/span><\/span>\n<\/span>\n#<\/span> Fetch and extract XML content from the URL<\/span><\/span>\nurl <\/span>=<\/span> <\/span>"https:\/\/learn.microsoft.com\/en-us\/previous-versions\/windows\/desktop\/ms762271(v=vs.85)"<\/span><\/span>\nresponse <\/span>=<\/span> requests<\/span>.<\/span>get<\/span>(<\/span>url<\/span>)<\/span><\/span>\nsoup <\/span>=<\/span> BeautifulSoup<\/span>(<\/span>response<\/span>.<\/span>content<\/span>,<\/span> <\/span>"html.parser"<\/span>)<\/span><\/span>\nxml_content <\/span>=<\/span> soup<\/span>.<\/span>find<\/span>(<\/span>"pre"<\/span>).<\/span>text<\/span><\/span>\n<\/span>\n#<\/span> Parse the XML content with untangle<\/span><\/span>\nxml_obj <\/span>=<\/span> untangle<\/span>.<\/span>parse<\/span>(<\/span>xml_content<\/span>)<\/span><\/span>\n<\/span>\n#<\/span> Example: Print all book titles and authors<\/span><\/span>\nfor<\/span> book <\/span>in<\/span> xml_obj<\/span>.<\/span>catalog<\/span>.<\/span>book<\/span>:<\/span><\/span>\n    title <\/span>=<\/span> book<\/span>.<\/span>title<\/span>.<\/span>cdata <\/span>if<\/span> <\/span>hasattr<\/span>(<\/span>book<\/span>,<\/span> <\/span>"title"<\/span>)<\/span> <\/span>else<\/span> <\/span>"N\/A"<\/span><\/span>\n    author <\/span>=<\/span> book<\/span>.<\/span>author<\/span>.<\/span>cdata <\/span>if<\/span> <\/span>hasattr<\/span>(<\/span>book<\/span>,<\/span> <\/span>"author"<\/span>)<\/span> <\/span>else<\/span> <\/span>"N\/A"<\/span><\/span>\n    <\/span>print<\/span>(<\/span>f<\/span>"Title: <\/span>{<\/span>title<\/span>}<\/span>, Author: <\/span>{<\/span>author<\/span>}<\/span>"<\/span>)<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    Output:<\/p>\n\n\n\n
    <\/p>\n\n\n\n
    Copy<\/span><\/span>
    Title<\/span>:<\/span> <\/span>XML<\/span> Developer<\/span>'s Guide, Author: Gambardella, Matthew<\/span><\/span>\nTitle<\/span>:<\/span> Midnight Rain<\/span>,<\/span> Author<\/span>:<\/span> Ralls<\/span>,<\/span> Kim<\/span><\/span>\nTitle<\/span>:<\/span> Maeve Ascendant<\/span>,<\/span> Author<\/span>:<\/span> Corets<\/span>,<\/span> Eva<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
    <\/p>\n\n\n\n
    <\/div>\n\n\n\n
    \"Image<\/figure>\n\n\n\n
    <\/div>\n\n\n\n
    Tips and Tricks to Parse XML in Python<\/h2>\n\n\n\n
    We have explained and presented five different ways to parse XML using Python. This section will provide insight into when one parsing library will be better than the other as well as give some helpful tips and tricks to parse XML in Python.<\/p>\n\n\n\n
    Most of the time, choosing between the different parsers depends on the size of the XML file you are working with. If you are working with a small to medium-sized XML file, Element Tree would suffice due to its great speeds and ease of use. MiniDOM is useful for smaller files as well, especially when working with DOM-like structures. For context, the XML file we have been experimenting with throughout this article (Books.XML) is only 5KB so using Element Tree for something of the same size is a great choice.<\/p>\n\n\n\n
    For a larger XML file, typically something bigger than a gigabyte, BS4 and lxml would be the better choices as they are specifically efficient for parsing large documents and provide some additional functionality like XPath support. For extremely large files or streaming files, SAX is a perfect option because of how it processes data incrementally and reduces memory usage. If you are looking for the most simple and Python-like option, Untangle is the best choice. <\/p>\n\n\n\n
    One of the issues that pop up when parsing or even web scraping is suffering from an IP ban<\/a> due to multiple requests being made due to exceeding rate limits. A useful tool to bypass this when deciding to parse XML in Python is a proxy. While it is not entirely necessary to use when parsing a file you have in your documents, it comes in handy when parsing an XML document through a URL as we have been doing. If you are retrieving XML data from a remote server, you can route the request through a mobile proxy<\/a> to hide your IP and avoid rate limits.\u00a0<\/p>\n\n\n\n
    <\/div>\n\n\n\n
    Conclusion <\/h2>\n\n\n\n
    Choosing to parse XML in Python allows you to handle structured data for many tasks including web scraping and data analysis. With the five different approaches we presented for you in this article, you should have a comprehensive understanding of the tools available, when they could be used, and why. If you are working with small files, large datasets, or just want to make things easier for yourself, there is a parser available that will suit your needs.<\/p>\n","protected":false},"author":2627,"featured_media":75720,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","format":"standard","categories":[266],"tags":[],"class_list":["post-61366","blog","type-blog","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-tutorials-and-programming"],"acf":[],"_links":{"self":[{"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/blog\/61366","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/users\/2627"}],"replies":[{"embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/comments?post=61366"}],"version-history":[{"count":8,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/blog\/61366\/revisions"}],"predecessor-version":[{"id":87248,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/blog\/61366\/revisions\/87248"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/media\/75720"}],"wp:attachment":[{"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/media?parent=61366"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/categories?post=61366"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/proxidize.com\/wp-json\/wp\/v2\/tags?post=61366"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}