Parse HTML file to excel python

Question

I am using BeautifulSoup and trying to parse the output to excel.

<div id="MainContent_BuildSheetUpdatePanel">
                <div id="MainContent_BuildSheetPanel">
                    <div class="row">
                        <div class="col-sm-4 mt-2">
                            <div class="card border-primary">
                                <div class="card-header">
                                    <h4 class="card-title text-center">SCHOOL:</h4>
                                </div>
                                <div class="card-body">
                                    <div class="form-group">
                                        <label>Class ID: </label>
                                        <input name="ctl00$MainContent$ClassIdTextBox" type="text" value="250" id="MainContent_IdTextBox" disabled="disabled"  class="aspNetDisabled form-control">
                                            <span id="MainContent_rfvClassIdTextBox" style="color:Red;display:none;">Required</span>
                                    </div>
                                    <div class="form-group">
                                        <label>Profile ID: </label>
                                        <input name="ctl00$MainContent$ProfileIdTextBox" type="text" value="NA" id="MainContent_ServiceIdTextBox" disabled="disabled"  class="aspNetDisabled form-control">
                                        <span id="MainContent_rfvProfileIdTextBox" style="color:Red;display:none;">Required</span> 
                                    </div>
                                    <div class="form-group">
                                        <label>Serial Number: </label>
                                        <input name="ctl00$MainContent$NumberTextBox" type="text" value="763" id="MainContent_NumberTextBox" disabled="disabled"  class="aspNetDisabled form-control">
                                        <span id="MainContent_rfvNumberTextBox" style="color:Red;display:none;">Required</span> 
                                    </div>
                                    <div class="form-group">
                                        <label>MC Number: </label>
                                        <input name="ctl00$MainContent$MCSerialNumberTextBox" type="text" value="290" id="MainContent_SerialNumberTextBox" disabled="disabled"  class="aspNetDisabled form-control">
                                        <span id="MainContent_rfvMCSerialNumberTextBox" style="color:Red;display:none;">Required</span> 
                                    </div>
                                    <div class="form-group">
                                        <label>SK: </label>
                                        <input name="ctl00$MainContent$SkTextBox" type="text" value="384xm" id="MainContent_SkTextBox" disabled="disabled" class="aspNetDisabled form-control">
                                    </div>
                                    <div class="form-group">
                                        <label>Profile: </label>
                                        <input name="ctl00$MainContent$ProfileTextBox" type="text" value="NA" id="MainContent_ProfileTextBox" disabled="disabled"  class="aspNetDisabled form-control">
                                    </div>
                                    <div class="form-group">
                                        <label>Address: </label>
                                        <input name="ctl00$MainContent$AddressTextBox" type="text" value="192.168.56.54" id="MainContent_AddressTextBox" disabled="disabled"  class="aspNetDisabled form-control">
                                    </div>
                                    <div class="form-group">
                                        <label>Dn: </label>
                                        <input name="ctl00$MainContent$DnTextBox" type="text" value="NA" id="MainContent_DnTextBox" disabled="disabled"  class="aspNetDisabled form-control">
                                        <span id="MainContent_rfvoDnTextBox" style="color:Red;display:none;">Required</span> 
                                    </div>
                                    <div class="form-group">
                                        <label>Hostname: </label>
                                        <input name="ctl00$MainContent$PrimaryHostNameTextBox" type="text" value="N/A" id="MainContent_HostNameTextBox" disabled="disabled" class="aspNetDisabled form-control">
                                    </div>
                                    <div class="form-group">
                                        <label>Primary: </label>
                                        <input name="ctl00$MainContent$PrimarySidTextBox" type="text" value="N/A" id="MainContent_SidTextBox" disabled="disabled" class="aspNetDisabled form-control">
                                    </div>
                                    <div class="form-group">
                                        <label>Server: </label>
                                        <input name="ctl00$MainContent$ServerTextBox" type="text" value="sv41" id="MainContent_ServerTextBox" disabled="disabled" class="aspNetDisabled form-control">
                                    </div>
                                    <div class="form-group">
                                        <label>Server-Address: </label>
                                        <input name="ctl00$MainContent$AddressTextBox" type="text" value="10.56.1.41" id="MainContent_AddressTextBox" disabled="disabled" class="aspNetDisabled form-control">
                                         <span id="MainContent_ServerIpTxtRequiredFieldValidator" style="color:Red;display:none;">Required</span>                    
                                    </div>
                                    </div>
                                </div>
                            </div>
                        </div>

Expected output:

Class ID Profile ID Serial Number MC Number SK Profile Address Dn Hostname Primary 250 NA 763 290 384xm NA 192.168.56.54 NA NA NA

from bs4 import BeautifulSoup 
import requests 

html= """Inputfile """ 

for item in soup.select("div.form-group"): print(item.get_text())

from bs4 import BeautifulSoup import requests html= """Inputfile """ for item in soup.select("div.form-group"): print(item.get_text()) — naruto
– naruto, Commented Oct 19, 2019 at 17:46

QHarr · Accepted Answer · 2019-11-01 04:05:38Z

1

You want the 'value' attribute. Depending on your full html you may be able to shorten the selectors.

from bs4 import BeautifulSoup as bs
import csv

soup = bs(your_html, 'lxml')

with open("data.csv", "w", encoding="utf-8-sig", newline='') as csv_file:
    w = csv.writer(csv_file, delimiter = ",", quoting=csv.QUOTE_MINIMAL)
    w.writerow([i.text for i in soup.select('.form-group label')])
    w.writerow([i['value'] for i in soup.select('input.aspNetDisabled')])

Specific items:

soup = bs(your_html, 'lxml')

items = ['"Class ID:"','"Serial Number:"','"Hostname:"']
items = ','.join(items)
nodes = [i['value'] for i in soup.select(f'label:contains({items}) + .aspNetDisabled')]
headers =  [i.text for i in soup.select(f'label:contains({items})')]

with open("data.csv", "w", encoding="utf-8-sig", newline='') as csv_file:
    w = csv.writer(csv_file, delimiter = ",", quoting=csv.QUOTE_MINIMAL)
    w.writerow(headers)
    w.writerow(nodes)

edited Nov 1, 2019 at 4:05

answered Oct 19, 2019 at 21:12

QHarr

84.5k14 gold badges58 silver badges105 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

naruto Over a year ago

This is working if that has value ,but sometimes i dont have value in it .Is it possible to get the required fields and value like Class ID,Serial Number,Hostname only

QHarr Over a year ago

Do those you list all have value attribute?

naruto Over a year ago

yes i have ,but i dont need all the fields instead i want only few Class ID,Serial Number,Hostname like this to csv

Collectives™ on Stack Overflow

Parse HTML file to excel python

Expected output:

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

Expected output:

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related