Extracting a table data from Webpage using Selenium webdriver

Question

Am using Selenium webdriver (in Eclipse) to automate a web app however now the requirement is to capture a table data displayed in one of the html page. I tried with the solutions given here, here and few other websites however our webpage seems to have bit different way of displaying table

Tried to get the values using div class names as String Text = driver.findElements(By.xpath("//div[@class='ag-row ag-row-even ag-row-level-0']//tr")).get(0).getText(); however it did not work, Index out of bounds exception is thrown

What exactly are you trying to fetch? WW_SALES or APJ?

JRodDynamite
– JRodDynamite

2015-12-02 06:37:36 +00:00
Commented Dec 2, 2015 at 6:37 — JRodDynamite
– JRodDynamite, Commented Dec 2, 2015 at 6:37
@JasonEstibeiro: Table as whole

Vinod
– Vinod

2015-12-02 08:33:11 +00:00
Commented Dec 2, 2015 at 8:33 — Vinod
– Vinod, Commented Dec 2, 2015 at 8:33

Cosmin · Accepted Answer · 2015-12-02 09:18:32Z

1

From what I see, you seem to have a custom table built. And from the HTML excerpt in the attached image, the structure is something like:

<div class="ag-body-container" ...>
    <div class="row_1_class" ...>
        <div class="column_1_class" ...>
        <div class="column_2_class" ...>
        <div class="column_3_class" ...>
        <div class="column_4_class" ...>
        ... etc
    <div class="row_2_class" ...>
        <div class="column_1_class" ...>
        <div class="column_2_class" ...>
        <div class="column_3_class" ...>
        <div class="column_4_class" ...>
        ... etc

But your xPath is assuming that you have table rows (and I'm guessing maybe table cells afterwards):

By.xpath("//div[@class='ag-row ag-row-even ag-row-level-0']//tr")

causing your array to be empty (funny enough that you don't get a NoSuchElement exception, perhaps there are some tr tags somewhere in your html tree).

Now, I'm not sure what data you're trying to extract from that table, but your best try would be to get all the rows, based on the class attribute and for each row to get all columns data based on, again, class attribute (or you can even use the col attribute for these).

EDIT: To get all the elements, you could take all rows, and afterwards for each row get all column data:

//Get all the rows from the table
List<WebElement> rows = driver.findElements(By.xpath("//div[contains(@class, 'ag-row')));

//Initialize a new array list to store the text
List<String> tableData = new ArrayList<String>();

//For each row, get the column data and store into the tableData object
for (int i=0; i < rows.size(); i++) {
    //Since you also have some span tags inside (and maybe something else)
    //we first get the div columns
    WebElement tableCell = rows.get(i).findElements(By.xpath("//div[contains(@class, 'ag-cell')]"));
    tableData.add(tableCell.get(0).getText());
}

You could also store your data into bi-directional array (or any of this sort) and afterwards access the data based on the row and column number position.

edited Dec 2, 2015 at 9:18

answered Dec 2, 2015 at 8:05

Cosmin

2,4043 gold badges26 silver badges41 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Vinod Over a year ago

Am trying to read all the table data as I need compare this data with some other table data with same structure.

Cosmin Over a year ago

@Vinod Updated my answer. This way you will have a list with containing all the data from your table.

Witold Krak · Accepted Answer · 2015-12-02 07:35:52Z

0

I'm not sure but probably your webElements array is empty that why You get Index out of bounds exception.

If you try to get value from entire WW_SALES row I suppose that find_elements should pint out parent div - class="ag-row ag-row-even ag-row-level-0"

It is only my supposition based on description and image attached.

answered Dec 2, 2015 at 7:35

Witold Krak

135 bronze badges

Collectives™ on Stack Overflow

Extracting a table data from Webpage using Selenium webdriver

2 Answers 2

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related