Iterating over Torchtext.data.BucketIterator object throws AttributeError 'Field' object has no attribute 'vocab'

Question

When I try to look into a batch, by printing the next iteration of the BucketIterator object, the AttributeError is thrown.

tv_datafields=[("Tweet",TEXT), ("Anger",LABEL), ("Fear",LABEL), ("Joy",LABEL), ("Sadness",LABEL)]
train, vld = data.TabularDataset.splits(path="./data/", train="train.csv",validation="test.csv",format="csv", fields=tv_datafields)

train_iter, val_iter = BucketIterator.splits(
(train, vld),
batch_sizes=(64, 64),
device=-1,
sort_key=lambda x: len(x.Tweet),
sort_within_batch=False,
repeat=False
)
print(next(iter(train_dl)))

mausamsion · Accepted Answer · 2018-10-17 01:08:39Z

1

I am not sure about the specific error you are getting but, in this case, you can iterate over a batch by using the following code:

for i in train_iter:
    print i.Tweet
    print i.Anger
    print i.Fear
    print i.Joy
    print i.Sadness

i.Tweet (also others) is a tensor of shape (input_data_length, batch_size).

So, to view a single batch data (lets say batch 0), you can do print i.Tweet[:,0].

Same goes for val_iter (and test_iter, if needed).

edited Oct 17, 2018 at 1:08

answered Oct 9, 2018 at 2:33

mausamsion

2301 silver badge8 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Iterating over Torchtext.data.BucketIterator object throws AttributeError 'Field' object has no attribute 'vocab'

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related