Hive SQL, querying a column of arrays using where statement

Question

I'm just curious about filtering my query with a where statement in a table with array column

So for example, I have a column of username and usertype, then each username might have more than one type

So when I use

 select username, collect_set(usertype) as type from table group by username

Then I will have something like: user1,[1,2,3], user2,[3,4,5] and so on. The problem is when I want to filter the result using "where usertype = [3,4,5]". I am not sure how to construct an array to do the filtering and right now I have been using "where usertype[0] = 3 and usertype[1] = 4 " and so on. Anyone has any advise or idea on this matter?

Thanks

Alex Libov · Accepted Answer · 2019-04-21 08:32:38Z

2

You can't compare non-primitive types using =.

One solution is to cast type to string so that the collection would be array<string>, then use concat_ws to compare to a string:

select * from table where concat_ws(' ', usertype) = "1 2 3";

Another option it to write a custom UDF that compares two array<int> arguments.

I found an implementation of several array UDFs, including arrayEquals here.

edited Apr 21, 2019 at 8:32

answered Nov 2, 2016 at 7:07

Alex Libov

1,4912 gold badges12 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

chrishendra93 Over a year ago

Thanks for the help!

Collectives™ on Stack Overflow

Hive SQL, querying a column of arrays using where statement

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related