kdb c++ interface: create byte list from std::string

Question

The following is very slow for long strings:

std::string s = "long string";
K klist = DBVec::CreateList(KG , s.length());
for (int i=0; i<s.length(); i++)
{
    kG(klist)[i]=s.c_str()[i];
}

It works acceptably fast (<100ms) for strings up to 100k, but slows to a crawl (tens of minutes, possibly hours) for strings of a few million characters. I don't see anything other than kG that can create nonlinearity. I don't see any reason for accessor function kG to be non-constant time, but there is just nothing else in this loop. Unfortunately I don't know how kG works due to lack of documentation.

Question: given a blob of binary data as std::string, what's the efficient way to construct a byte list?

Thomas Smyth · Accepted Answer · 2017-11-27 19:37:25Z

2

kG is a macro defined in k.h which expands to ((x)->G0), i.e. follow the G0 pointer of the K object

http://kx.com/q/d/a/c.htm#Strings documents kp, which creates a K string object directly from a string, so presumably you could do K klist = kp(s.c_str()), which is probably faster

edited Nov 27, 2017 at 19:37

Thomas Smyth

5,6546 gold badges27 silver badges37 bronze badges

answered Jan 9, 2014 at 17:18

Aaron Davies

1,2401 gold badge12 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

user443854 · Accepted Answer · 2014-01-09 00:40:03Z

0

This works:

memcpy(kG(klist), s.c_str(), s.length());

Still wonder why that loop is not O(N).

answered Jan 9, 2014 at 0:40

user443854

7,54313 gold badges56 silver badges64 bronze badges

Collectives™ on Stack Overflow

kdb c++ interface: create byte list from std::string

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related