Runtime Error for U-SQL Scripts when Repeatedly Executing in Local Environment

Question

We have a simple U-SQL Migration Script that:

Selects data from a staging table in our ADL database
Truncates the staging table
Inserts contents to a persisted table in ADL

When we run this script after running our loading script for our staging table, the script runs successfully and the data is inserted. If I run this same migration script for a second time, however, I get the following error:

"diagnosticCode":195887168,"severity":"Error","component":"RUNTIME","source":"System","errorId":"E_RUNTIME_SYSTEM_INTERNALISSUE","message":"An internal error has been reported [Assertion failed: 'partitionDimension < vertexIndices.size()' at ScopeEngine::GetPartitionIndex(1020),]"

Finally, if I again run the loading script followed by the migration script, all is well again. Can anyone provide more information about what may be wrong?

Yu Dong Yang · Accepted Answer · 2016-08-08 01:41:09Z

1

You will need to rebuild the script before run the second time if the input data changes. There's a limitation in the current local build process, we don't detected input data changes.

The script compilation results depend on input data. If the data changes, we need to recompile the script to generate the correct code.

answered Aug 8, 2016 at 1:41

Yu Dong Yang

2361 silver badge5 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Runtime Error for U-SQL Scripts when Repeatedly Executing in Local Environment

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related