Azure Data Factory Flatten Multi-Array JSON- Issue previewing data in dataflow source

Question

I haven't work much with ADF but I am trying to connect to a REST API and write the data to an Azure SQL DB. I have already created a pipe that copies the JSON retrieved from the Rest API to and writes to Blob storage.

When I create a dataflow and use the Blob as the source, I get a nested table in the data preview tab. Allow schema drift is selected and the JSON settings is set to document of arrays.

All the data is in subarrays under the tickets array. Is there a way to select only the tickets array? If this is possible then I should be able to easily flatten the rest.

Top Level JSON

Sub-Array

Data Preview

Mark Kromer MSFT · Accepted Answer · 2022-05-03 20:40:10Z

1

You can use the Flatten transformation to unroll the tickets array. It is currently showing as drifted in your data preview, so you'll want to first make it part of your metadata. You can do that either through Import Projection on the source projection tab, or use the "Map Drifted" button on your data preview panel.

answered May 3, 2022 at 20:40

Mark Kromer MSFT

3,8681 gold badge12 silver badges11 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

heroyo Over a year ago

Thanks, it worked! Am I able to flatten with one Flatten transformation or will I need two other source/flatten sequences for the two other sub-arrays and then join them all into a flat table?

Mark Kromer MSFT Over a year ago

Add another Flatten to unroll more arrays

Collectives™ on Stack Overflow

Azure Data Factory Flatten Multi-Array JSON- Issue previewing data in dataflow source

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related