Data Factory: JSON data is interpreted as expression - ErrorCode=InvalidTemplate, ErrorMessage=Unable to parse expression

Question

I want to copy items from

CosmosDB databaseA/productCollection

to

CosmosDB databaseB/productCollection

Therefore I decided to use Azure Data Factory. I actived also "Export as-is to JSON files or Cosmos DB collection".

The read operation works as expected.
Unfortunately, the write operation stops because of an error related to the data:

ErrorCode=InvalidTemplate, ErrorMessage=Unable to parse expression 'Currency'

{
"ProductName": "Sample",
"Price": {
    "@Currency": "GBP",
    "$": "2624.83"
}

}

I'm not able to change to input data itself. The output data has to equal the input data.

Is there possiblity, that @Currency will not be interpreted as an expression

In ARM, this part is failling:

Price.{@Currency}

Markus Meyer · Accepted Answer · 2022-12-30 08:36:27Z

I had the same problem and I was able to resolve accordingly.

I am using a Pipeline with a Source that is a Dataset referencing JSON data.

Clicking the button highlighted below.

I had to change the JSON from

{
  "name": "SourceDataset",
  "properties": {
    "linkedServiceName": {
      "referenceName": "StorageAccountLink",
      "type": "LinkedServiceReference"
    },
    "annotations": [],
    "type": "Json",
    "typeProperties": {
      "location": {
        "type": "AzureBlobStorageLocation",
        "container": "test-data"
      }
    },
    "schema": {
      "type": "object",
      "properties": {
        "@context": {
          "type": "string"
        },
        "value": {
          "type": "array",
          "items": {
            "type": "object",
            "properties": {
              "id": {
                "type": "string"
              }
            }
          }
        }
      }
    }
  }
}

To ( Escaping the @ with @@ )

{
  "name": "SourceDataset",
  "properties": {
    "linkedServiceName": {
      "referenceName": "StorageAccountLink",
      "type": "LinkedServiceReference"
    },
    "annotations": [],
    "type": "Json",
    "typeProperties": {
      "location": {
        "type": "AzureBlobStorageLocation",
        "container": "test-data"
      }
    },
    "schema": {
      "type": "object",
      "properties": {
        "@@context": {
          "type": "string"
        },
        "value": {
          "type": "array",
          "items": {
            "type": "object",
            "properties": {
              "id": {
                "type": "string"
              }
            }
          }
        }
      }
    }
  }
}

Jay Gong · Accepted Answer · 2020-05-08 14:33:37Z

0

I tried to reproduce your issue but it works for me. I used copy activity to transfer data from account A to account B.

Additional, if this operation is just need to be executed once, please consider using Azure Cosmos DB Migration Tool. It's free for usage. You could export the data from cosmos db A as json file then import it into cosmos db B very simply.Also, it could be executed in the cmd so that it could be made as a scheduled job on the windows system.

answered May 8, 2020 at 14:33

Jay Gong

23.8k2 gold badges30 silver badges32 bronze badges

Collectives™ on Stack Overflow

Data Factory: JSON data is interpreted as expression - ErrorCode=InvalidTemplate, ErrorMessage=Unable to parse expression

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related