Parse nested json as raw string

Question

I am writing a Lambda function that receives an SQS queue object. The SQS sends a json object as a string value to SQS.

When I receive the request in the Lambda, AWS has wrapped it into a new JSON and since the json is a string value it becomes invalid json.

(Example) The json looks like:

{"uuid ":"someuuid"}

We send this as a string to the SQS. AWS then wraps this into something like:

{
  "Records": [
    {
      "messageId": "somemesasgeid",
      "receiptHandle": "MessageReceiptHandle",
      "body": {
          "Message":"{"uuid":"someUuid"}"
      },
      "attributes": {
        "ApproximateReceiveCount": "1",
        "SentTimestamp": "sometimestamp",
        "SenderId": "someid",
        "ApproximateFirstReceiveTimestamp": "sometimestamp"
      },
      "messageAttributes": {},
      "md5OfBody": "somebody",
      "eventSource": "aws:sqs",
      "eventSourceARN": "someARN",
      "awsRegion": "eu-west-1"
    }
  ]
}

Now the body.Message is not valid Json. I tried parsing it as a raw value like How can I include raw JSON in an object using Jackson? but it keeps complaining that it found a u where it was expecting a comma seperate object.

Since I can't post raw json to SQS and have to stringify it, how do I go about parsing this into an object where I can get the json message?

I tried creating a pojo and trying the above link, but jackson keeps complaining about the message variable.

--- update with code ---

private Response HandleServiceRequest(Map<String, Object> input) {

List<String> records = (List<String>) input.get("Records");
    for(String r : records) {
        SqsMessage m = objectMapper.readValue(r, SqsMessage.class);
    }
}

public class SqsMessage {
    // all other values
    SqsBody body;

// getters/setters
}

public class SqsBody {
// all other values
@JsonProperty("Message")
private Object message;
// getters/setters
@JsonRawValue
public String getMessage() {
   message == null ? null : message.toString();
}

public void setMessage(Object message){
this.message = message;
}
}

This is what I have now. I tried changing message to String but that did not change anything.

Could you try to treat that nested json as a string instead of json or a pojo? That way it should get escaped and result into something like "Message":"{\"uuid\":\"someUuid\"}" — Thomas
– Thomas, Commented Jun 21, 2019 at 9:50
I tried that. String and even Object. Jackson will still try to parse it. I could try to escape the json before sending it to SQS though.. Gonna try this — MrM
– MrM, Commented Jun 21, 2019 at 9:53
Jackson shouldn't try to parse a string value unless you tell it that "Message" is something else. Can you provide more information, e.g. a minimal reproducible example? — Thomas
– Thomas, Commented Jun 21, 2019 at 9:55
@Thomas This is what I have now. I tried changing the message to String but that made no difference to me. — MrM
– MrM, Commented Jun 21, 2019 at 10:03
Well, you've posted how you're trying to parse the json but what I was getting at is how do you generate it? "Message":"{"uuid":"someUuid"}" is no valid json so Jackson will have a problem parsing that in any case. You need to have the nested json escaped upon generation, i.e. bring it to a form like I suggested in my first comment - only if the string content is properly escaped will Jackson be able to read the string as a whole. — Thomas
– Thomas, Commented Jun 21, 2019 at 10:10

Thomas · Accepted Answer · 2019-06-21 12:37:33Z

1

The basic problem is that "Message":"{"uuid":"someUuid"}" isn't valid json and thus Jackson cannot parse this part. From a json point of view the value of "Message" is "{" and thus the following uuid causes the error.

To handle that you'll need to properly escape the nested json so that it looks like any other string to Jackson, i.e. you'd want to get something like this:

"Message":"{\"uuid\":\"someUuid\"}"

Here the value of "Message" is "{\"uuid\":\"someUuid\"}" and thus Jackson can take that string and handle it further (put it into a string or unescape and parse).

That means you shouldn't try to tackle the problem at the parsing side but at the generation side, i.e. where the request body for HandleServiceRequest(...) is being created.

answered Jun 21, 2019 at 12:37

Thomas

88.9k13 gold badges126 silver badges162 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Parse nested json as raw string

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related