AWS Lambda that parse CloudWatch log Stream

Question

I am writing a AWS Lambda that will process log stream from CloudWatch. I am implementing it in Java. I am struggling with couple of issues:

How to decode and decompressed the logs that are received. In Python following code works:

import json
import base64
import zlib

def stream_gzip_decompress(stream):
    dec = zlib.decompressobj(32 + zlib.MAX_WBITS)  # offset 32 to skip the header
    foo=''
    for chunk in stream:
        rv = dec.decompress(chunk)
        if rv:
            foo += rv
    return foo

def lambda_handler(event, context):
    # Decode and decompress the AWS Log stream to extract json object
    stream=json.dumps(event['awslogs']['data'])
    payload=json.loads(stream_gzip_decompress(stream.decode('base64')))
    print(payload)

How to implement similar functionality in Java?

Also when I try to add external jar org.json for parsing input JSON data. I am getting following error although I tried most of the things that are given on stackoverflow

Error:

{ "errorMessage": "Error loading class UpdateCurrentNotificationStatus: org/json/JSONException",
"errorType": "class java.lang.NoClassDefFoundError" }

Following is the sample code that I am writing:

import java.io.IOException;
import java.io.InputStream;
import java.io.OutputStream;

import org.json.JSONException;
import org.json.JSONObject;

import com.amazonaws.services.lambda.runtime.RequestStreamHandler;
import com.amazonaws.services.lambda.runtime.Context; 

public class UpdateCurrentNotificationStatus implements RequestStreamHandler {
    public void handleRequest(InputStream inputStream, OutputStream outputStream, Context context)
            throws IOException {
        int letter;
        while((letter = inputStream.read()) != -1)
        {
            //outputStream.write(Character.toUpperCase(letter));
            JSONObject json = new JSONObject(letter);
            try {
              String stream = json.getString("awslogs");
              System.out.println(stream);
          } catch (JSONException e) {
              // TODO Auto-generated catch block
              e.printStackTrace();
          }
        }
    }
}

Can somebody help me with this?

Thank You,

Prasad

Hi, I am using Eclipse. When I add external Jar to my build path and upload project jar on AWS Lambda and test it I am getting this error. — Prasad Pande
– Prasad Pande, Commented Nov 9, 2016 at 17:46
This seems more like a question concerning eclipse more than it pertains to aws stuff. Try seeing if this question solves your problem — smac89
– smac89, Commented Nov 9, 2016 at 17:54

Max · Accepted Answer · 2018-05-04 15:09:46Z

What you need to do is to accept CloudWatchLogsEvent as input param.

    public class Testing implements RequestHandler<CloudWatchLogsEvent, String> {


        public String handleRequest(CloudWatchLogsEvent request, Context context){
            context.getLogger().log(request.toString());
            String timeStamp = new SimpleDateFormat("yyyy-MM-dd_HH:mm:ss").format(Calendar.getInstance().getTime());
            context.getLogger().log("Invocation started: " + timeStamp);

            context.getLogger().log(request.toString());

            timeStamp = new SimpleDateFormat("yyyy-MM-dd_HH:mm:ss").format(Calendar.getInstance().getTime());
            context.getLogger().log("Invocation completed: " + timeStamp);
            return "completed";
        }
}

Remember this will print the encoded base 64 string which is gzipped as well. Which you'll have to decode and unzip. There are example available on web on how to do that so I'll not dig into that. One eg is here Decode Base64 encoded ZIP archive (GZIP).

Collectives™ on Stack Overflow

AWS Lambda that parse CloudWatch log Stream

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related