Using native functions in Android with OpenCV

Question

I want to use OpenCV+Android, using native functions. However I am a little confused how to use bitmaps as parameters and how to return a value of an edited bitmap (or Mat).

So for example I have a native function:

#include <jni.h>
#include <opencv2/core/core.hpp>
#include <opencv2/imgproc/imgproc.hpp>


JNIEXPORT ??? JNICALL Java_com_my_package_name_and_javaclass_myFunction(JNIEnv* env, jobject javaThis, cv::Mat mat1){
    //here will be code to perform filtering, blurring, canny edge detection or similar things.
        //so I want to input a bitmap, edit it and send it back to the Android class.

return ???
    }

So here I am using cv::Mat as a parameter. I know this is wrong, but I am unsure what it should be, and what should be in the correpsonding java class. Should it be a ByteArray? And then in the above native function the parameter would be jByteArray (or similar)?

And for the return object, what should I put? Should this be an array?

Basically what I am looking for is in the Java class I have a Mat (or Bitmap) I send it to the native function for editing and return a nicely edited bitmap.

you can just google about the JNI for this, it's not Android specific and you can use the JNI like always. — axis
– axis, Commented Oct 2, 2012 at 17:32
Thanks. I actually tried Google, and I am still confused. It seems I should be using arrays as parameters, but I am unsure how to do this properly and would like advice. Also I am unsure what to return. — user485498
– user485498, Commented Oct 2, 2012 at 17:36

Tae-Sung Shin · Accepted Answer · 2012-10-03 00:20:47Z

This is the OpenCV Tutorial code for Android. I remember that it took a while for me to understand the JNI convention. Just look into JNI code first

#include <jni.h>
#include <opencv2/core/core.hpp>
#include <opencv2/imgproc/imgproc.hpp>
#include <opencv2/features2d/features2d.hpp>
#include <vector>

using namespace std;
using namespace cv;

extern "C" {
JNIEXPORT void JNICALL Java_org_opencv_samples_tutorial3_Sample3View_FindFeatures(JNIEnv* env, jobject thiz, jint width, jint height, jbyteArray yuv, jintArray bgra)
{
    jbyte* _yuv  = env->GetByteArrayElements(yuv, 0);
    jint*  _bgra = env->GetIntArrayElements(bgra, 0);

    Mat myuv(height + height/2, width, CV_8UC1, (unsigned char *)_yuv);
    Mat mbgra(height, width, CV_8UC4, (unsigned char *)_bgra);
    Mat mgray(height, width, CV_8UC1, (unsigned char *)_yuv);

    //Please make attention about BGRA byte order
    //ARGB stored in java as int array becomes BGRA at native level
    cvtColor(myuv, mbgra, CV_YUV420sp2BGR, 4);

    vector<KeyPoint> v;

    FastFeatureDetector detector(50);
    detector.detect(mgray, v);
    for( size_t i = 0; i < v.size(); i++ )
        circle(mbgra, Point(v[i].pt.x, v[i].pt.y), 10, Scalar(0,0,255,255));

    env->ReleaseIntArrayElements(bgra, _bgra, 0);
    env->ReleaseByteArrayElements(yuv, _yuv, 0);
}
}

and then Java code

package org.opencv.samples.tutorial3;

import android.content.Context;
import android.graphics.Bitmap;

class Sample3View extends SampleViewBase {

    public Sample3View(Context context) {
        super(context);
    }

    @Override
    protected Bitmap processFrame(byte[] data) {
        int frameSize = getFrameWidth() * getFrameHeight();
        int[] rgba = new int[frameSize];

        FindFeatures(getFrameWidth(), getFrameHeight(), data, rgba);

        Bitmap bmp = Bitmap.createBitmap(getFrameWidth(), getFrameHeight(), Bitmap.Config.ARGB_8888);
        bmp.setPixels(rgba, 0/* offset */, getFrameWidth() /* stride */, 0, 0, getFrameWidth(), getFrameHeight());
        return bmp;
    }

    public native void FindFeatures(int width, int height, byte yuv[], int[] rgba);

    static {
        System.loadLibrary("native_sample");
    }
}

ArtemStorozhuk · Accepted Answer · 2012-10-02 18:15:30Z

3

You'd better read default OpenCV for Android samples (native).

Of course, you cannot use cv::Mat as parameter, because this is c++ class not java. However if I'm not mistaken you can call c++ class methods from java source (it's also part of JNI).

In your situation you have to use a pointer to image data (it may be uchar* or int* in c++, it's the same as byte[] or int[] in java). For example, you can get pixels from Android Bitmap using method getPixels. And in c++ you can use a specific mat constructor that takes a pointer to image data:

// constructor for matrix headers pointing to user-allocated data
Mat(int _rows, int _cols, int _type, void* _data, size_t _step=AUTO_STEP);
Mat(Size _size, int _type, void* _data, size_t _step=AUTO_STEP);

Hope, it helps.

answered Oct 2, 2012 at 18:15

ArtemStorozhuk

8,7354 gold badges37 silver badges53 bronze badges

3 Comments

user485498 Over a year ago

Thanks this helps. But what should I return? How can I give the processed image back to the Java class?

ArtemStorozhuk Over a year ago

You can create Android Bitmap with constructor that takes int array as parameter - just return processed image data from c++. And again, don't reinvent the wheel - use existed code (android opencv sample native #3).

eldjon Over a year ago

first link is broken

Collectives™ on Stack Overflow

Using native functions in Android with OpenCV

2 Answers 2

Comments

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related