Define your own constructor that value initializes the array, setting all of its elements to null pointers. That's done by providing () initializer for the member, which also works for arrays.
class A
{
public:
A():my2DArray() { }
private:
B* my2DArray[max1][max2];
};