C# Custom Encoding and Decoding/Serialization of Values into a Stream

I am stuck with the following problem: I am communicating with another application using TcpClients/Streams.

This application needs input parameters passed to it, encoded in a special way (something along first byte: parameter type identifier, next 4 bytes: content length; next length bytes: content).

The application processes the input and gives me the output back in the same format. My problem is that I usually don't know the exact order of different return values. The application could return nothing, one int, 5 ints, 2ints and an IntArray...

EDIT: To clarify this, I can not change the underlying protocol or the source code of the application I am communicating with!

The problem is that I want to be able to use the params as if they were "native" C# objects. What I tried achieving is the following approach:

https://dotnetfiddle.net/ZjbUix

I am not really sure whether this is a good idea. Maybe it would be a better alternative to have a EncodingStream(NetworkStream) with Write() methods for all possible parameter types, and a DecodingStream(NetworkStream) with GetInt(), GetIntArray() etc. methods. This would, however, more or less disregard the type identifier and could only be prevented with throwing an Exception along "Attempted to read an Int value but found Int Array parameter type".

EDIT: I implemented this version here: https://dotnetfiddle.net/8WVXPz

Another requirement is that it should be possible to easily add new parameter types while at best detecting errors at compile-time. Additionally, I'd prefer a non-reflection solution.

Maybe someone can make up an even better architecture to support this?