np.matrix is not only slow, but it is an ill-behaved sequence:
m[0].ndim == m.ndim == 2

This causes problems when converting a numpy matrix to a tinyarray.

Instead of a tuple of tuples of python integers, return a list of numpy arrays.
Initialize the arrays by memcpy.

There is no point in converting that purpose-made list into a tuple.