removing optional dependencies

Looking at the requirements, we really only need scipy and sortedcontainers (numpy is a dependency of scipy already).

The rest (holoviews, ipython, ipyparallel, distributed) shouldn't be required. To make all these optional, we can enclose all corresponding imports into try-catch.