remove the extra branch from singularity build

2 jobs for dask_qt_fix in 10 minutes and 25 seconds (queued for 3 seconds)