For me the worst is putting something coherent together. Material is never a problem, but turning it into something coherent and interesting, and not making every paragraph a research project that reinvents metaphysics from the ground up is the worst.