The infrastructure and building sectors want a more reliable pipeline of work, a new survey has found.