Sometimes without a sign it really can be hard to tell.
.
Where I grew up we called these guys "city workers". The city road crew would show up, five guys would get out of the truck, and four of them would lean on their shovel and watch one guy work.
