That is generally true in a new subdivision, but it certainly isn't true when you have a big hole dug in your small backyard. Because of the layout of our yard, the bog and waterfall were already elevated, so we needed exactly zero cubic yards of the dirt we pulled out of that hole. And I'll second what @morewater - our backyard is a treasure trove of all kinds of construction trash. We had to reconfigure our waterfall to avoid a pile of landscape timber scraps that they buried behind the wall they constructed. Digging them out would have meant relocating power lines - you want to talk about expensive. So we just shook our heads and went to plan B.Dump fees? That's sorta funny because the first thing excavating crews do is scrape off and keep the topsoil for resale later.
Which brings up another cost point - as with any construction budget, add a good percentage for overruns. You just never know what you're going to dig up!