I've never heard of a skimmer floating in the earth before, but for shifting soil in general, you can use unsorted crushed stone instead of concrete. This is variously known as dense grade aggregate, crusher run, and crush and run. As the latter two names imply, it's the raw product of the rock crusher and is made of limestone gravel of various sizes all the way down to fine dust. The fines will fill in the gaps between the larger bits, and once you tamp it well, it's not likely to shift.
I'd put a few inches of crusher in the bottom of the hole, tamp it level, put the skimmer in, and then backfill partway with more crusher, tamp again, and top off with dirt. The last few inches should be earth to make sure the limestone dust never gets in the pond.