As long as you have a clean water source, would be okay. The problem comes in sucking sand through the pump. That will take a toll on the impeller and wipe out a pump in fairly short order.
You could suspend the intake in the tank and just run the discharge hose over the side and get quite a bit of it out.
Tougher on a pond, unless you have a pretty long suction hose and can keep the intake in clean water.