When creating the sound of the stone tower crumbling down, I took a bucket full of rocks varying  in size and dumped them on my driveway. I recorded several takes, so I would have plenty of layers. Using RX's deconstruct module, I was able to remove the bucket's sound by separating the transients. I then pitched them down and added some processing to make them sound bigger.