Someone walking nearby will see nothing but remnants of the previous castle. The actual castle being built is covered by an illusion.
Some parts of the mud flats are safe to walk on, other parts are extremely dangerous. Both for the sinking of any heavy weight and the monsters.