It happens. Destruction can not be removed from the game or else you'd have permanent safezone everywhere. Rebuild, but build small and out of the way. If you find something in your base that you did not place, convo me here or DM me in Discord. Do not destroy and items potentially placed by griefers.
