1) ASM can enforce WebSocket protocol compliance through checks like validating the handshake process and framing.
2) It can also enforce the payload of WebSocket messages by checking for attack signatures in plain text, validating the structure of JSON payloads, and enforcing length limits on binary payloads.
3) The document outlines various violations that ASM can detect like problems with the handshake, framing, payload type mismatches, and illegal characters. It also discusses related settings like WebSocket URL learning and request logging.