Turing machines (TMs) are powerful theoretical machines that can simulate any modern computer and serve as a foundation for understanding computability and decidability. They utilize a transition function to manipulate tape symbols, check for string memberships, and perform calculations such as arithmetic operations. Additionally, variations like multi-tape and non-deterministic TMs expand their capabilities, but all are equivalent in recognizing recursively enumerable languages.