Web Scraping with Python
Download as PPTX, PDF0 likes51 views
This document discusses web scraping techniques using Python, including HTTP programming, DOM parsing, and regular expressions. It covers HTTP requests and responses, using common HTTP methods like GET and POST, managing cookies and sessions, and tools for debugging HTTP requests. Python is presented as a programming language that can be used for web scraping by utilizing these techniques to extract and parse data from websites.
Web Scraping with Python
- 1. Web Scraping with Python Softnix Technology Chakrit Phain
- 2. Topic HTML parsing HTTP Programming Methods Cookie Session HTTP Tools Chrome Develop Tool Postman Python Web Scraping Regular Expression DOM parsing
- 3. • HTTP programming • DOM parsing • Text pattern matching (Regular Expression) • Etc. Web Scraping technique https://en.wikipedia.org/wiki/Web_scraping#HTTP_programming
- 5. Methods • Get • Post Cookie Session HTTP Programming https://en.wikipedia.org/wiki/Web_scraping#HTTP_programming
- 6. HTTP Request & Response https://en.wikipedia.org/wiki/Web_scraping#HTTP_programming GET /index.html HTTP/1.1 Host: www.example.com HTTP/1.1 200 OK Date: Mon, 23 May 2005 22:38:34 GMT Content-Type: text/html; charset=UTF-8 Content-Encoding: UTF-8 Content-Length: 138 Last-Modified: Wed, 08 Jan 2003 23:11:55 GMT Server: Apache/1.3.3.7 (Unix) (Red- Hat/Linux) ETag: "3f80f-1b6-3e1cb03b" Accept-Ranges: bytes Connection: close <html> <head> <title>An Example Page</title> </head> <body> Hello World, this is a very simple HTML document. </body> </html> Request Response
- 7. Hand On #1 http telnet (5mins)
- 10. HTTP Tools
- 11. HTTP Tools
- 12. Hand On #2 Session Hijack (5mins)