Randomized and Approximation Algorithms

Advanced Course, 2 + 2

Basic Information

Coordinator:Danupon Nanongkai
Lecturers:Evangelos Kipouridis and Tomasz Kociumaka
Time:Wednesday, 14:00-15:30, E1 4, Room 024
First lecture:October 15th
Office hours:Thursday, 15:30-16:30, E1 4, 3rd floor
Tutors:Anouk Duyster and Yonggang Jiang
Time:Tuesday, 16:15-17:45, E1 4, Room 024
First tutorial:October 21st
Credits:6
Grade formula:The grade is fully determined by the written exam. To qualify for the exam, 50% points in the exercise sheets are required.
Exam:February 16th (14:00-18:00); re-exam March 16th (14:00-18:00)
Prerequisites:Basic knowledge of Algorithms and Probability Theory.
Moodle:https://moodle.mpi-sws.org/course/view.php?id=86
You can view the contents as a guest. If you do not have a Moodle account (needed to submit assignments), fill in this Google form.
Feedbacks:We welcome any anonymous feedback (lectures, tutorials, assignments) through this Google form to help us improve the quality of this course.

Description

Several practically relevant algorithmic problems are unfortunately not known to have deterministic efficient algorithms. More specifically, for several important problems, it is highly unlikely that an efficient algorithm exists that produces an optimal solution on every input instance. Since often such problems are too important to be left unadressed, there are several "relaxations" being used to adress such problems. Two of them are:

  • Approximation Algorithms: One can relax the objective of searching for the optimal solution and instead design an efficient algorithm that produces solutions which are provably "close" in value to the optimal one.
  • Randomized Algorithms, and Probabilistic Analysis of Algorithms: Often, allowing an algorithm to make random choices during its execution leads to significantly more efficient computation (possibly with the drawback that the efficiency is only guaranteed with some probability, or that the output is correct only with some probability). Especially in the context of approximation algorithms, such randomized methods provide powerful tools.  Furthermore, many problems are known to be difficult only in specific, pathetic instances whereas for instances apearing in practice efficient algorithms may exist. Probabilistic analysis of algorithms can, in many cases, give a theoretical explanation of this phenomenon.

In this course we will focus on several techniques for designing and analyzing randomized and approximation algorithms. We will also see a couple of interesting recent results in the area.

 

Tentative Schedule

DateSpeakerTopicAlgorithmsAssignment
Oct 15TomaszIntroduction to the Course and to Randomized AlgorithmsGlobal Min-Cut algorithm. Univariate Polynomial Identity Testing [M+U, Ch. 1]Link
Oct 22TomaszBasic Tools (Independence, Linearity of Expectation) and their ApplicationsMax3SAT approximation, QuickSort analysis [M+U, Ch. 2] Link
Oct 29TomaszConcentration I: Applications of Markov's and Chebyshev's InequalitiesFrom Las Vegas to Monte Carlo, Floyd-Rivest median selection [M+U, Ch. 3] Link
Nov 5TomaszConcentration II: Applications of Chernoff's InequalityFrequency estimation, set discrepancy, maximum bin load [M+U, Ch. 4 & 5.1]Link
Nov 12TomaszHashing: Dictionaries and FiltersPerfect hashing [M+U, Ch. 15.3], partial Bloom filters, Bloom filters via negative correlation; cf. [M+U, Ch. 5.5] 
Nov 19TomaszDerandomization  
Nov 26TomaszRandom Walks  
Dec 3EvangelosIntroduction to Approximation Algorithms. Greedy Algorithms  
Dec 10EvangelosLocal Search  
Dec 17EvangelosDynamic Programming in Approximation Algorithms  
Jan 7EvangelosIntroduction to Linear Programming  
Jan 14EvangelosLinear Programming, Primal-Dual Algorithms  
Jan 21EvangelosLinear Programming, Dual-Fitting  
Jan 28EvangelosLinear Programming, Ellipsoid Method  
Feb 4TBAAdvanced Topics  

Bibliography

  • M. Mitzenmacher, E. Upfal. Probability and Computing. Second edition. Cambridge University Press, 2017.
  • D.P. Williamson, D.B. Shmoys. The Design of Approximation Algorithms. Cambridge University Press, 2011.