SlideShare a Scribd company logo
8
Most read
9
Most read
13
Most read
Combinatorial Optimization
CS-724
Lec-1: Date: 22-02-2021
Dr. Parikshit Saikia
Assistant Professor
Department of Computer Science and Engineering
NIT Hamirpur (HP)
India
Course Information
•Theory
•Day: Monday—Wednesday
•Time: 3-3:35 PM
•Evaluation:
• Quiz + Attendance (At least 75%) + Assignment : 20% of the total
marks
• Mid Sem Exam: 30% of the total marks
• End Sem Exam: 50% of the total marks
Combinatorial Optimization (CO)
• Objective
• To learn how to model problems using mathematical programs.
• To learn how to formulate and solve the traditional problems in combinatorial
optimization using combinatorial algorithm.
• To learn the concept of linear programming and matching algorithms.
Course Outcome
• Students will be able to
• Identify and classify combinatorial optimization problems with real-world
problems
• Identify, classify and implement algorithm to solve combinatorial optimization
problems
• Model problems using linear programming.
• Understand the inherent complexity of problems: Polynomial time, NP-
completeness.
Application of CO
• Algorithm Theory
• Operations Research
• Artificial Intelligence
• Computational Complexity
• Auction Theory
• Software Engineering
• Machine Learning
• Theoretical Computer Science
• …………….
• What do we optimize?
* A cost function: It help us to define which solution is better
(Solution A or Solution B etc)
• How to find the solution having the best cost?
By designing an optimization algorithm.
• Can we decompose the problem into some smaller problems?
By defining optimal sub-structure property
• How shall we search among alternatives?
By using complexity: run time, space required
Optimization Problem
• An instance of an optimization problem is a pair (F, c), where F is any
set, the domain of feasible points; c is the cost function s.t.
c : F → R
The point is to find a point f F s.t.
c(f) ≤ c(y) for all y F
Such a point f is called globally optimal solution.
Optimization Problems
• Categorized into two types
• Those with continuous variables: looking for a set of real numbers
• Those with discrete variables: looking for an object from a finite, or possibly
countably infinite set, typically an integer set, permutation or graphs.
Optimization Problems with Discrete Variables
are called Combinatorial Optimization Problems
Example 1: Minimum spanning problem
Given a graph G=(V,E), w: E → Z+
An instance of MST problem is
F = {all spanning trees (V, E’) with V = {1, 2, ……, n}}
c: (V, E’) → σ𝒆 𝑬′ 𝒘(𝒆)
Here spanning tree means connected and acyclic graph.
Example 2 : Travelling Salesman Problem
We are given an integer n > 0 and the distance between every pair of n
cities in the form of an n x n matrix [di,j], where di,j Z+ . A tour is a
close path that visits every city exactly once. The problem is to find a
tour with minimum total length.
F= {all cyclic permutations π on n cities}
C(π) → σ𝒋 𝒏 𝒅i,j
Here city j is visited after visiting city i
Global Optima
• It is the extrema (minimum or maximum) of the objective function for
the entire input space
• Given an instance (F, c) of an optimization problem, a feasible solution
f is called globally optimal with respect to F if
c(f) ≤ c(g) for all g F
Local optimization
• A local optima is the extrema (minimum or maximum) of
the objective function for a given region of the input
space.
• Given an instance (F, c) of an optimization problem and a
neighborhood N, a feasible solution f is called locally optimal with
respect to N if
c(f) ≤ c(g) for all g N(f)
Here N(f) is defined as a set of points that are close in some
sense to the point f.
Combinatorial optimization CO-1

More Related Content

What's hot (20)

PPTX
Ant colony optimization (aco)
gidla vinay
 
PDF
Parallel-kmeans
Tien-Yang (Aiden) Wu
 
PDF
Linear regression
MartinHogg9
 
PPTX
Convolution Neural Network (CNN)
Suraj Aavula
 
PPT
PSO and Its application in Engineering
Prince Jain
 
PPTX
Particle swarm optimization
Hanya Mohammed
 
PPTX
Particle swarm optimization
Suman Chatterjee
 
PPT
SINGLE-SOURCE SHORTEST PATHS
Md. Shafiuzzaman Hira
 
PPTX
Travelling Salesman Problem
Daniel Raditya
 
PDF
Ant Colony Optimization: The Algorithm and Its Applications
adil raja
 
PPTX
Optimization Shuffled Frog Leaping Algorithm
Uday Wankar
 
PDF
Applying deep learning to medical data
Hyun-seok Min
 
PDF
Presentation on Neural Style Transfer
Sanjoy Datta
 
PPTX
Practical Swarm Optimization (PSO)
khashayar Danesh Narooei
 
PDF
Value Driven Development by Dave Thomas
Naresh Jain
 
PDF
K - Nearest neighbor ( KNN )
Mohammad Junaid Khan
 
PPTX
Page rank algortihm
Siddharth Kar
 
PPT
Ant Colony Optimization presentation
Partha Das
 
PPTX
Fuzzy expert system
Rohit Srivastava
 
PDF
The partial derivative of the binary Cross-entropy loss function
TobiasRoeschl
 
Ant colony optimization (aco)
gidla vinay
 
Parallel-kmeans
Tien-Yang (Aiden) Wu
 
Linear regression
MartinHogg9
 
Convolution Neural Network (CNN)
Suraj Aavula
 
PSO and Its application in Engineering
Prince Jain
 
Particle swarm optimization
Hanya Mohammed
 
Particle swarm optimization
Suman Chatterjee
 
SINGLE-SOURCE SHORTEST PATHS
Md. Shafiuzzaman Hira
 
Travelling Salesman Problem
Daniel Raditya
 
Ant Colony Optimization: The Algorithm and Its Applications
adil raja
 
Optimization Shuffled Frog Leaping Algorithm
Uday Wankar
 
Applying deep learning to medical data
Hyun-seok Min
 
Presentation on Neural Style Transfer
Sanjoy Datta
 
Practical Swarm Optimization (PSO)
khashayar Danesh Narooei
 
Value Driven Development by Dave Thomas
Naresh Jain
 
K - Nearest neighbor ( KNN )
Mohammad Junaid Khan
 
Page rank algortihm
Siddharth Kar
 
Ant Colony Optimization presentation
Partha Das
 
Fuzzy expert system
Rohit Srivastava
 
The partial derivative of the binary Cross-entropy loss function
TobiasRoeschl
 

Similar to Combinatorial optimization CO-1 (20)

PPT
Lecture11
Nv Thejaswini
 
PPT
Ch4: Searching Techniques 6_2018_12_25!05_35_25_PM.ppt
Sasal6
 
PPTX
Convex optmization in communications
Deepshika Reddy
 
PPTX
Undecidable Problems and Approximation Algorithms
Muthu Vinayagam
 
PPTX
dynamic programming complete by Mumtaz Ali (03154103173)
Mumtaz Ali
 
PPTX
ADA_Module 1_MN.pptx- Analysis and design of Algorithms
madhu614742
 
PPT
Chap12 slides
BaliThorat1
 
PPT
chap1211111111111111111111111_slides.ppt
717823p132
 
PDF
bv_cvxslides (1).pdf
SantiagoGarridoBulln
 
PDF
Overview on Optimization algorithms in Deep Learning
Khang Pham
 
PDF
BCS401 ADA First IA Test Question Bank.pdf
VENKATESHBHAT25
 
PPT
Dynamic Programming and Applications.ppt
coolscools1231
 
PPTX
Design and Analysis of Algorithms Lecture Notes
Sreedhar Chowdam
 
PPTX
Undecidable Problems - COPING WITH THE LIMITATIONS OF ALGORITHM POWER
muthukrishnavinayaga
 
PDF
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
The Statistical and Applied Mathematical Sciences Institute
 
PPTX
Linear Programing.pptx
AdnanHaleem
 
Lecture11
Nv Thejaswini
 
Ch4: Searching Techniques 6_2018_12_25!05_35_25_PM.ppt
Sasal6
 
Convex optmization in communications
Deepshika Reddy
 
Undecidable Problems and Approximation Algorithms
Muthu Vinayagam
 
dynamic programming complete by Mumtaz Ali (03154103173)
Mumtaz Ali
 
ADA_Module 1_MN.pptx- Analysis and design of Algorithms
madhu614742
 
Chap12 slides
BaliThorat1
 
chap1211111111111111111111111_slides.ppt
717823p132
 
bv_cvxslides (1).pdf
SantiagoGarridoBulln
 
Overview on Optimization algorithms in Deep Learning
Khang Pham
 
BCS401 ADA First IA Test Question Bank.pdf
VENKATESHBHAT25
 
Dynamic Programming and Applications.ppt
coolscools1231
 
Design and Analysis of Algorithms Lecture Notes
Sreedhar Chowdam
 
Undecidable Problems - COPING WITH THE LIMITATIONS OF ALGORITHM POWER
muthukrishnavinayaga
 
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
The Statistical and Applied Mathematical Sciences Institute
 
Linear Programing.pptx
AdnanHaleem
 
Ad

More from man003 (7)

PDF
Combinatorial optimization CO-3
man003
 
PDF
Combinatorial optimization CO-2
man003
 
PDF
Combinatorial optimization CO-7
man003
 
PDF
Combinatorial optimization CO-6
man003
 
PDF
Combinatorial optimization CO-5
man003
 
PDF
Combinatorial optimization CO-4
man003
 
PPTX
IOT(Internet of Things) Seminar
man003
 
Combinatorial optimization CO-3
man003
 
Combinatorial optimization CO-2
man003
 
Combinatorial optimization CO-7
man003
 
Combinatorial optimization CO-6
man003
 
Combinatorial optimization CO-5
man003
 
Combinatorial optimization CO-4
man003
 
IOT(Internet of Things) Seminar
man003
 
Ad

Recently uploaded (20)

PDF
GTU Civil Engineering All Semester Syllabus.pdf
Vimal Bhojani
 
PDF
MAD Unit - 1 Introduction of Android IT Department
JappanMavani
 
PPTX
美国电子版毕业证南卡罗莱纳大学上州分校水印成绩单USC学费发票定做学位证书编号怎么查
Taqyea
 
PPTX
原版一样(Acadia毕业证书)加拿大阿卡迪亚大学毕业证办理方法
Taqyea
 
PDF
Viol_Alessandro_Presentazione_prelaurea.pdf
dsecqyvhbowrzxshhf
 
PPTX
Damage of stability of a ship and how its change .pptx
ehamadulhaque
 
PPTX
DATA BASE MANAGEMENT AND RELATIONAL DATA
gomathisankariv2
 
PPTX
Solar Thermal Energy System Seminar.pptx
Gpc Purapuza
 
PPTX
GitOps_Without_K8s_Training_detailed git repository
DanialHabibi2
 
PDF
MAD Unit - 2 Activity and Fragment Management in Android (Diploma IT)
JappanMavani
 
PDF
Set Relation Function Practice session 24.05.2025.pdf
DrStephenStrange4
 
PPTX
Hashing Introduction , hash functions and techniques
sailajam21
 
DOCX
CS-802 (A) BDH Lab manual IPS Academy Indore
thegodhimself05
 
PPTX
Mechanical Design of shell and tube heat exchangers as per ASME Sec VIII Divi...
shahveer210504
 
PDF
AI TECHNIQUES FOR IDENTIFYING ALTERATIONS IN THE HUMAN GUT MICROBIOME IN MULT...
vidyalalltv1
 
PDF
Design Thinking basics for Engineers.pdf
CMR University
 
PDF
Basic_Concepts_in_Clinical_Biochemistry_2018كيمياء_عملي.pdf
AdelLoin
 
PPTX
265587293-NFPA 101 Life safety code-PPT-1.pptx
chandermwason
 
PPTX
Shinkawa Proposal to meet Vibration API670.pptx
AchmadBashori2
 
PDF
Zilliz Cloud Demo for performance and scale
Zilliz
 
GTU Civil Engineering All Semester Syllabus.pdf
Vimal Bhojani
 
MAD Unit - 1 Introduction of Android IT Department
JappanMavani
 
美国电子版毕业证南卡罗莱纳大学上州分校水印成绩单USC学费发票定做学位证书编号怎么查
Taqyea
 
原版一样(Acadia毕业证书)加拿大阿卡迪亚大学毕业证办理方法
Taqyea
 
Viol_Alessandro_Presentazione_prelaurea.pdf
dsecqyvhbowrzxshhf
 
Damage of stability of a ship and how its change .pptx
ehamadulhaque
 
DATA BASE MANAGEMENT AND RELATIONAL DATA
gomathisankariv2
 
Solar Thermal Energy System Seminar.pptx
Gpc Purapuza
 
GitOps_Without_K8s_Training_detailed git repository
DanialHabibi2
 
MAD Unit - 2 Activity and Fragment Management in Android (Diploma IT)
JappanMavani
 
Set Relation Function Practice session 24.05.2025.pdf
DrStephenStrange4
 
Hashing Introduction , hash functions and techniques
sailajam21
 
CS-802 (A) BDH Lab manual IPS Academy Indore
thegodhimself05
 
Mechanical Design of shell and tube heat exchangers as per ASME Sec VIII Divi...
shahveer210504
 
AI TECHNIQUES FOR IDENTIFYING ALTERATIONS IN THE HUMAN GUT MICROBIOME IN MULT...
vidyalalltv1
 
Design Thinking basics for Engineers.pdf
CMR University
 
Basic_Concepts_in_Clinical_Biochemistry_2018كيمياء_عملي.pdf
AdelLoin
 
265587293-NFPA 101 Life safety code-PPT-1.pptx
chandermwason
 
Shinkawa Proposal to meet Vibration API670.pptx
AchmadBashori2
 
Zilliz Cloud Demo for performance and scale
Zilliz
 

Combinatorial optimization CO-1

  • 1. Combinatorial Optimization CS-724 Lec-1: Date: 22-02-2021 Dr. Parikshit Saikia Assistant Professor Department of Computer Science and Engineering NIT Hamirpur (HP) India
  • 2. Course Information •Theory •Day: Monday—Wednesday •Time: 3-3:35 PM •Evaluation: • Quiz + Attendance (At least 75%) + Assignment : 20% of the total marks • Mid Sem Exam: 30% of the total marks • End Sem Exam: 50% of the total marks
  • 3. Combinatorial Optimization (CO) • Objective • To learn how to model problems using mathematical programs. • To learn how to formulate and solve the traditional problems in combinatorial optimization using combinatorial algorithm. • To learn the concept of linear programming and matching algorithms.
  • 4. Course Outcome • Students will be able to • Identify and classify combinatorial optimization problems with real-world problems • Identify, classify and implement algorithm to solve combinatorial optimization problems • Model problems using linear programming. • Understand the inherent complexity of problems: Polynomial time, NP- completeness.
  • 5. Application of CO • Algorithm Theory • Operations Research • Artificial Intelligence • Computational Complexity • Auction Theory • Software Engineering • Machine Learning • Theoretical Computer Science • …………….
  • 6. • What do we optimize? * A cost function: It help us to define which solution is better (Solution A or Solution B etc) • How to find the solution having the best cost? By designing an optimization algorithm. • Can we decompose the problem into some smaller problems? By defining optimal sub-structure property • How shall we search among alternatives? By using complexity: run time, space required
  • 7. Optimization Problem • An instance of an optimization problem is a pair (F, c), where F is any set, the domain of feasible points; c is the cost function s.t. c : F → R The point is to find a point f F s.t. c(f) ≤ c(y) for all y F Such a point f is called globally optimal solution.
  • 8. Optimization Problems • Categorized into two types • Those with continuous variables: looking for a set of real numbers • Those with discrete variables: looking for an object from a finite, or possibly countably infinite set, typically an integer set, permutation or graphs. Optimization Problems with Discrete Variables are called Combinatorial Optimization Problems
  • 9. Example 1: Minimum spanning problem Given a graph G=(V,E), w: E → Z+ An instance of MST problem is F = {all spanning trees (V, E’) with V = {1, 2, ……, n}} c: (V, E’) → σ𝒆 𝑬′ 𝒘(𝒆) Here spanning tree means connected and acyclic graph.
  • 10. Example 2 : Travelling Salesman Problem We are given an integer n > 0 and the distance between every pair of n cities in the form of an n x n matrix [di,j], where di,j Z+ . A tour is a close path that visits every city exactly once. The problem is to find a tour with minimum total length. F= {all cyclic permutations π on n cities} C(π) → σ𝒋 𝒏 𝒅i,j Here city j is visited after visiting city i
  • 11. Global Optima • It is the extrema (minimum or maximum) of the objective function for the entire input space • Given an instance (F, c) of an optimization problem, a feasible solution f is called globally optimal with respect to F if c(f) ≤ c(g) for all g F
  • 12. Local optimization • A local optima is the extrema (minimum or maximum) of the objective function for a given region of the input space. • Given an instance (F, c) of an optimization problem and a neighborhood N, a feasible solution f is called locally optimal with respect to N if c(f) ≤ c(g) for all g N(f) Here N(f) is defined as a set of points that are close in some sense to the point f.