TELE3113 Analogue and Digital
      Communications
       Introduction to Communications

                      Wei Zhang
                 w.zhang@unsw.edu.au


School of Electrical Engineering and Telecommunications
          The University of New South Wales
Outline

 Introduction to Communications
 Review of Probability Theory and Random Process




                                     TELE3113 - Introduction to Communications. July 28, 2009. – p.1/2
History of Radio

Radio is the transmission of signals, by modulation of
electromagnetic (EM) waves with frequencies below those of
visible light. The history of radio can be seen to have three
distinct phases:
    EM waves and experimentation;
    wireless communication and technical development;
    and radio broadcasting and commercialization




                                            TELE3113 - Introduction to Communications. July 28, 2009. – p.2/2
History of Radio - Phase I
EM waves and experimentation
   1820 Hans Christian Orsted discovered the relationship
   between electricity and magnetism in an experiment.
   1831 Michael Faraday discovered EM induction and
   proposed Faraday’s law.
   1873 Maxwell first described the theoretical basis of the
   propagation of EM waves. Maxwell equations.
   1886 to 1888: Hertz validated Maxwell’s theory through
   experiments.



                                          TELE3113 - Introduction to Communications. July 28, 2009. – p.3/2
History of Radio - Phase II
Wireless communication and technical development
    1893 Telsa first demonstrated a wireless radio system.
    1894 Oliver Lodge demonstrated the reception of Morse
    code using a radio system.
    1896 Marconi established the first radio station in England.
    1906 Fessenden made the first radio audio broadcast.
    1912 The RMS Titantic was equipped with two Marconi
    radios.




                                           TELE3113 - Introduction to Communications. July 28, 2009. – p.4/2
History of Radio - Phase III
Radio broadcasting and commercialization:
    1920 The first radio news program was broadcast in Detroit.
    1920 Radio was first used to transmit pictures as television.
    1930 Frequency Modulation (FM) was invented.
    1963 Color television was commercially transmitted.
    1990- Beginning of Digital Era.




                                            TELE3113 - Introduction to Communications. July 28, 2009. – p.5/2
A Communication System

                        Message
  Input
                         signal                 Transmitted
 message
              Input                                signal
                                  Transmitter
           transducer


                                                                                  Additive noise,
                                                         Channel                    Interference,
                                                                                  Distortion due to
                        Message                                                    bandlimiting,
 Output
                         signal                                                   EM discharges,
 message
             Output                                                                      etc.
                                   Receiver
           transducer                            Received
                                                  signal




                                                        TELE3113 - Introduction to Communications. July 28, 2009. – p.6/2
Message Signal

 Analog signal is a continuous function of time.
 Examples: speech, sound, AM/FM radio
 Digital signal is a sequence of symbols which are selected
 from a finite set of discrete elements.
 Examples: bit stream {11010111001 · · · }, CD audio, video on
 DVD




                                         TELE3113 - Introduction to Communications. July 28, 2009. – p.7/2
Input Transducer

 Converts message produced by a source to an electric
 signal (voltage or current).
 Example: speech waves are converted by a microphone to
 voltage variations.




                                      TELE3113 - Introduction to Communications. July 28, 2009. – p.8/2
Transmitter
 Processes the message signal to a transmitted signal
 suitable for transmission over channel.
 Commonly used transmission techniques include:
 modulation, coding, amplifier, filtering, etc.




                                       TELE3113 - Introduction to Communications. July 28, 2009. – p.9/2
Channel
 The transmission medium that connects transmitter and
 receiver, such as radio over the air, cable, copper wired
 lines, optical fibre, etc.
 Signals undergo degradation whilst traveling through
 channel
 Degradation may result from noise, interference, fading,
 multipath, distortion from band-limiting, shadowing, etc.




                                        TELE3113 - Introduction to Communications. July 28, 2009. – p.10/2
Receiver

 Extracts desired message from the received signal.
 Usually includes decoding, demodulation, amplification and
 filtering, etc.




                                      TELE3113 - Introduction to Communications. July 28, 2009. – p.11/2
Output Transducer

 Converts the electric signal into the form desired by user,
 such as TV or audio.




                                         TELE3113 - Introduction to Communications. July 28, 2009. – p.12/2
Communication Resources

Two primary resources for communications:
    Transmitted power: the average power of the transmitted
    signal.
    Channel bandwidth: width of the passband of the channel.
Two important system-design parameters :
    Signal-to-Noise Ratio (SNR)
    Channel bandwidth

The design of a communication system boils down to a tradeoff
between signal-to-noise ratio and channel bandwidth.

                                           TELE3113 - Introduction to Communications. July 28, 2009. – p.13/2
Free-Space Link Budget
Let the transmitting source radiate a total power PT . The
received power PR at a distance r is given by
                                            2
                                       λ
                    PR = PT GT GR
                                      4πr

where
    GT : the gain of transmitting antenna. The product PT GT is
    called the effective isotropic radiated power (EIRP).
    GR : the gain of receiving antenna.
    λ: the wavelength of the transmitted EM wave.


                                            TELE3113 - Introduction to Communications. July 28, 2009. – p.14/2
Link Budget

Another expression of the link budget in dB is given by

                    PR = EIRP + GR − Lp , (dB)

where
    EIRP = 10 log10 (PT GT ).
                     4πr
    Lp = 20 log10     λ    .




                                           TELE3113 - Introduction to Communications. July 28, 2009. – p.15/2
Random Signals and Noise

Random refers to “unpredictable”.
    Signals are random. (e.g., voice or data over Internet)
    Noise is random.
    Although they are random, they can be analyzed in average
    sense.
What is the probability of “heads” in tossing a coin?




                                            TELE3113 - Introduction to Communications. July 28, 2009. – p.16/2
pdf

Denote X a random variable (RV). The probability distribution
function FX (x) is
                       FX (x) = P [X ≤ x].
Note
    FX (x) is a function of x, not X.
    0 ≤ FX (x) ≤ 1.
If X is a continuous-valued RV, then the probability density
function is
                                 ∂
                       fX (x) =     FX (x).
                                 ∂x


                                             TELE3113 - Introduction to Communications. July 28, 2009. – p.17/2
Joint Distribution

 Consider two RVs X and Y . The joint probability distribution
 function FX,Y (x, y) is

                 FX,Y (x, y) = P [X ≤ x, Y ≤ y].

 The joint probability density function is

                                 ∂ 2 FX,Y (x, y)
                   fX,Y (x, y) =                 .
                                      ∂x∂y

 If X and Y are statistically independent, then

                 FX,Y (x, y) = FX (x)FY (y).
                  fX,Y (x, y) = fX (x)fY (y).
                                             TELE3113 - Introduction to Communications. July 28, 2009. – p.18/2
Conditional Probability

 Consider two RVs X and Y . The conditional probability of Y
 given X, written as P [Y |X], is given by

                                P [X, Y ]
                     P [Y |X] =           .
                                 P [X]

 Likewise, we have
                                P [X, Y ]
                     P [X|Y ] =           .
                                 P [Y ]

 Bayes’ rule:
                             P [X|Y ]P (Y )
                  P [Y |X] =                .
                                 P [X]

                                         TELE3113 - Introduction to Communications. July 28, 2009. – p.19/2
Expectation

 The statistical average or expectation of a RV X is denoted
 by E[X].
 If X is a discrete RV, the mean µX is given by

                 µX = E[X] =        xP [X = x].
                                X

 If X is a continuous RV with a density function fX (x), the
 expectation of X is given by
                              ∞
                    E[X] =        xfX (x)dx.
                             −∞




                                         TELE3113 - Introduction to Communications. July 28, 2009. – p.20/2
Variance

 The variance of a RV is an estimate of the spread of the
 probability distribution about the mean.
                                       2
 If X is a discrete RV, the variance, σX is given by

        σX = E[(X − µX )2 ] =
         2
                                      (x − µX )2 P [X = x].
                                  X

 If X is a continuous RV with a density function fX (x), the
 variance of X is given by
                         ∞
                  2
                 σX =        (x − µX )2 fX (x)dx.
                        −∞



                                            TELE3113 - Introduction to Communications. July 28, 2009. – p.21/2
Covariance

 The covariance of two RVs X and Y is given by

             Cov(X, Y ) = E[(X − µX )(Y − µY )].

 Further it has (Can you prove this?)

                Cov(X, Y ) = E[XY ] − µX µY ,

 where
                        ∞    ∞
            E[XY ] =             xyfX,Y (x, y)dxdy.
                       −∞   −∞
 .
 If X and Y are independent, then E[XY ] = E[X]E[Y ].

                                        TELE3113 - Introduction to Communications. July 28, 2009. – p.22/2
Gaussian RV

 The density function of a Gaussian RV X is

                         1            (x − µX )2
            fX (x) =            exp −      2                          .
                            2
                         2πσX            2σX

                                     2
 For a special case when µX = 0 and σX = 1, it is called
 normalized Gaussian RV.
 Q-function, defined as
                       1            ∞
               Q(x) = √                 exp(−s2 /2)ds.
                       2π       x

 Q-function can be viewed as the tail probability of the
 normalized Gaussian RV.
                                              TELE3113 - Introduction to Communications. July 28, 2009. – p.23/2
Random Process

 The random process X(t) is viewed as RV in term of time.
 At a fixed tk , X(tk ) is a RV.
 Autocorrelation of the random process is

                  RX (t, s) = E[X(t)X ∗ (s)].

 Wide-sense stationary requires: 1) the mean of the random
 process is a constant independent of time, and 2) the
 autocorrelation E[X(t)X ∗ (t − τ )] = RX (τ ) of the random
 process only depends upon the time difference τ , for all t
 and τ .


                                        TELE3113 - Introduction to Communications. July 28, 2009. – p.24/2

More Related Content

PDF
The Power-Bandwidth Tradeoff in MIMO Systems
PDF
Ii Communications Channel
PDF
E045063032
PDF
Cu stp 02_solar_resource
PDF
L shaped slot loaded semicircular patch antenna for wideband operation
PDF
Cb25464467
PDF
Ch4 linear modulation pg 111
PDF
The Power-Bandwidth Tradeoff in MIMO Systems
Ii Communications Channel
E045063032
Cu stp 02_solar_resource
L shaped slot loaded semicircular patch antenna for wideband operation
Cb25464467
Ch4 linear modulation pg 111

What's hot (11)

PDF
Blind Estimation of Carrier Frequency Offset in Multicarrier Communication Sy...
PDF
Effect of Pump Dithering at Each Stage of Cascaded Fiber Optical Parametric A...
PDF
Lte course
PDF
Poc assinment no 03
PDF
IRJET- Orthogonal Frequency Division Multiplexing (OFDM) based Uplink Multipl...
PPT
Mimo dr. morsi
PDF
Course 10 example application of random signals - oversampling and noise sh...
PDF
Tele3113 wk6tue
PDF
6161103 7.4 cables
PDF
Shielding Equation Derivations For X And Gamma Rays
Blind Estimation of Carrier Frequency Offset in Multicarrier Communication Sy...
Effect of Pump Dithering at Each Stage of Cascaded Fiber Optical Parametric A...
Lte course
Poc assinment no 03
IRJET- Orthogonal Frequency Division Multiplexing (OFDM) based Uplink Multipl...
Mimo dr. morsi
Course 10 example application of random signals - oversampling and noise sh...
Tele3113 wk6tue
6161103 7.4 cables
Shielding Equation Derivations For X And Gamma Rays
Ad

Viewers also liked (20)

PDF
Căn hộ vạn hưng phát quận 8
PPTX
Intro to advertising week 1, class 1 - hmlc
PPTX
Slide bio4206
PPT
Ucp s.tax 2
PDF
ইভটিজিং প্রতিরোধে দক্ষতাভিত্তিক শিক্ষা
PPTX
B2B in Government Organizations
PPTX
Commemoration of the Great War 1914-1918 by David Langford
PDF
Prova elemental 2009_novembre
PDF
РИФ+КИБ 2012 // CPL-Механики // CPA Network Russia (Кира Жесткова)
PPS
Paczka ciasteczek
DOC
323-Boulay
PDF
Lect13
PPTX
Innovation at OnTheWight - Presented at What's next for Community Journalism ...
PDF
B2B Part II
DOCX
Getting Started
PDF
Prova elemental 2008
PPS
Carillon apartment
PDF
মাধ্যমিক স্তরে ভূগোল শিক্ষা ও করণীয়
ODP
Sand
PDF
Chapter4 high-level-design
Căn hộ vạn hưng phát quận 8
Intro to advertising week 1, class 1 - hmlc
Slide bio4206
Ucp s.tax 2
ইভটিজিং প্রতিরোধে দক্ষতাভিত্তিক শিক্ষা
B2B in Government Organizations
Commemoration of the Great War 1914-1918 by David Langford
Prova elemental 2009_novembre
РИФ+КИБ 2012 // CPL-Механики // CPA Network Russia (Кира Жесткова)
Paczka ciasteczek
323-Boulay
Lect13
Innovation at OnTheWight - Presented at What's next for Community Journalism ...
B2B Part II
Getting Started
Prova elemental 2008
Carillon apartment
মাধ্যমিক স্তরে ভূগোল শিক্ষা ও করণীয়
Sand
Chapter4 high-level-design
Ad

Similar to Tele3113 wk2tue (20)

PDF
COMMUNICATION THEORY
PPTX
communication system Introduction - AM
PPTX
PERFORMANCE ANALYSIS OF 2*2 MIMO CHANNEL USING ZF EQUALIZER
PPT
Communication theory
PDF
wireless communication important topics
PDF
notes05.pdf
PDF
Mobile_Lec5
PPT
Ch2-Wireless_Transmission global view and
PDF
Ofdm Detection on Umts Utra-Fdd up-Link and Implementation of the Modulator/ ...
PDF
Lecture 1.pdf communicate system lecture UET TAXILA
PPTX
SIGNAL ANALYSIS am MODULATION downlod ppt
PDF
Tele3113 wk6wed
PPT
Analog communicationintroduction
PDF
Kanal wireless dan propagasi
PPTX
LECTURE 3.pptx
PDF
Lecture 1 introduction and signals analysis
PDF
Popular Interview Wireless Question with Answer
PPTX
Introduction to communication system chapter 1.pptx
PDF
PPT
Communication System
COMMUNICATION THEORY
communication system Introduction - AM
PERFORMANCE ANALYSIS OF 2*2 MIMO CHANNEL USING ZF EQUALIZER
Communication theory
wireless communication important topics
notes05.pdf
Mobile_Lec5
Ch2-Wireless_Transmission global view and
Ofdm Detection on Umts Utra-Fdd up-Link and Implementation of the Modulator/ ...
Lecture 1.pdf communicate system lecture UET TAXILA
SIGNAL ANALYSIS am MODULATION downlod ppt
Tele3113 wk6wed
Analog communicationintroduction
Kanal wireless dan propagasi
LECTURE 3.pptx
Lecture 1 introduction and signals analysis
Popular Interview Wireless Question with Answer
Introduction to communication system chapter 1.pptx
Communication System

More from Vin Voro (20)

PDF
Tele3113 tut6
PDF
Tele3113 tut5
PDF
Tele3113 tut4
PDF
Tele3113 tut1
PDF
Tele3113 tut3
PDF
Tele3113 tut2
PDF
Tele3113 wk11tue
PDF
Tele3113 wk10wed
PDF
Tele3113 wk10tue
PDF
Tele3113 wk11wed
PDF
Tele3113 wk7wed
PDF
Tele3113 wk9tue
PDF
Tele3113 wk8wed
PDF
Tele3113 wk9wed
PDF
Tele3113 wk7wed
PDF
Tele3113 wk7wed
PDF
Tele3113 wk7tue
PDF
Tele3113 wk5tue
PDF
Tele3113 wk4wed
PDF
Tele3113 wk4tue
Tele3113 tut6
Tele3113 tut5
Tele3113 tut4
Tele3113 tut1
Tele3113 tut3
Tele3113 tut2
Tele3113 wk11tue
Tele3113 wk10wed
Tele3113 wk10tue
Tele3113 wk11wed
Tele3113 wk7wed
Tele3113 wk9tue
Tele3113 wk8wed
Tele3113 wk9wed
Tele3113 wk7wed
Tele3113 wk7wed
Tele3113 wk7tue
Tele3113 wk5tue
Tele3113 wk4wed
Tele3113 wk4tue

Recently uploaded (20)

PDF
Physical education and sports and CWSN notes
PDF
Hospital Case Study .architecture design
PPTX
Climate Change and Its Global Impact.pptx
PDF
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
PDF
0520_Scheme_of_Work_(for_examination_from_2021).pdf
PPTX
Thinking Routines and Learning Engagements.pptx
PDF
Farming Based Livelihood Systems English Notes
PPTX
Case Study on mbsa education to learn ok
PDF
Lecture on Viruses: Structure, Classification, Replication, Effects on Cells,...
PDF
Compact First Student's Book Cambridge Official
PDF
Myanmar Dental Journal, The Journal of the Myanmar Dental Association (2015).pdf
PPTX
ACFE CERTIFICATION TRAINING ON LAW.pptx
PDF
African Communication Research: A review
PPTX
Macbeth play - analysis .pptx english lit
PPTX
UNIT_2-__LIPIDS[1].pptx.................
PPTX
2025 High Blood Pressure Guideline Slide Set.pptx
PPTX
Key-Features-of-the-SHS-Program-v4-Slides (3) PPT2.pptx
PDF
Nurlina - Urban Planner Portfolio (english ver)
PDF
Laparoscopic Colorectal Surgery at WLH Hospital
PDF
Disorder of Endocrine system (1).pdfyyhyyyy
Physical education and sports and CWSN notes
Hospital Case Study .architecture design
Climate Change and Its Global Impact.pptx
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
0520_Scheme_of_Work_(for_examination_from_2021).pdf
Thinking Routines and Learning Engagements.pptx
Farming Based Livelihood Systems English Notes
Case Study on mbsa education to learn ok
Lecture on Viruses: Structure, Classification, Replication, Effects on Cells,...
Compact First Student's Book Cambridge Official
Myanmar Dental Journal, The Journal of the Myanmar Dental Association (2015).pdf
ACFE CERTIFICATION TRAINING ON LAW.pptx
African Communication Research: A review
Macbeth play - analysis .pptx english lit
UNIT_2-__LIPIDS[1].pptx.................
2025 High Blood Pressure Guideline Slide Set.pptx
Key-Features-of-the-SHS-Program-v4-Slides (3) PPT2.pptx
Nurlina - Urban Planner Portfolio (english ver)
Laparoscopic Colorectal Surgery at WLH Hospital
Disorder of Endocrine system (1).pdfyyhyyyy

Tele3113 wk2tue

  • 1. TELE3113 Analogue and Digital Communications Introduction to Communications Wei Zhang [email protected] School of Electrical Engineering and Telecommunications The University of New South Wales
  • 2. Outline Introduction to Communications Review of Probability Theory and Random Process TELE3113 - Introduction to Communications. July 28, 2009. – p.1/2
  • 3. History of Radio Radio is the transmission of signals, by modulation of electromagnetic (EM) waves with frequencies below those of visible light. The history of radio can be seen to have three distinct phases: EM waves and experimentation; wireless communication and technical development; and radio broadcasting and commercialization TELE3113 - Introduction to Communications. July 28, 2009. – p.2/2
  • 4. History of Radio - Phase I EM waves and experimentation 1820 Hans Christian Orsted discovered the relationship between electricity and magnetism in an experiment. 1831 Michael Faraday discovered EM induction and proposed Faraday’s law. 1873 Maxwell first described the theoretical basis of the propagation of EM waves. Maxwell equations. 1886 to 1888: Hertz validated Maxwell’s theory through experiments. TELE3113 - Introduction to Communications. July 28, 2009. – p.3/2
  • 5. History of Radio - Phase II Wireless communication and technical development 1893 Telsa first demonstrated a wireless radio system. 1894 Oliver Lodge demonstrated the reception of Morse code using a radio system. 1896 Marconi established the first radio station in England. 1906 Fessenden made the first radio audio broadcast. 1912 The RMS Titantic was equipped with two Marconi radios. TELE3113 - Introduction to Communications. July 28, 2009. – p.4/2
  • 6. History of Radio - Phase III Radio broadcasting and commercialization: 1920 The first radio news program was broadcast in Detroit. 1920 Radio was first used to transmit pictures as television. 1930 Frequency Modulation (FM) was invented. 1963 Color television was commercially transmitted. 1990- Beginning of Digital Era. TELE3113 - Introduction to Communications. July 28, 2009. – p.5/2
  • 7. A Communication System Message Input signal Transmitted message Input signal Transmitter transducer Additive noise, Channel Interference, Distortion due to Message bandlimiting, Output signal EM discharges, message Output etc. Receiver transducer Received signal TELE3113 - Introduction to Communications. July 28, 2009. – p.6/2
  • 8. Message Signal Analog signal is a continuous function of time. Examples: speech, sound, AM/FM radio Digital signal is a sequence of symbols which are selected from a finite set of discrete elements. Examples: bit stream {11010111001 · · · }, CD audio, video on DVD TELE3113 - Introduction to Communications. July 28, 2009. – p.7/2
  • 9. Input Transducer Converts message produced by a source to an electric signal (voltage or current). Example: speech waves are converted by a microphone to voltage variations. TELE3113 - Introduction to Communications. July 28, 2009. – p.8/2
  • 10. Transmitter Processes the message signal to a transmitted signal suitable for transmission over channel. Commonly used transmission techniques include: modulation, coding, amplifier, filtering, etc. TELE3113 - Introduction to Communications. July 28, 2009. – p.9/2
  • 11. Channel The transmission medium that connects transmitter and receiver, such as radio over the air, cable, copper wired lines, optical fibre, etc. Signals undergo degradation whilst traveling through channel Degradation may result from noise, interference, fading, multipath, distortion from band-limiting, shadowing, etc. TELE3113 - Introduction to Communications. July 28, 2009. – p.10/2
  • 12. Receiver Extracts desired message from the received signal. Usually includes decoding, demodulation, amplification and filtering, etc. TELE3113 - Introduction to Communications. July 28, 2009. – p.11/2
  • 13. Output Transducer Converts the electric signal into the form desired by user, such as TV or audio. TELE3113 - Introduction to Communications. July 28, 2009. – p.12/2
  • 14. Communication Resources Two primary resources for communications: Transmitted power: the average power of the transmitted signal. Channel bandwidth: width of the passband of the channel. Two important system-design parameters : Signal-to-Noise Ratio (SNR) Channel bandwidth The design of a communication system boils down to a tradeoff between signal-to-noise ratio and channel bandwidth. TELE3113 - Introduction to Communications. July 28, 2009. – p.13/2
  • 15. Free-Space Link Budget Let the transmitting source radiate a total power PT . The received power PR at a distance r is given by 2 λ PR = PT GT GR 4πr where GT : the gain of transmitting antenna. The product PT GT is called the effective isotropic radiated power (EIRP). GR : the gain of receiving antenna. λ: the wavelength of the transmitted EM wave. TELE3113 - Introduction to Communications. July 28, 2009. – p.14/2
  • 16. Link Budget Another expression of the link budget in dB is given by PR = EIRP + GR − Lp , (dB) where EIRP = 10 log10 (PT GT ). 4πr Lp = 20 log10 λ . TELE3113 - Introduction to Communications. July 28, 2009. – p.15/2
  • 17. Random Signals and Noise Random refers to “unpredictable”. Signals are random. (e.g., voice or data over Internet) Noise is random. Although they are random, they can be analyzed in average sense. What is the probability of “heads” in tossing a coin? TELE3113 - Introduction to Communications. July 28, 2009. – p.16/2
  • 18. pdf Denote X a random variable (RV). The probability distribution function FX (x) is FX (x) = P [X ≤ x]. Note FX (x) is a function of x, not X. 0 ≤ FX (x) ≤ 1. If X is a continuous-valued RV, then the probability density function is ∂ fX (x) = FX (x). ∂x TELE3113 - Introduction to Communications. July 28, 2009. – p.17/2
  • 19. Joint Distribution Consider two RVs X and Y . The joint probability distribution function FX,Y (x, y) is FX,Y (x, y) = P [X ≤ x, Y ≤ y]. The joint probability density function is ∂ 2 FX,Y (x, y) fX,Y (x, y) = . ∂x∂y If X and Y are statistically independent, then FX,Y (x, y) = FX (x)FY (y). fX,Y (x, y) = fX (x)fY (y). TELE3113 - Introduction to Communications. July 28, 2009. – p.18/2
  • 20. Conditional Probability Consider two RVs X and Y . The conditional probability of Y given X, written as P [Y |X], is given by P [X, Y ] P [Y |X] = . P [X] Likewise, we have P [X, Y ] P [X|Y ] = . P [Y ] Bayes’ rule: P [X|Y ]P (Y ) P [Y |X] = . P [X] TELE3113 - Introduction to Communications. July 28, 2009. – p.19/2
  • 21. Expectation The statistical average or expectation of a RV X is denoted by E[X]. If X is a discrete RV, the mean µX is given by µX = E[X] = xP [X = x]. X If X is a continuous RV with a density function fX (x), the expectation of X is given by ∞ E[X] = xfX (x)dx. −∞ TELE3113 - Introduction to Communications. July 28, 2009. – p.20/2
  • 22. Variance The variance of a RV is an estimate of the spread of the probability distribution about the mean. 2 If X is a discrete RV, the variance, σX is given by σX = E[(X − µX )2 ] = 2 (x − µX )2 P [X = x]. X If X is a continuous RV with a density function fX (x), the variance of X is given by ∞ 2 σX = (x − µX )2 fX (x)dx. −∞ TELE3113 - Introduction to Communications. July 28, 2009. – p.21/2
  • 23. Covariance The covariance of two RVs X and Y is given by Cov(X, Y ) = E[(X − µX )(Y − µY )]. Further it has (Can you prove this?) Cov(X, Y ) = E[XY ] − µX µY , where ∞ ∞ E[XY ] = xyfX,Y (x, y)dxdy. −∞ −∞ . If X and Y are independent, then E[XY ] = E[X]E[Y ]. TELE3113 - Introduction to Communications. July 28, 2009. – p.22/2
  • 24. Gaussian RV The density function of a Gaussian RV X is 1 (x − µX )2 fX (x) = exp − 2 . 2 2πσX 2σX 2 For a special case when µX = 0 and σX = 1, it is called normalized Gaussian RV. Q-function, defined as 1 ∞ Q(x) = √ exp(−s2 /2)ds. 2π x Q-function can be viewed as the tail probability of the normalized Gaussian RV. TELE3113 - Introduction to Communications. July 28, 2009. – p.23/2
  • 25. Random Process The random process X(t) is viewed as RV in term of time. At a fixed tk , X(tk ) is a RV. Autocorrelation of the random process is RX (t, s) = E[X(t)X ∗ (s)]. Wide-sense stationary requires: 1) the mean of the random process is a constant independent of time, and 2) the autocorrelation E[X(t)X ∗ (t − τ )] = RX (τ ) of the random process only depends upon the time difference τ , for all t and τ . TELE3113 - Introduction to Communications. July 28, 2009. – p.24/2