Date |
Topics
|
Where to study
(B = book; LN = lecture notes)
|
Additional material |
|
- Presentation of the course
|
|
- Slides
|
October 5, 2020 (2 slots) |
- Basics of system theory
- Concept of system
- Static vs dynamical systems
- Concept of state
- Continuous vs discrete state
- Concept of event
- Time-driven vs event-driven systems
- Systems vs (mathematical) models
- Definition of DES
- State automata as models of DES
- Example: queueing system
| [B] Chapter 1 (except §1.2.7, §1.2.8 and §1.3.5)
[B] Section 2.2.2
[B] Example 2.11
[LN] Chapter 1
| |
|
- Untimed models of DES: state automata (with outputs)
- Graphical representation
- Simulation scheme
- Feasible event sequences
- Exercises on state automata
| [LN] Chapter 2
|
- Exercises (with solutions)
|
October 12, 2020 (2 slots) |
- Exercises on state automata
- Introduction to timed models of DES
- Example: FIFO vs Round-Robin queueing
| [B] Section 5.1
[LN] Section 3.1
|
- Exercises (with solutions)
|
October 15, 2020 (1 slot) |
- Timed models of DES: timed automata
- Clock structure
- Basic examples of event timing dynamics
| [B] Section 5.2 (only §5.2.1)
| |
October 19, 2020 (2 slots) |
- Timed models of DES: timed automata
- Basic event timing mechanism
- Exercises on timed automata
| [B] Section 5.2 (only §5.2.2, §5.2.4 and §5.2.5)
|
- Exercises (with solutions)
|
October 22, 2020 (1 slot) |
- Review of basic concepts of probability theory
| [B] Appendix I (except §I.7 and §I.8)
[LN] Appendix A
|
- Entry test of probability theory
|
October 26, 2020 (2 slots) |
- Uncertainty sources in models of DES
- Models of DES with uncertainty: stochastic timed automata
- Example of analysis of a stochastic timed automaton
| [B] Sections 6.1÷6.5
|
- Example
|
October 29, 2020 (1 slot) |
- Exercises on stochastic timed automata
|
|
- Exercises (with solutions)
|
November 2, 2020 (2 slots) |
- The exponential distribution: definition and properties
- The Poisson counting process
- Stochastic timed automata with Poisson clock structure
- Distribution of residual lifetimes
- Conditional probability of the events
| [B] Sections 6.6÷6.8
|
|
November 5, 2020 (1 slot) |
- Exercises on stochastic timed automata with Poisson clock structure
|
|
- Exercises (with solutions)
|
November 9, 2020 (2 slots) |
- Stochastic timed automata with Poisson clock structure
- Distribution of state holding times
- Exercises on stochastic timed automata and Poisson processes
|
|
- Exercises (with solutions)
|
November 12, 2020 (1 slot) |
- Exercises on stochastic timed automata and Poisson processes
|
|
- Exercises (with solutions)
|
November 16, 2020 (2 slots) |
|
|
|
November 19, 2020 (1 slot) |
- Stochastic timed automata with Poisson clock structure
- Event probabilities P(Ek=e)
- State probabilities P(Xk=x)
- Basics of stochastic processes
- Markov property and Markov processes
| [B] Section 6.2
|
|
November 23, 2020 (2 slots) |
- Continuous-time homogeneous Markov chains
- Chapman-Kolmogorov equations
- Transition rate matrix and its properties
- Graphical representation
- State holding times
- Transition probabilities
- Transient analysis: state probabilities P(X(t)=x)
| [B] Sections 7.1 and 7.3 (from §7.3.1 to §7.3.9)
|
|
November 26, 2020 (1 slot) |
- Continuous-time homogeneous Markov chains
- Classification of states
- Birth-death chains
- Steady state analysis
| [B] Section 7.3 (only §7.3.10)
[B] Section 7.4
|
|
November 30, 2020 (2 slots) |
- Concept of stochastic equivalence of discrete event models
- Stochastic equivalence of:
- Stochastic timed automata with Poisson clock structure
- Continuous-time homogeneous Markov chains
- Exercises on the use of stochastic equivalence in applications
- Review of basic concepts of statistics
- Law of large numbers
- Central limit theorem
|
|
|
December 3, 2020 (1 slot) |
- Review of basic concepts of statistics
- Probability estimation
- Empirical cumulative distribution functions
- Histograms and estimation of probability density functions
|
|
- Matlab files
|
December 7, 2020 (2 slots) |
- Identification of discrete event models from data
- Simulation of stochastic timed automata
- Random number generation
- Sampling of discrete random variables
- Sampling of continuous random variables via the inverse method
|
|
- Matlab files
- Homework
|
December 10, 2020 (1 slot) |
- Queueing theory
- Specification of queueing models
- A/B/m/K notation
- Transient and steady state analysis
- Characterization of steady state
- Little's law
- PASTA property
| [B] Sections from 8.1 to 8.6
|
|
December 14, 2020 (2 slots) |
- Queueing theory
- Exercises on Markovian queueing systems
- Example of As-Is and What-If analysis
|
|
- Exercises (with solutions)
|
December 17, 2020 (1 slot) |
- Discrete-time homogeneous Markov chains
- Chapman-Kolmogorov equations
- Transition probability matrix and its properties
- State probabilities and transient analysis
- Graphical representation
- Example: a simple phone-call process
| [B] Sections 7.1 and 7.2 (from §7.2.1 to §7.2.7, except §7.2.5)
|
|
December 21, 2020 (2 slots) |
- Discrete-time homogeneous Markov chains
- State holding times
- Classification of states
- Birth-death chains
- Steady state analysis
- Exercises on discrete-time homogeneous Markov chains
| [B] Section 7.2 (§7.2.5 and from §7.2.8 to §7.2.11)
|
- Exercises (with solutions)
- Additional exercises (with solutions)
|
January 7, 2021 (2 slots) |
- Exercises on stochastic timed automata
- Exercises on discrete-time homogeneous Markov chains
|
|
- Exercises
- Additional exercises (with solutions)
|