{"id":284,"date":"2024-03-26T18:26:33","date_gmt":"2024-03-26T09:26:33","guid":{"rendered":"https:\/\/mp-superkler.com\/?p=284"},"modified":"2024-07-25T00:54:30","modified_gmt":"2024-07-24T15:54:30","slug":"probability","status":"publish","type":"post","link":"https:\/\/mp-superkler.com\/?p=284","title":{"rendered":"Probability Theory"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Probability theory is the branch of mathematics concerned with analyzing random phenomena and modeling uncertainty. It provides a framework for quantifying and reasoning about the likelihood of events.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Basic Concepts<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Probability Space<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">A probability space is a mathematical construct that models a random experiment. It consists of three components:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Sample Space \\( \\Omega \\):<\/strong> The set of all possible outcomes.<\/li>\n\n\n\n<li><strong>Event \\( E \\):<\/strong> A subset of the sample space, representing one or more outcomes.<\/li>\n\n\n\n<li><strong>Probability Measure \\( P \\):<\/strong> A function that assigns a probability to each event.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Axioms of Probability<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The probability measure \\( P \\) must satisfy the following axioms:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Non-negativity:<\/strong> \\( P(E) \\geq 0 \\) for any event \\( E \\).<\/li>\n\n\n\n<li><strong>Normalization:<\/strong> \\( P(\\Omega) = 1 \\).<\/li>\n\n\n\n<li><strong>Additivity:<\/strong> For any countable sequence of mutually exclusive events \\( E_1, E_2, \\ldots \\),<br>$$ P\\left(\\bigcup_{i=1}^{\\infty} E_i\\right) = \\sum_{i=1}^{\\infty} P(E_i) $$<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\">Conditional Probability<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The conditional probability of an event \\( A \\) given that \\( B \\) has occurred is defined as:<br>$$ P(A|B) = \\frac{P(A \\cap B)}{P(B)} $$<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Bayes&#8217; Theorem<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Bayes&#8217; Theorem relates the conditional probabilities of two events:<br>$$ P(A|B) = \\frac{P(B|A)P(A)}{P(B)} $$<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Random Variables<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">A random variable is a function that assigns a real number to each outcome in the sample space. There are two types of random variables:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Discrete Random Variables:<\/strong> Take on a countable set of values.<\/li>\n\n\n\n<li><strong>Continuous Random Variables:<\/strong> Take on an uncountable set of values.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Probability Distributions<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The probability distribution of a random variable describes how probabilities are distributed over its possible values.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Discrete Distributions<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">For a discrete random variable \\( X \\), the probability mass function (PMF) \\( p(x) \\) gives the probability that \\( X \\) takes the value \\( x \\):<br>$$ p(x) = P(X = x) $$<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Continuous Distributions<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">For a continuous random variable \\( X \\), the probability density function (PDF) \\( f(x) \\) describes the relative likelihood of \\( X \\) taking on a particular value:<br>$$ P(a \\leq X \\leq b) = \\int_a^b f(x) \\, dx $$<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Expectation and Variance<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Expectation<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The expectation (or mean) of a random variable \\( X \\) is a measure of its central tendency. For a discrete random variable:<br>$$ \\mathbb{E}[X] = \\sum_{x} x p(x) $$<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For a continuous random variable:<br>$$ \\mathbb{E}[X] = \\int_{-\\infty}^{\\infty} x f(x) \\, dx $$<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Variance<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The variance of a random variable \\( X \\) measures the spread of its values. It is defined as:<br>$$ \\text{Var}(X) = \\mathbb{E}[(X &#8211; \\mathbb{E}[X])^2] $$<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Using the linearity of expectation:<br>$$ \\text{Var}(X) = \\mathbb{E}[X^2] &#8211; (\\mathbb{E}[X])^2 $$<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Common Probability Distributions<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Binomial Distribution<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">A discrete distribution representing the number of successes in a fixed number of independent Bernoulli trials:<br>$$ P(X = k) = \\frac{n!}{k!(n-k)!} p^k (1-p)^{n-k} $$<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Normal Distribution<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">A continuous distribution characterized by its mean \\( \\mu \\) and variance \\( \\sigma^2 \\):<br>$$ f(x) = \\frac{1}{\\sqrt{2 \\pi \\sigma^2}} e^{-\\frac{(x &#8211; \\mu)^2}{2 \\sigma^2}} $$<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Exponential Distribution<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">A continuous distribution describing the time between events in a Poisson process:<br>$$ f(x) = \\lambda e^{-\\lambda x} $$<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Law of Large Numbers and Central Limit Theorem<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Law of Large Numbers<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The law of large numbers states that as the number of trials increases, the sample mean converges to the expected value:<br>$$ \\frac{1}{n} \\sum_{i=1}^{n} X_i \\rightarrow \\mathbb{E}[X] \\quad \\text{as} \\quad n \\to \\infty $$<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Central Limit Theorem<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The central limit theorem states that the sum (or average) of a large number of independent, identically distributed random variables approaches a normal distribution, regardless of the original distribution:<br>$$ \\frac{\\sum_{i=1}^{n} X_i &#8211; n \\mu}{\\sigma \\sqrt{n}} \\rightarrow N(0, 1) \\quad \\text{as} \\quad n \\to \\infty $$<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Probability theory provides a rigorous foundation for analyzing random phenomena and making inferences about uncertain events. Its concepts and methods are essential for understanding and modeling a wide range of real-world processes.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Probability theory is the branch of mathematics concerned with analyzing random phenomena and modeling uncerta<\/p>\n","protected":false},"author":1,"featured_media":272,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[],"class_list":["post-284","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-probability"],"_links":{"self":[{"href":"https:\/\/mp-superkler.com\/index.php?rest_route=\/wp\/v2\/posts\/284","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mp-superkler.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mp-superkler.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mp-superkler.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mp-superkler.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=284"}],"version-history":[{"count":5,"href":"https:\/\/mp-superkler.com\/index.php?rest_route=\/wp\/v2\/posts\/284\/revisions"}],"predecessor-version":[{"id":482,"href":"https:\/\/mp-superkler.com\/index.php?rest_route=\/wp\/v2\/posts\/284\/revisions\/482"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mp-superkler.com\/index.php?rest_route=\/wp\/v2\/media\/272"}],"wp:attachment":[{"href":"https:\/\/mp-superkler.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=284"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mp-superkler.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=284"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mp-superkler.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}