☕

          • 1. Variational AutoEncoder
          • 2. Denoising Diffusion Probabilistic Models (DDPMs)
          • 1. Entropy and Mutual Information
          • 2. Inequalities and Their Consequences
          • 3. Asymptotic Equipartition Property
          • 1. Poses, Coordinate Frames, Rigid Transforms, and 3D Rotations
          • 1. Notation Reference
          • 2. Joint Probability Distributions
          • 4. Maximum Likelihood Estimation
    AboutNotesNewsPublications
    Home

    ❯

    Notes

    ❯

    Information Theory

    Information Theory

    Aug 30, 20261 min read

    Notes on entropy, information, coding, and communication.

    1. Entropy and Mutual Information
    2. Information Inequalities, Data Processing, and Fano’s Inequality
    3. Asymptotic Equipartition Property

    3 items under this folder.

    • Sep 08, 2026

      3. Asymptotic Equipartition Property

      • information-theory
      • probability
      • coding
      • notes
    • Aug 30, 2026

      1. Entropy and Mutual Information

      • information-theory
      • probability
      • notes
    • Aug 30, 2026

      2. Inequalities and Their Consequences

      • information-theory
      • probability
      • statistics
      • notes

    Notes

    Created with Quartz v4.3.1 © 2026