Information Theory

• The Bottom Line: Information Theory is a powerful mental model that helps an investor separate the vital “signal” of a company's true business value from the distracting and overwhelming “noise” of daily market chatter.
• Key Takeaways:
• What it is: Originally a field of mathematics for communication, it provides a framework for understanding uncertainty and distinguishing meaningful messages (signals) from random interference (noise).
• Why it matters: It provides a structured way to combat emotional decision-making, forcing you to focus on long-term business fundamentals—the bedrock of value_investing—instead of getting swept up in market panic or euphoria.
• How to use it: By consciously identifying signals (like a decade of rising free cash flow) and filtering out noise (like a talking head's stock prediction), you can build a more robust and rational investment process.

Imagine you're at a loud, chaotic party. The music is blasting, people are shouting, and glasses are clinking. Across the room, your trusted business partner is trying to tell you a critical piece of information: the secret formula for a product that will change your company forever. Her words are the signal—the pure, valuable message you need to receive. Everything else—the music, the shouting, the clatter—is the noise. The louder the noise, the harder it is to hear the signal. You might mishear the formula, or miss it entirely. Information Theory, pioneered by the brilliant mathematician Claude Shannon in the 1940s, is the science of this exact problem. It’s the study of how to quantify information, measure uncertainty, and transmit a signal reliably in the presence of noise. For an investor, the stock market is that chaotic party, running 24/7.

• The Signal is the fundamental, tangible information about a business's health and long-term earning power. Think of annual reports, cash flow statements, balance sheet strength, and the durability of its competitive advantage. This information is often quiet, slow-moving, and, frankly, a bit boring.
• The Noise is everything else. It's loud, exciting, and constantly changing. It includes daily stock price fluctuations, sensational news headlines, analyst upgrades and downgrades, social media hype, and grim economic forecasts.

Information Theory also gives us the concept of entropy. In science, entropy is a measure of disorder or randomness. In our world, it's a perfect measure of uncertainty. A simple, predictable business like a company that sells soap has low entropy; its future earnings are relatively easy to forecast. A speculative biotech company with no product and a single drug trial has high entropy; its future is a dizzying cloud of possibilities, from bankruptcy to a ten-thousand-percent return. As investors, our primary job is to be expert signal receivers. We must learn to tune our radios to the frequency of business reality and build filters powerful enough to block out the deafening static of the market.

“The stock market is a device for transferring money from the impatient to the patient.” - Warren Buffett
¹⁾

The principles of Information Theory are not just academic curiosities; they are the very scaffolding upon which a sound value investing philosophy is built. For a value investor, mastering the art of signal detection is everything.

• It Forces a Focus on Intrinsic Value: The ultimate “signal” a value investor is searching for is a company's intrinsic value—what the business is truly worth, independent of its fluctuating stock price. This signal is broadcasted not on cable news, but in the dry, factual pages of a Form 10-K. By viewing financial statements and business analysis as the signal, you naturally gravitate toward what matters, while seeing daily price quotes for what they are: Mr. Market's noisy, emotionally unstable opinion.
• It Is the Antidote to Speculation: Speculators thrive on noise and high entropy. They chase hot tips, trade on rumors, and bet on unpredictable outcomes. A value investor does the opposite. They seek low-entropy situations: stable, understandable businesses with predictable cash flows. The Information Theory framework makes this distinction clear. Are you investing based on a clear signal of durable value, or are you gambling on a noisy, uncertain future?
• It Reinforces the Margin of Safety: In communication engineering, one way to ensure a message gets through noise is through redundancy—repeating the signal. The margin of safety is the investor's form of redundancy. When you buy a company for significantly less than your conservative estimate of its intrinsic value, you are building a buffer. Even if some noise gets through (e.g., you made a small error in your analysis, or the company faces an unexpected headwind), the redundant protection of your low purchase price helps ensure your capital survives.
• It Tames Mr. Market: Benjamin Graham’s allegory of Mr. Market—your manic-depressive business partner who offers you wildly different prices every day—is a perfect illustration of noise. He is pure, unadulterated emotion. Information Theory gives you the intellectual armor to deal with him. When he is euphoric and offering you sky-high prices, you recognize it as noise and ignore him. When he is terrified and offers you his shares for pennies on the dollar, you recognize it as a signal—not about the business, but about the opportunity to buy at a great price.

Ultimately, internalizing the lessons of Information Theory transforms you from a market participant, tossed about by the waves of noise, into a business analyst, calmly observing from the shore and waiting for the signal of a truly great opportunity.

Thinking like an information theorist isn't about complex math; it's about building a disciplined process for consuming and acting on information. It's about creating your own “signal filter.”

Here is a step-by-step method to apply Information Theory to your investment process.

1. Step 1: Explicitly Define Your Signals.

Before you even look at a stock, write down what you consider to be a true signal of a healthy, long-term investment. Your list should be based on business fundamentals.

• Quantitative Signals: Consistent revenue and earnings growth over 5-10 years, strong and growing free cash flow, a healthy balance sheet (low debt), high return on invested capital (ROIC), and reasonable valuation metrics.
• Qualitative Signals: A durable economic_moat, a strong and aligned management team, a simple and understandable business model, and a product or service with lasting power.

1. Step 2: Explicitly Identify the Noise.

Now, make a list of all the inputs you will consciously categorize as noise. Acknowledging them as noise is the first step to ignoring them.

• Common Noise Sources: Daily/weekly/monthly stock price movements, most financial news commentary (“The Dow is down 200 points on fears of…”), analyst price targets, “hot stock” tips from friends or social media, short-term quarterly earnings “misses” or “beats” relative to analyst expectations, and macroeconomic forecasts.

1. Step 3: Choose Your Information Channels Deliberately.

Where you get your information determines the signal-to-noise ratio you experience.

• High-Signal Channels: A company's official filings (10-K, 10-Q), annual shareholder letters (especially from great capital allocators), industry-specific trade journals, and books by legendary investors. These are primary sources.
• High-Noise Channels: Financial news television, Twitter/Reddit feeds, and “market summary” sections of most news websites. These are overwhelmingly secondary sources designed to generate clicks, not insight.

1. Step 4: Respect Your “Channel Capacity.”

Information Theory has a concept called “channel capacity,” which means any channel can only handle a certain amount of information before it gets distorted. Your brain is a channel with limited capacity. Trying to follow 50 stocks, day-trade, and read every news story is a recipe for overload and poor decisions. Instead, operate within your circle of competence, focusing deeply on a handful of businesses you can truly understand. This is quality over quantity.

Once your filter is in place, you can process new information rationally. When news breaks about one of your companies, ask yourself this simple question: “Does this new information fundamentally alter my long-term assessment of the company's earning power and durable competitive advantage?”

• If the answer is YES, it is a SIGNAL. A new, disruptive competitor enters the market, a key patent expires, or management engages in a disastrous, debt-fueled acquisition. These are signals that require you to re-evaluate your entire thesis.
• If the answer is NO, it is almost certainly NOISE. The stock price drops 10% because of a market-wide panic, an analyst downgrades the stock from “Buy” to “Hold,” or the company misses quarterly earnings by a penny because of a temporary supply chain issue. This is noise you should train yourself to ignore.

Let's compare two hypothetical companies through the lens of Information Theory to see how it works in the real world.

This example shows how the Information Theory framework doesn't just define terms; it guides action. It directs your attention toward the predictable, understandable business and away from the speculative, noisy one.

Applying Information Theory as a mental model is incredibly powerful, but it's not a silver bullet. It's essential to understand its strengths and where it can lead you astray.

• Promotes Rationality and Reduces Emotion: Its greatest strength is providing a logical framework to filter the market's emotional chaos. By labeling something as “noise,” you give yourself permission to ignore it, which is a powerful defense against the twin fears of greed and fear.
• Improves Focus and Efficiency: It forces you to concentrate on the few variables that truly drive long-term business success. This prevents “analysis paralysis” from information overload and aligns perfectly with the principle of staying within your circle_of_competence.
• Encourages a Long-Term Mindset: Signals of business value emerge over years, not days. Noise is a high-frequency phenomenon. By default, focusing on signals forces you to adopt the patient, long-term perspective that is the hallmark of successful investing.

• The Signal/Noise Distinction Is Subjective: What one investor considers noise (e.g., a new ESG controversy), another might see as a crucial signal about long-term brand risk. The model is only as good as the investor's judgment in defining the terms.
• Vulnerability to Confirmation Bias: A major pitfall is to label information that contradicts your investment thesis as “noise” while labeling anything that supports it as “signal.” To combat this, you must actively seek out disconfirming evidence and evaluate it honestly.
• Signals Can Change: A great company can deteriorate. A new technology can emerge that permanently erodes a once-powerful economic_moat. What was once noise (a small startup competitor) can become a powerful, thesis-destroying signal. The filter must be dynamic, not static. You must constantly ask, “Has the long-term signal itself changed?”

Understanding Information Theory provides a solid foundation for many other core value investing ideas.

• signal_and_noise: A more direct exploration of this core dichotomy in the investing world.
• mr_market: The personification of market noise and emotional irrationality.
• circle_of_competence: The practice of limiting your investment universe to reduce uncertainty (entropy) and improve your ability to identify true signals.
• margin_of_safety: The ultimate protection against misunderstood signals or unexpected noise.
• intrinsic_value: The fundamental signal that a value investor is always trying to uncover.
• behavioral_finance: The academic study of why human brains are so poorly wired to handle market noise and why models like this are necessary.
• economic_moat: One of the strongest and most reliable signals of a high-quality, low-entropy business.