The Applied AI Thoughts for Realization Blog Post 3

The Impact Layers — Why AI Models Alone Don’t Deliver Value

Introduction

This is the third post in the Applied AI Thoughts for Realization series.

In the first post, Why AI Feels Overwhelming, we tackled the problem of “AI Fatigue” and the trap of Tactical Thinking—chasing the latest tools without a plan. We argued for a shift to Structural Thinking, focusing on the architecture of problems rather than just the features of models.

In the second post, A Simple Mental Model — 4 Pillars, we established the horizontal dimension of our mental model. We categorized the AI landscape into 4 Domain Pillars—Consumer, Enterprise, Science, and Physical AI—and used the “Engine vs. Vehicle” analogy to show why a “Sports Car” strategy (Consumer) fails when you need a “Cargo Train” solution (Enterprise).

With the understanding of the 4 Pillars of different AI ecosystem and how the application of AI varies across the pillars its critical to understand what is required to deliver value in ech of the pillars. This brings us to the vertical dimension of our framework: The Impact Layers which play critical role in delivering value for each pillar.

Why a Model is not Everything in a AI Solution?

There is often a disconnect when we try to adopt AI. On one hand, we see headlines about models acing exams and writing code. It makes us feel model is what you need to role out a AI driven solution. On the other hand, when Enterprises or Consumers try to start deploying AI based solutions, they end up realizing its much more than just having a model. Enterprises have to address multiple challenges since they face multiple challenges like:

The solution is not responsive and impacts user experience.
Does not produce consistent or reliable results.
It’s not quite fast enough, or it produces results that need a second look.
Integration with existing systems is complex and time-consuming.
The cost of running the solution at scale becomes prohibitively expensive.
It works in demos but fails on real-world, messy data.
Users don’t trust the output enough to act on it without verification.
Models occasionally “hallucinate” or make confident errors.

The question then arises Why is there such a gap between the Intelligence we hear and read about around the Model and realizing the actual Capability we like to experience?

The answer lies in understanding that a “Model” is not the final “Product” or “Solution”.

A model is just raw potential—like a powerful engine sitting on a factory floor. To turn that potential into actual value, it is dependent on several layers of translation. It needs to be hosted on hardware, connected to tools, wrapped in an interface, and integrated into a workflow.

If any one of those layers is weak, the entire experience fails.

The “Iceberg” Theory of AI

A helpful way to visualize this is the Iceberg Theory of AI.

When you interact with an AI application—whether it’s a chatbot, a recommendation engine, or a robot—you are only seeing the tip of the iceberg.

Above the Water (Visible): The Application Layer. This is the user interface, the buttons, and the response time. This is what we judge.
Below the Water (Invisible): The massive infrastructure that supports that tip. This includes the Agents (logic), the Models (intelligence), and the Hardware (compute).

Most of the hype focuses on the “Model” layer deep underwater. But most of the failure happens in the layers between the model and the user. To understand why an AI project succeeds or fails, we need to look below the surface and examine the 5 Layers of AI Impact.

The 5 Layers of AI Impact

Progress in AI doesn’t happen all at once. It moves up this stack, layer by layer.

Layer 1: Hardware (The Foundation)

This is the physical reality of AI. It includes the GPUs (chips) that train models, the data centers that host them, and the edge devices (phones, robots) that run them.

Why it matters: Hardware dictates feasibility. You might have a brilliant AI model, but if it requires $10,000 of compute per hour to run, it cannot be a consumer product. If it takes 5 seconds to respond, it cannot be a self-driving car.
The Constraint: Cost, Energy, and Latency.

Layer 2: Models (The Intelligence)

This is what we typically call “AI.” It includes Large Language Models (LLMs), diffusion models (images), and predictive models. This layer provides the raw reasoning and pattern-matching capability.

Why it matters: Models dictate potential. A smarter model can solve harder problems.
The Constraint: Context Window (memory), Hallucination (accuracy), and Reasoning capability.

Layer 3: Agents & Tools (The Orchestration)

This is the bridge between thought and action. A model can only output text; an Agent can use that text to call a tool—like searching the web, querying a database, or clicking a button.

Why it matters: Agents dictate utility. Without this layer, AI is just a chatbot. With this layer, AI becomes a coworker that can book flights, write code to disk, or control a robot arm.
The Constraint: Reliability. If an agent gets confused and clicks the wrong button, it causes chaos.

Layer 4: Applications (The Interface)

This is the software layer where the human meets the machine. It includes the UI/UX, the workflow integration, and the “vibe” of the product.

Why it matters: Applications dictate adoption. A powerful agent wrapped in a confusing interface will be ignored. The best AI applications often hide the AI completely (e.g., Netflix recommendations).
The Constraint: Friction and Trust. Users must feel in control.

Layer 5: Impact (The Value)

This is the final result. It is not software; it is the change in the real world. Does this tool save time? Does it cure a disease? Does it increase revenue?

Why it matters: Impact dictates sustainability. If an AI project doesn’t generate real value (ROI or societal good), it will eventually be shut down, no matter how cool the technology is.
The Constraint: Human Behavior and Economics. Just because a tool exists doesn’t mean people will change their habits to use it.

The Bottleneck Theory: Why Progress is Non-Linear

The most important thing to understand about these layers is that they must work in coherence.

We cannot simply “upgrade” one layer and expect the whole system to improve. In fact, the system is always limited by its weakest link.

Historical Example: In the 1960s, AT&T invented the Picturephone. It was a brilliant Layer 4 (Application) idea. But Layer 1 (Network Bandwidth) wasn’t ready. The product failed spectacularly.
Current Example: Today, we have incredible Layer 3 (Agent) concepts—AI employees that can do everything. But often, Layer 2 (Model Reliability) isn’t quite there yet; the models still hallucinate occasionally. As a result, the “AI Employee” fails to be reliable enough for critical work.

This interdependence creates a “hurdle for adoption.” You might have the budget and the desire, but if one layer in the stack is immature, your project will stall.

Guidance: The Incremental Approach

So, how do you build when the stack isn’t perfect? You adopt an Incremental Approach.

Instead of trying to build the “Ultimate AI System” that relies on every layer being perfect, you build for the layers that are ready today.

A sample scenario how to Approach incremental Build:

Start with “Human-in-the-Loop” (Layer 3 Lite): Don’t try to build fully autonomous agents yet. Build “Copilots” where the AI drafts the work, and a human reviews it. This mitigates the Layer 2 (Accuracy) risk.
Focus on “Low-Risk” Applications (Layer 4 Safety): Deploy AI in internal brainstorming or draft generation before putting it in front of customers.
Scale as Layers Mature: As models get cheaper (Layer 1 improves) and smarter (Layer 2 improves), you gradually remove the human guardrails.

Advantages:

Immediate Value: You get ROI now, rather than waiting 5 years for “AGI.”
Learning: Your organization learns how to work with AI data and workflows.
Safety: You avoid catastrophic failures by keeping humans involved.

Disadvantages:

Maintenance: You have to constantly update your system as the underlying layers change.
Process Change: It requires changing how people work (training them to use Copilots), which is often harder than just installing software.

By respecting the bottleneck, you build systems that actually work, rather than science fiction that breaks on day one.

Summary

In this post, we explored the vertical dimension of AI execution: the 5 Layers of Impact. We saw how a seemingly simple AI application is actually supported by a complex stack of Hardware, Models, Agents, and Interfaces, and why the “weakest link” in this chain often determines success. But understanding the pillars and layers is only half the picture. In the next post, “How Pillars and Layers Work Together,” we will merge the horizontal Pillars and vertical Layers into a unified perspective. This approach will allow you to predict the behavior, timeline, and constraints of any AI project by understanding how technical layers interact differently across each distinct domain pillars.

Author’s Note: AI-assisted writing tools were used to support the creation of this post. All concepts, perspectives, and the underlying thought process originate from me; the AI served only as a drafting and refinement aid

Previous Post : The Applied AI Thoughts for Realization Blog Post 2

Understanding How AI Thinks (and Where It Doesn’t) – Part 1 Are LLMs Really Understanding?

From a DeepSeek Article to trying to Understand Semantics vs Reasoning Cognitive concepts in AI

Introduction:

This first part captures the beginning of my thought journey. What started as reading an article about DeepSeek’s long-text technique slowly turned into a more fundamental question about what we really mean when we say an AI system “understands.”

A Simple Article That Led to a Big Question

I recently read an article about a research study that questioned a technique used by DeepSeek to help AI models read very long texts. The idea sounded impressive: compress large amounts of text so an AI can process more information at once.

But the researchers found something surprising.

The AI seemed to perform well not because it truly understood the text, but because it relied on patterns it had seen before. When those patterns were disrupted, the model struggled badly.

Even though I already had a working understanding of how LLMs work and Transformer architectures function, something about this finding triggered my interest to learn deeper. If these models were struggling the moment patterns broke down, what exactly were they doing when we say they “understand” text?

This thought triggered a deeper line of questioning in my mind — not about DeepSeek specifically, but about how we interpret progress in GenAI as a whole.

That curiosity naturally led me to ask:

Are modern AI systems really understanding, or are they just very good at guessing?

Once that question formed, it became clear that I needed to first separate two ideas that are often mixed together: semantic understanding and cognitive capability.

Semantic Understanding (Knowing What Something Means)

The first concept I needed clarity on was semantic understanding — a term frequently used but rarely unpacked.

Semantic understanding simply means understanding the meaning.

In everyday language:

It answers the question: “What does this mean?”

Large Language Models (LLMs) are exceptionally strong in this area.

They can:

Read a paragraph and explain it
Summarize documents
Translate languages
Recognize relationships between ideas

For instance, when an AI explains a legal document or summarizes a report, it is exercising semantic understanding. In many ways, this mirrors how humans comprehend words and sentences.

However, as I reflected on the DeepSeek article, an important limitation became obvious.

Semantic understanding stops at meaning.

It explains what is being said, but it does not decide what should happen next.

That realization naturally pushed me toward the next question: if understanding meaning is not enough, what role does reasoning actually play?

Reasoning Models (Thinking Better, Not Acting Better)

At this point, my attention shifted to reasoning models, often marketed as “thinking” AI.

These models are designed to show their work. They break problems into steps, apply logic, and produce more structured explanations.

On the surface, this feels like a major leap forward — and in many ways, it is.

But when I looked more carefully, I noticed that reasoning models still revolve around a single question:

“What is the best response to this input?”

Even with better logic, they still do not:

Choose goals (which is critical for decision-making — without goals, outputs remain just well-organized facts)
Take responsibility for outcomes
Act independently in the world

So while reasoning models think better, they don’t actually decide.

This insight clarified something important for me: reasoning improves semantic structure, but it still operates within the same boundary.

That naturally led to the next question — if neither understanding nor reasoning decides action, then what does?

Part 1 Conclusion: A Boundary Becomes Visible

By the end of this first part, one boundary had become very clear to me.

Understanding meaning and reasoning about it — even in sophisticated ways — does not automatically lead to decision-making or action. Something else is required.

In the next part, I will share my learning about the missing layer: cognitive capability, and why AI agents represent an important architectural shift rather than just a smarter model.

The ERP Awakening: From System of Record to System of Intelligence

The Foundation of Stability

For the last 30 years, the enterprise software industry has focused on one massive engineering achievement: Stability.

Enterprises have implemented SAP, Oracle, and Microsoft Dynamics to serve as the bedrock of their operations. They optimized for the “System of Record”—an immutable, reliable vault where every transaction is stamped, stored, and secured. In this regard, the strategy succeeded. The foundation is solid.

The Challenge: Data Rich, Insight Constrained

However, a vault is designed to keep things in, not necessarily to let insights out.

Today, the modern ERP operates like a massive, well-organized reference library. It contains all the answers—”Why is margin down?”, “Which supplier is late?”—but finding them requires users to walk the aisles, pull specific files (T-Codes), and decode complex rows of data. This architecture creates three distinct layers of operational friction:

The Insight Latency: Business leaders cannot ask questions directly. They often rely on technical intermediaries to build reports, leading to a “time-to-insight” gap of days or weeks.
The Productivity Burden: Skilled professionals spend hours on high-volume, manual tasks—drafting standard emails, visually verifying invoices against purchase orders when there is an exception, or creating requisition forms.
The Execution Variance: Critical workflows can experience delays due to minor “micro-stops”—like a pricing discrepancy of a few cents—that require manual human intervention to clear.

While the enterprise possesses the data, it often lacks the agility to act on it instantly.

Moving from System of Record to System of Intelligence

If the modern ERP is a comprehensive library, the operational bottleneck lies in the absence of a guide. Users are currently forced to act as their own researchers—navigating complex schemas and table structures just to retrieve basic facts.

Hence the strategic value of Generative AI lies not in replacing the library (the ERP), but in providing an intelligent Librarian to navigate it. By layering cognition over storage of records, enterprises can transition from a passive System of Record to an active System of Intelligence.

The “Three Stages” of Change

To make this transition actionable, organizations should view the evolution from a System of Record to a System of Intelligence not as a single leap, but as three distinct stages of maturity. Each stage builds trust and capability, moving from passive insight to active orchestration.

Stage 1: Synthesizing Intelligence (The Conversational Analyst)

Key Objective: To democratize access to complex ERP data, enabling “self-service” analytics without technical dependency.
Strategic Rationale: The primary bottleneck in most enterprises is “Insight Latency.” Business users face a barrier to entry—they do not know the technical schema required to query the ERP. The first step is to remove this friction by allowing natural language interrogation of the data.
Execution Strategy: Enterprises implement Text-to-SQL layers that act as a “universal translator.” Instead of navigating menus, users query the database using natural language. The system translates the intent into a precise SQL or OData query.
Tangible Impact:
- Use Case: A Regional CFO needs to understand a sudden variance in APAC logistics costs. Instead of commissioning a BI report (3-day lag), they ask the system directly and receive a visual breakdown of freight surcharges in seconds.
- Outcome: Zero time-to-insight for ad-hoc queries.

Stage 2: Augmenting Operations (The Generative Assistant)

Key Objective: To standardize communication and documentation while significantly increasing workforce velocity.
Strategic Rationale: Once users have insight, they must act on it. Often, this action involves creating content—emails, contracts, or summaries. This stage focuses on removing the “Blank Page” fatigue that drains high-value human talent on low-value drafting tasks.
Execution Strategy: This involves Content Generation thru Context Injection. The architecture feeds specific transaction data (such as open Purchase Orders or vendor contracts) into the LLM prompt, instructing it to draft content based on that specific reality for human review.
Tangible Impact:
- Use Case: A procurement team needs to send dunning emails to 50 suppliers regarding late shipments. The Assistant auto-drafts 50 unique emails, each referencing the specific PO number, delay duration, and relevant penalty clauses from the master contract.
- Outcome: Massive productivity gains and strict legal/policy compliance in external communications.

Stage 3: Autonomous Orchestration (The Process Agent)

Key Objective: To achieve “Zero-Touch” processing for routine variances, freeing human capital for complex problem-solving.
Strategic Rationale: Speed is often lost to minor details. Traditionally, any error—no matter how small—halts the process for human review. This stage shifts the paradigm to “Management by Exception,” where the system autonomously resolves routine problems, leaving only complex strategic decisions for human experts.
Execution Strategy: Deploying Agentic Automation. Autonomous agents are granted write-access to specific API endpoints and governed by strict policy logic (e.g., “If variance < $5, then approve”).
Tangible Impact:
- Use Case: The Accounts Payable close is stalled by hundreds of “micro-variances” where invoice totals differ from POs by cents due to rounding errors. The Orchestrator scans, verifies the tolerance policy, and posts the clearing documents automatically.
- Outcome: A faster financial close and a shift of human effort from data entry to strategic relationship management.

The Engineering Challenge: Building Trust

While this transition unlocks immense potential, it forces IT departments to confront a fundamentally new maintenance paradigm: the shift from managing deterministic code to governing probabilistic behaviors.

In traditional systems, if a report generates a wrong number, it is usually a bug in the code that can be traced, patched, and redeployed. In the era of AI, systems face Probabilistic outcomes. A model might generate a slightly different answer depending on context.

This requires new “safety rails”:

Glass Box UI: Systems must always show the user where the answer came from (citations).
Human-in-the-Loop: For high-stakes actions (like paying a vendor), the AI should draft the proposal, but a human must execute the final approval.

The Path Forward

The journey to a GenAI-augmented ERP is an architectural evolution, not a “rip-and-replace” project. To manage risk and ensure successful adoption, enterprises should align their implementation roadmap with the three-stage maturity model defined above.

By starting with Stage 1 (Insight), organizations can validate data accuracy and build user trust in a safe, read-only environment. Once confidence is established, they can advance to Stage 2 (Creation), introducing productivity gains while maintaining human oversight. Finally, only after proving stability, should they progress to Stage 3 (Action) for autonomous processing. This measured evolution ensures that capability grows alongside governance, minimizing operational risk while maximizing business value.

At 1CloudHub we are closely working with Enterprise customers to help them navigate the path to maturity through our consulting services and our solutions and products that help Enterprise to accelerate the pace of adoption to augment GenAI with ERP systems.

Coming Up – Navigating Day 1 Challenges

In the next post, the focus will shift to the foundation. Before building these intelligent layers, enterprises need to ensure their data is ready to support them. The discussion will cover practical strategies for Data Hygiene and how to start small with “Sidecar” pilots.

Coming Up: Post 2 – Navigating Day 1 Challenge : The Practical Reality of Implementation.

The Applied AI Thoughts for Realization Blog Post 1

Why AI Feels Overwhelming — And Why That’s the Wrong Way to Look at It

Introduction

In case of people who closely follow AI related developments as well as for people who are in early stages of understanding the AI landscape its become very hard to track the developments in the space and understand how new technologies, tools, techniques and solutions can be applied in their respective domains and use case ideas they have. For the ones closely following developments in AI space every morning, it feels like the landscape of Artificial Intelligence has shifted overnight. You wake up to a barrage of headlines: a new Large Language Model (LLM) that crushes previous benchmarks, a new image generator that renders reality perfectly, or a new agentic tool that promises to automate your entire workflow.

For engineers, leaders, and decision-makers, this constant acceleration often triggers a mix of excitement and anxiety. There is a pervasive fear of falling behind—the sense that if you don’t master this specific tool released today, you will be obsolete tomorrow. This is “AI Fatigue,” and it is the natural result of trying to drink from a firehose without a cup.

The objective of this blog series, Applied AI Thoughts for Realization, is to help the readers to put down the firehose and step back. The objective is not to cover the latest news or review the newest tools. Instead, the goal of the blogs in this series is to provide you with a structured mental model—a way to organize the chaos into a coherent map.

Over the course of this series, I will try to avoid the hype cycles and focus on a first-principles approach to understanding the AI landscape. I will help you to explore how to categorize AI into distinct “Domain Pillars” based on where it is applied, and how to understand the dependencies and progress within the Domain Pillars through specific “Impact Layers.”

By the end of this series, you won’t just have more information; you will have a mental model framework. When you encounter any news about new AI developments or innovations—whether it’s a breakthrough in consumer gadgets, an enterprise platform launch, or a scientific research milestone—you will be able to instantly map it to its specific domain pillar and identify which layer it operates within. This clarity will help you understand not just what the announcement is, but where it fits in the broader landscape, why it matters in that context, and whether it’s relevant to your work.

The Problem the Series helps to Solve : The Trap of Tactical Thinking

Imagine you decide to build a house. You walk into a massive hardware store, credit card in hand.

On Monday, you buy a power drill because the salesperson says it’s the fastest one ever made. On Tuesday, you see a new type of saw that uses lasers, so you buy that too. On Wednesday, you hear about a revolutionary type of hammer, so you rush back to the store.

By the end of the week, your garage is full of cutting-edge tools. You are exhausted from researching specs and comparing brands. But when you look at your empty lot, you realize a painful truth: You haven’t laid a single brick. You have a collection of tools, but you don’t have a blueprint.

This is exactly where most of us are with Artificial Intelligence today. We are stuck in Tactical Thinking.

We treat AI as a shopping list of features and vendors. We obsess over the “tools”:

“Did you see the context window on that new model?”
“Is OpenAI better than Google for coding?”
“Should we use RAG or fine-tuning?”

While these questions aren’t irrelevant, asking them first is a trap. When you focus solely on the tools, you become reactive. You are constantly pivoting based on the latest press release. You judge AI progress by how fast the “drill” spins (model benchmarks), rather than whether it can actually help you build the “house” (solve a specific problem).

This tactical approach leads to two major issues:

Paralysis: You are afraid to commit to a solution because something better might come out next week.
Misalignment: You try to force a tool into a job it wasn’t meant for—like trying to frame a house with that laser saw just because it was expensive.

To escape this cycle, we need to stop looking at the tools and start looking at the architecture.

The Shift: From Tools to Structure

The antidote to tactical paralysis is Structural Thinking.

If tactical thinking asks “What tool should I use?”, structural thinking asks “Where does this problem live, and what are the constraints of that environment?”

When you shift your mindset from tools to structure, you stop chasing every new announcement. You realize that AI is not a single, monolithic wave washing over everything in the same way. Instead, it is a set of capabilities that behaves radically differently depending on the context.

Why Structure Matters for Scalability and Flexibility

The biggest advantage of structural thinking is that it future-proofs your strategy.

In the tactical world, your strategy is brittle. If you build your entire workflow around a specific vendor’s model, and that vendor changes their pricing or a competitor releases a better model next month, your strategy breaks. You are constantly rebuilding.

In the structural world, your strategy is flexible. You define the architecture of your solution—the data flows, the safety guardrails, the user interaction patterns—independent of the specific engine powering it.

If a new, faster model comes out? You simply swap it in as a component.
If a regulation changes? You adjust your governance layer without tearing down the whole application.

Structural thinking allows you to build systems that last, rather than prototypes that expire. It moves you from being a consumer of technology to an architect of solutions. It forces you to acknowledge that a “good” AI system for writing a marketing email is fundamentally different from a “good” AI system for controlling a robotic arm—not just because the tools are different, but because the structure of the problem (risk, speed, cost, accuracy) is different.

The Solution: A Preview of the Framework

To navigate this landscape effectively, we need a map. Over years of working with AI across various domains, I have developed a mental model that breaks the AI world down into two distinct dimensions. Think of it as a coordinate system for understanding any AI development.

Dimension 1: The 4 Domain Pillars (Where AI Applies) First, we must recognize that “AI” is not a single thing. It is a set of technologies applied in radically different environments. We divide the landscape into four vertical pillars:

Consumer AI: The AI we use in our daily lives (chatbots, image generators).
Enterprise AI: The AI that powers businesses (automation, data analysis).
Science & STEM AI: The AI that accelerates discovery (drug discovery, material science).
Physical AI: The AI that interacts with the real world (robotics, autonomous systems).

Dimension 2: The 5 Impact Layers (How AI Progresses) Within each pillar, progress doesn’t happen in a vacuum. It moves through layers of maturity, from the raw silicon to the final societal change:

Hardware: The chips and infrastructure.
Models: The algorithms and intelligence.
Agents & Tools: The orchestration that makes models useful.
Applications: The interfaces we actually touch.
Impact: The real-world value and behavioral change created.

The Power of the Grid When you combine these, you get a grid. You can place any news story, any tool, or any project onto this grid. Suddenly, the chaos disappears. You aren’t just looking at “AI”; you are looking at “Layer 2 (Models) within Pillar 3 (Science).” Below is a diagram that helps understand the framework.

This framework allows you to ignore the noise that doesn’t affect your specific coordinates and focus deeply on the areas that do.

What to Expect from This Series

This blog post is just the starting point. Over the coming weeks, we will unpack this framework piece by piece, giving you the tools to apply it to your own work.

Here is the roadmap for the series:

Part 1: Foundational Thinking We will dive deeper into the mental models. We’ll explore the 4 Domain Pillars in detail to understand their unique characteristics, and we’ll break down the 5 Layers to see how innovation actually flows from hardware to impact.
Part 2: Pillar-by-Pillar Deep Dives We will dedicate specific articles to each of the four domain pillars—Consumer, Enterprise, Science, and Physical AI. We will analyze the specific trends, constraints, and opportunities within each domain.
Part 3: Applying the Framework Finally, we will turn theory into practice. We will discuss how to use this framework to make better decisions, whether you are evaluating a new vendor, planning an internal AI project, or simply trying to stay ahead of the curve.

By the end of this journey, you will have a clear, reusable lens through which to view the AI landscape—one that turns information overload into actionable insight.

References

Next in Series: Blog 2: A Simple Mental Model — How I Break the AI World into 4 Pillars