The New Conway's Law: How AI Context Windows Shape Enterprise Architecture
CIOREVIEW >> Artificial Intelligence >> NEWS

Camping World

Sergey Sergeyev, Vice President of Enterprise Architecture

The New Conway's Law: How AI Context Windows Shape Enterprise Architecture

Sergey Sergeyev, Vice President of Enterprise Architecture
Sergey Sergeyev, Vice President of Enterprise Architecture, Camping World

Sergey Sergeyev

Enterprise Architecture Visionary

For decades, Conway’s Law has been one of the most useful and uncomfortable observations in technology: organizations tend to design systems that mirror their own communication structures. If teams are fragmented, systems become fragmented. If departments operate in silos, architecture eventually reflects those silos.

That interpretation still matters. But it is no longer enough.

AI-driven software development is introducing a new form of architectural gravity. Systems are no longer shaped only by how humans communicate. They are increasingly shaped by what AI agents can understand, retain and reason about inside a limited context window.

In traditional software delivery, architecture was decomposed around business domains, team ownership, deployment models, data boundaries and operational responsibilities. With AI-generated applications, another force enters the room: machine cognition. Large language models and AI agents do not “see” the enterprise the way an experienced architect, engineer or product leader does. They operate inside a bounded context. They reason from what is included, retrieved, summarized or remembered in that moment.

This creates a new interpretation of Conway’s Law:

AI-generated systems increasingly reflect the context boundaries of the agents involved in their generation.

That sounds subtle. It is not.

When an AI agent works inside a limited context window, it naturally optimizes for what it can see. It favors local reasoning, local dependencies, local objectives and simplified interfaces. What falls outside the context window is compressed, abstracted, ignored or handed off to another agent. Over time, this can create systems that are not intentionally modular but accidentally fragmented.

The enterprise risk is significant. AI can now generate software faster than many organizations can govern it. That speed is attractive, especially when business teams want rapid automation, workflow simplification or custom applications without waiting for traditional delivery cycles. But if every AI-assisted solution is decomposed around prompt boundaries, agent boundaries or retrieval limitations, the result may be a new form of architectural fragmentation.

This risk is different from traditional technical debt. It is not only bad code, missing documentation or weak integration patterns. It is the accumulation of decisions made inside a limited context, without the full enterprise picture. The system may work locally but fail architecturally. It may satisfy a workflow but duplicate business logic. It may automate a process but create hidden dependencies. It may appear modern, while quietly eroding coherence.

This is where governance and operational accountability become critical.

First, organizations need to define cognitive domains, not just business domains. Traditional architecture boundaries have typically been aligned around business capabilities, applications or organizational ownership. In an AI-driven environment, enterprises must also consider the optimal reasoning scope of AI agents. Cognitive domains should define the information, decisions and context an AI system needs to operate effectively while maintaining alignment with broader enterprise architecture. By intentionally designing these boundaries, organizations can prevent AI agents from creating fragmented solutions based only on limited visibility.

Second, enterprises need shared semantic memory. AI agents should not be working from disconnected prompts, outdated documents or tribal knowledge. They need access to curated architecture decisions, approved patterns, system ownership, data definitions, integration standards and operational constraints. Without shared memory, every agent becomes a local optimizer.

Third, architecture governance must become agent-aware. Traditional review processes were designed for human-created designs. AI-native delivery requires attention to prompt structures, retrieval models, agent workflows, generated code ownership, testing evidence, integration behavior and supportability. The question is no longer only “Was this system designed correctly?” It is also “Was this system generated within the right architectural context?”

Finally, enterprise architecture must preserve global intent. AI agents are powerful at local execution. They are not automatically good at enterprise coherence. Someone still needs to protect the larger shape of the enterprise, the shared data model, the integration strategy, the operating model, the security posture and the long-term ability to change.

The future role of Enterprise Architecture is not to slow AI adoption or force every experiment through traditional governance. That would miss the point. The better role is to help the enterprise design the conditions under which AI-generated systems remain coherent, supportable, secure and strategically aligned.

The organizations that understand this early will not treat AI as just another development accelerator. They will treat it as a new design force. They will recognize that context windows are becoming architecture boundaries and that unmanaged boundaries eventually become enterprise constraints.

Conway’s Law has not disappeared. It has evolved.

The old version said systems mirror the communication structures of the people who build them.

The new version says AI-generated systems increasingly reflect the cognitive boundaries of the agents that build them.

That is the architecture challenge of the AI era. Not whether AI can generate software. It clearly can. The real question is whether enterprises can maintain coherent architecture when thousands of AI-driven generation processes begin producing systems at machine speed.

The articles from these contributors are based on their personal expertise and viewpoints, and do not necessarily reflect the opinions of their employers or affiliated organizations.