Artificial Intelligence

Artificial intelligence is the umbrella term for systems that learn from data, recognize patterns, and make decisions without being explicitly programmed for each scenario. It covers everything from the spam filter in your inbox to the recommendation engine behind your streaming queue to the fraud detection model scanning every card transaction in real time.

For enterprise teams, the interesting question is not whether AI works - it clearly does in narrow domains - but whether the organization's data is ready for it. AI initiatives live or die on data quality, metadata, and governance. The technology is mature; the bottleneck is data readiness.

What AI Is (and Is Not)

No deployed system has general, human-level reasoning; even broad models are trained for bounded tasks, which is what narrow AI means. A vision model that identifies manufacturing defects cannot write marketing copy. A language model that drafts contracts cannot detect tumors in X-rays. These systems excel within their domain but are unreliable outside it.

General AI - a system with human-level reasoning across arbitrary domains - remains a research aspiration with no production implementation. When vendors describe their product as "AI," they mean narrow AI applied to a well-scoped problem. Understanding this distinction prevents inflated expectations and helps organizations scope AI projects realistically.

Core Technologies

Four pillars underpin modern AI systems. Each solves a different class of problem, and most enterprise deployments combine two or more.

Machine learning trains models on historical data to make predictions. Supervised learning uses labeled examples - a bank feeds transaction records marked "fraud" or "legitimate" to train a classifier. Unsupervised learning finds structure in unlabeled data - clustering customers by behavior without predefined segments. Reinforcement learning optimizes through trial and error - adjusting pricing in real time to maximize conversion.

Deep learning and neural networks extend ML with architectures that learn hierarchical features from raw data. A convolutional neural network can identify hairline cracks in turbine blades from photographs that human inspectors miss under time pressure. The tradeoff is data volume: deep learning models need orders of magnitude more training data than classical ML, and that data must be labeled, governed, and representative.

Natural language processing enables machines to read, interpret, and generate human language. NLP powers chatbots, document summarization, text-to-SQL interfaces for business intelligence, and automated metadata enrichment in data catalogs. The transformer architecture - the foundation of GPT, Claude, and BERT - made NLP practical for enterprise-scale applications by processing entire text sequences in parallel.

Computer vision lets systems interpret images and video. Applications range from quality inspection on manufacturing lines to medical imaging diagnostics to autonomous vehicle perception. Like NLP, modern computer vision runs on deep learning and requires large, well-labeled training datasets.

Enterprise AI in Practice

The value of AI shows up in specific scenarios where data governance is the differentiator, not just an afterthought. The four below are hypothetical, but each failure mode is a common one.

Consider a bank's fraud detection model that scores every card transaction in real time. Its accuracy depends on whether the feature "account_age" means days since account creation or days since last login - a distinction that lives in the data catalog, not the model code. When the catalog definition drifts from reality, false positive rates spike and legitimate customers get blocked. The model is fine; the metadata was wrong.

Consider a pharmaceutical company applying NLP to extract adverse event signals from thousands of clinical trial documents. The system works when "elevated liver enzymes" in Study A means the same thing as "hepatotoxicity markers" in Study B. That synonymy mapping comes from a governed business glossary. Without it, the model misses relevant signals because it treats synonyms as distinct concepts.

Consider a retailer's demand forecasting model that predicts inventory needs across thousands of stores. When a supplier changes its product hierarchy - splitting "beverages" into "carbonated" and "non-carbonated" - the model's accuracy drops until someone updates the feature store mappings. MLOps pipelines that monitor data lineage catch these schema changes before they cascade into bad forecasts.

Consider an insurer that deploys predictive analytics to price commercial policies. The model was trained on claims data where "building_age" was calculated from construction date. In production, a data migration changes the source column to "last renovation date." The model can then underprice policies for months, because nothing tracks the upstream change. Lineage plus change tracking on the definition would flag it.

Why AI Projects Fail

Many enterprise AI projects stall before production, and the root causes are consistent.

Data preparation consumes nearly half the time. Data scientists spend nearly half their time preparing data - Anaconda's 2020 State of Data Science survey put it at 19% loading and 26% cleansing - not building models. When datasets contain missing values, inconsistent formats, or undocumented business rules, the data preparation phase balloons. Organizations without a governed data catalog force every project to rediscover what data exists and what it means.

Bias produces models that fail in production. If historical hiring data reflects gender bias, a recruiting model trained on that data will replicate it at scale. Bias detection requires deliberate testing with diverse evaluation data. It also requires lineage: knowing which source datasets contributed to training data and what selection criteria were applied.

Explainability gaps block adoption in regulated industries. A credit-scoring model has to explain why it rejected an applicant, however accurate it is. In the US, ECOA and Regulation B (12 CFR 1002.9(b)(2)) require specific principal reasons for adverse action, even when the model is complex; in the EU, AI Act Art. 86 gives affected persons a right to an explanation of decisions based on most Annex III high-risk systems that significantly affect them, where no other EU law already provides one. Black-box deep learning models need interpretability layers, and those layers need metadata about which features the model weighs and where those features originate.

Cost scales non-linearly. Training a frontier model is expensive: about $78M in compute for GPT-4 and $191M for Gemini Ultra, by Stanford AI Index 2024 estimates. But the hidden cost is in data engineering: building and maintaining the pipelines that prepare training data. Without governed, reusable datasets, every new AI project starts from scratch, duplicating data preparation work that should be shared across teams.

The Data Foundation AI Requires

AI models consume metadata whether organizations manage it or not. The question is whether that metadata is governed or left to guesswork.

Column definitions determine feature quality. A churn prediction model uses "last_activity_date" as a feature. If one source system defines activity as "login" and another defines it as "any API call including automated health checks," the model trains on noise. A business glossary with canonical definitions prevents this ambiguity at the source, not after the model fails.

Data lineage enables root-cause analysis. When a model's accuracy degrades, the first question is "what changed upstream?" Lineage traces the path from source system through transformation to the feature that the model consumed. Without lineage, debugging a production model failure means manually checking every pipeline, every table, and every ETL job - a process that takes days for problems that lineage solves in minutes.

Active metadata powers automation. Instead of relying on static documentation, active metadata platforms can update metadata automatically as data flows through pipelines. In tools that capture runtime signals, that can include freshness (when was this table last updated?), quality scores (what percentage of rows pass validation?), and usage patterns (which models depend on this dataset?). AI systems that consume such signals can make runtime decisions, such as refusing to generate predictions when underlying data is stale or flagging outputs that depend on low-quality inputs.

AI Needs Context, Not Just Data

Raw data alone is not enough. A model that processes a column labeled "revenue" needs to know: is this gross or net? Does it include returns? What currency? What fiscal year definition? Which customer segments are included? That semantic context is the difference between a model that produces useful predictions and one that produces plausible-looking numbers that are quietly wrong.

This is where the concept of a context layer becomes critical. Models that understand what data means - its business definitions, relationships, and provenance - outperform those that just process raw values. A RAG system retrieving data catalog entries can ground its answers in governed definitions instead of guessing. An NLP interface translating natural language to SQL can map "customer lifetime value" to the correct table and calculation, not the first column that matches the string.

The Model Context Protocol (MCP) formalizes this pattern. MCP is an open standard for connecting AI assistants to data sources and tools. Applied to metadata, it gives AI agents a standardized way to query field definitions, data lineage, and business rules. Instead of building custom connectors for every AI tool, organizations expose their governed metadata through one protocol that any MCP-compatible client can consume.

How Dawiso Supports AI Initiatives

Dawiso's data catalog provides the metadata layer that enterprise AI systems need to operate reliably. Governed definitions, ownership records, quality rules and SLAs recorded on data products, and column-level lineage give AI models the context that prevents the most common failure modes.

The business glossary, attributes and lineage give AI models a governed definition to check against: which table holds the canonical "revenue" metric, what business rules define "active customer," and how data flows from source to dashboard. Agents can read that context over MCP instead of assuming the column name tells the full story.

Through MCP, AI agents query Dawiso's catalog programmatically - searching for assets (semantic search needs Ask Dawiso AI enabled), reading definitions and attributes, tracing lineage upstream and downstream, seeing who is related to an object, and reading data samples. This reduces the "what does this column mean?" problem that derails AI projects: an agent can confirm what a column means and who to ask about it before it uses the data.

In Dawiso, workflow states and data-product publishing mark which assets are approved for analytical use. This gives AI teams a reliable starting point instead of discovering data quality issues after a model is already in production.

Conclusion

AI is not a single technology but a family of techniques that share one requirement: they all consume data, and the quality of their outputs is bounded by the quality of their inputs. The algorithms are mature. The frameworks are open source. The cloud compute is available on demand. What separates organizations that get value from AI from those that don't is whether their data is governed, cataloged, and semantically understood. Getting the data foundation right is not a preliminary step - it is the AI strategy.

Sources

• Gartner, Gartner Says More Than 80% of Enterprises Will Have Used Generative AI APIs or Deployed Generative AI-Enabled Applications by 2026 (press release, 11 October 2023).
• InfoWorld, For data scientists, drudgery is still job #1 (reporting Anaconda's 2020 State of Data Science survey: 19% of time on loading data, 26% on cleansing).
• Vaswani et al., Attention Is All You Need (2017; the transformer architecture).
• Stanford HAI, Inside the New AI Index (AI Index 2024; estimated training compute costs of about $78M for GPT-4 and $191M for Gemini Ultra).
• Legal Information Institute, 12 CFR 1002.9 Notifications (Regulation B; paragraph (b)(2), specific reasons for adverse action).
• EUR-Lex, Regulation (EU) 2024/1689 (Artificial Intelligence Act) (Art. 86, right to explanation of individual decision-making).
• Anthropic, Introducing the Model Context Protocol (2024).
• Dawiso Help, Dawiso Model Context Protocol (MCP) (the tools the Dawiso MCP server exposes).
• Dawiso Help, Data product quality and SLAs (quality dimensions, checks and SLAs recorded on data products).