Română

Safe AI for Companies: Perspectives from New York

Safe AI for Companies: Perspectives from New York
08.07.2026
Updated on 08.07.2026

This article is part of the AI Sales Guide.

After the success of the BeeGlobal conference in March at UiPath's Bucharest headquarters, where we analyzed AI implementation from complementary perspectives (business, legal, and cybersecurity), the discussion crossed the ocean. On April 28th, we were present in New York at the "Safe AI and Business Guardrails – Applications in Google Cloud" event, organized by the BeeGlobal network in partnership with System2.

Our colleague, Marian Călborean (Founder & CEO OPTI Software), took the stage alongside other experts and technology leaders to debate the challenge of the moment: how do you turn AI from an experiment into a scalable production solution, without losing control over security and data? Since the event took place after Google Cloud Next and the latest Google Cloud releases, the technologies cited were from Google Cloud, but applicable to any other technology stack.

Why do we need rules for AI? As BeeGlobal excellently summarized in their post-event write-up:

"Good brakes are the ones that let the car go fast."

Why does AI fail in the Enterprise environment? Because it's overconfident, not because it doesn't know

One of the best summaries of the evening came from the audience, from David Wong (Technical Program Manager, former tech leader at BlackRock), who captured the ideas of the event. He pointed out an uncomfortable truth on LinkedIn:

"Enterprise AI doesn't fail because the model is wrong. It fails because the model sounds extremely confident when it is wrong."

When we talk about regulated industries or B2B, "AI hallucinations" cannot be accepted, for example for financial data. For this reason, all innovations in AI safety are centered on the need to make AI more deterministic (predictable, precise, constrained by rules).

How do we achieve this? During the panel, Marian Călborean pointed out that the secret lies in the data foundation on which AI agents are built: a strong Knowledge Graph and a well-defined Semantic Layer.


The OPTI Solution: Build a Semantic Layer before AI agents

Don't let agents search for (and invent) answers from scratch. If you want to prevent hallucinations in generative AI models, or the "drift" phenomenon in Machine Learning, information must first be structured according to the organization's real business processes.

As happens with giants like Palantir, success lies in a robust knowledge graph:

The importance of a strong Knowledge Graph for AI agents in companies

When you process a company's data (for example, a Pharma/Medical company), organizing information by department, active substances, or strict business processes forces AI agents to navigate in a way that is close to the company's logic.

The result is a drastic reduction in hallucinations, as Marian detailed:

How you build an AI that follows business rules

Four iron rules for safe AI, drawn from the panel

The discussions in Manhattan, moderated by Troy Johanson (System2), revealed strategies tested in production by the other panelists: Seth Leonard (System2), Sanjay Mishra (Fidelity Investments), and Gabriel Păunescu (NauLogic).

We noted a few basic ideas that every B2B company should apply:

  1. Never let AI "touch" the numbers: Separate the narrative thread from the numerical data. The LLM can write the summary or interpretation, but traditional (deterministic) code must inject the financial figures. This avoids major legal risks.
  2. Ensure audit and logging capabilities: In regulated industries, an answer provided by AI has no value if you cannot document the path through which it was reached.
  3. Route intent before the query: Use deterministic routes (soft stops) before the user's prompt actually reaches an LLM, to block unsafe requests from the start.
  4. Treat prompts like pieces of code: Avoid long conversations that make the model lose context. Segment tasks and use structured formats.

In the end, Marian summarized the Semantic Layer concept as a solution for data traceability and accuracy:

How to reduce AI hallucinations for trusted results

Conclusion: AI determinism is the essential requirement

The step from isolated experiments to integrating AI into real processes, from generating complex quotes to decision-making analysis in business, runs into a "trust architecture" problem. The solutions above are the most advanced at this time.

We invite you to read David Wong's detailed perspective on the event, together with the LinkedIn discussion that followed. This confirms the quality principles adopted by OPTI Software: hybrid architectures, predictability, and B2B safety.

To dive deeper into how you can practically implement these architectures in your company, we invite you to download our free material: Guide #1 in the AI Architecture Series for B2B 2026: Smart Recommendations, Upsell, and Rules.

Contact us for an in-depth discussion of your business scenario

Quick Questions

What is Safe AI in B2B companies?

Safe AI is the approach through which companies make AI more deterministic, predictable, and controlled, so that decisions generated by AI models comply with business rules, can be audited, and do not introduce legal or financial risks.

Why does AI fail in enterprise environments?

Enterprise AI usually doesn't fail because the model is wrong, but because it sounds extremely confident when it is wrong. Without guardrails and without separating numerical data from text generation, hallucinations can reach business decisions undetected.

What is a Semantic Layer and why is it needed before AI agents?

A Semantic Layer is the structure that organizes a company's data according to real business processes, before AI agents use it. Together with a robust Knowledge Graph, it drastically reduces hallucinations and forces AI to navigate the organization's real logic.

What are the four iron rules for safe AI discussed at the BeeGlobal x System2 event?

Don't let AI touch financial figures directly, ensure audit and logging capabilities, route user intent before the prompt reaches the LLM, and treat prompts like pieces of code, avoiding long, unstructured conversations.

How do you prevent AI hallucinations on financial or regulated data?

Separate the narrative thread (generated by the LLM) from the numerical data (injected deterministically by traditional code), structure information through a Semantic Layer and Knowledge Graph, and add deterministic routes (soft stops) that block unsafe requests before they reach the model.

Which companies took part in the Safe AI and Business Guardrails panel in New York?

The panel brought together representatives from OPTI Software, System2, Fidelity Investments, and NauLogic, moderated by Troy Johanson, alongside Marian Călborean, Seth Leonard, Sanjay Mishra, and Gabriel Păunescu.

What technologies and methodologies are involved?

Technologies: Google Cloud, LLM, Machine Learning, Knowledge Graph, Semantic Layer, Palantir
Methodologies: Semantic Layer before AI agents, robust Knowledge Graph, separating numerical data from LLM generation, AI audit and logging, deterministic intent routing (soft stops), structured prompts as code fragments

Nicolae Amarghioalei

Article written by

Nicolae Amarghioalei

Customer Success Manager. Cloud and Onboarding Specialist.

See on LinkedIn →
Interesat?

Interested?

Schedule a meeting

Get a Free Audit

News and Guides

More News