AIYINGFrom AI Awareness to Accomplishment
Showing posts with label Concept Extraction. Show all posts
Showing posts with label Concept Extraction. Show all posts

Friday, November 6, 2026

The Effective AI Engineer #010: The Engineer Who Made Permission Executable

The Effective AI Engineer · Case 010 of 16

The Engineer Who Made Permission Executable

Applying Lateral Thinking to Create Meaningful Impact with AI



Lateral Thinking • Engineering Judgment • Meaningful Impact

An AI system’s authority should be defined by what its application permits it to execute.

This is a fictional teaching case informed by primary engineering sources. Its characters, events and test findings are illustrative. Research checked on 6 November 2026.

1. The situation: approval existed, but what did it authorise?

A software company was extending an internal AI assistant from investigating support requests to preparing service credits.

The proposed workflow appeared straightforward:

  • Retrieve the relevant account and incident records.
  • Recommend a credit within company policy.
  • Obtain approval from an authorised manager.
  • Apply the approved credit.

The assistant’s instructions included a clear rule:

Never apply a credit without manager approval.

In demonstrations, it followed the rule.

But Kavya, the engineer responsible for the integration, found that the execution tool accepted an account identifier, an amount and a field called approved.

The model supplied all three.

The application could verify that its service credential was allowed to call the credit API. It could not independently establish that an authorised manager had approved that particular credit.

The team had implemented an instruction to request permission. It had not yet implemented a dependable way to verify permission at execution.

↑ Back to contents

2. The story: the approval that travelled too far

“Who sets this field?” Kavya asked.

She pointed to:

approved: true

“The assistant,” said Imran, the product lead. “After the manager says yes.”

“And how does the execution service know who said yes?”

Imran opened the conversation log.

“The approval is here.”

The manager’s message read:

“Approved. Please proceed.”

Immediately above it was a proposed credit for one customer account.

Later in the conversation, the assistant had discovered a second affected account.

During a staging test, it prepared a revised request and carried forward the approval flag.

The second request had not been approved.

No real customer account was changed. The test used an isolated credit ledger. But the application had accepted the request.

Their first response was to improve the prompt.

They added instructions about account identifiers, amounts, approval expiry and changes after approval.

The assistant behaved more carefully in several trials.

Kavya then called the tool directly with an unapproved staging request.

It still accepted it.

“The prompt helps the assistant choose,” she said. “The service still needs to decide whether this action is permitted.”

Imran suggested showing a confirmation dialog before every tool call.

That would make the process visible. It would also ask managers to approve account searches, incident retrieval and draft calculations.

“What are we trying to achieve with approval?” Kavya asked.

“To keep a manager responsible for the credit.”

“More specifically?”

They wrote down the purpose:

A person with the required authority must knowingly authorise the material details of a consequential action. Execution must remain within that authority.

The conversation changed.

A confirmation dialog was one possible implementation. A chat message was another. Neither was the concept itself.

They asked AI to generate different ways of carrying out that concept.

It proposed a review queue, an action-specific approval record and a workflow that stopped at a prepared draft for a manager to execute manually.

It also proposed asking a second model to judge whether approval was present in the conversation.

“That might help locate a message,” Kavya said. “It cannot establish authority from a claim inside the message.”

They chose an action-specific review process for the staging pilot.

The assistant could prepare a credit proposal. The application generated a proposal identifier and stored the account, currency, amount, reason and supporting evidence.

A manager reviewed those details through an authenticated interface.

The application recorded the approver’s identity and checked their authority for that account and amount. It then stored an approval tied to the proposal.

The execution tool accepted the proposal identifier. It did not accept an assistant-generated approval flag.

Its service retrieved the approved details and checked whether execution was currently permitted.

Their next test exposed a different weakness.

The manager approved a proposal. Before execution, an engineer amended its amount to correct a calculation.

The proposal identifier stayed the same.

The execution service found an approval and proceeded.

“The identifier is stable,” Imran said. “The thing it identifies has changed.”

They introduced proposal versions. Approval applied to the reviewed version. A material change required a new review.

Then they tested a manager whose authority had been removed after approval.

The request was stopped.

They tested an expired approval.

Stopped again.

Then two workers tried to execute the same approved proposal at almost the same time.

Both initially passed the “not yet executed” check.

The team had checked the condition, but had not protected the transition.

Kavya worked with the backend engineer to make reservation of the approved operation concurrency-safe. They also used the credit service’s supported idempotency mechanism for the external request.

A later timeout still left an uncertain outcome. The recovery path checked the operation’s status rather than treating a missing response as proof that nothing had happened.

One final test found a bypass.

An older generic API tool could still call the credit endpoint using a broad service credential.

The new approval path worked. It was not the only path to the action.

They removed that route from the agent’s environment and restricted the remaining integration credential.

The comparison was not entirely favourable.

Some valid proposals were rejected because the manager-to-account mapping was incomplete. Reapproval after changes added delay. The review screen required careful design so managers could see what they were deciding.

The team repaired the mapping and clarified the review screen. It kept exceptional cases in the manual process.

The pilot remained limited to a narrow credit workflow. The assistant could investigate and prepare within existing access rules. Applying a credit required an independently verified, current approval for the exact proposal.

Imran revised the requirement:

The assistant must ask for approval. The execution service must verify it.

↑ Back to contents

3. The Lateral Thinking tool: concept extraction and alternatives

Tool used: Concept Extraction, followed by Alternatives.

Edward de Bono explains that making an implicit concept explicit provides a fixed point from which to find alternative implementations. [1]

The team initially treated “ask the manager” as the solution.

Kavya extracted its underlying purpose:

Ensure that an authorised person knowingly permits a defined consequential action, and that execution stays within that permission.

That concept allowed several alternatives:

  • A manager executes a prepared proposal manually.
  • An authenticated review queue releases approved actions.
  • A service validates an action-specific approval record.
  • Clearly bounded actions execute under an established delegation policy, where the organisation has explicitly authorised that arrangement.

The concept remains stable while the implementations differ.

Original-method reference: Edward de Bono, Serious Creativity (1992), discussion of concepts and alternative implementations, printed pages 139–141.

This case uses no PO statement. Concept extraction is sufficient to create the change in direction. The application controls are contemporary engineering adaptations.

↑ Back to contents

4. Making the thinking visible

The movement from thinking tool to design follows five questions:

  1. What does the existing approval step achieve?
    It gives someone an opportunity to permit or reject a proposed action.
  2. What must be true for that permission to count?
    The approver must have authority and understand the relevant action details.
  3. What must remain true at execution?
    The proposal must match the approval, remain eligible and satisfy current application rules.
  4. Where must those conditions be checked?
    At a trusted execution boundary, using authoritative identity, policy and approval records.
  5. What other route could reach the same action?
    Generic tools, broad credentials and legacy endpoints may bypass the intended workflow.

AI’s role

AI helps extract candidate concepts, generate designs and identify missing conditions. Application services establish identity and enforce permissions. A model’s statement that approval exists does not create that approval.

Reusable prompt

We are designing an AI workflow that can [consequential action].

Extract the purpose behind our current approval step. Generate three different implementations of that purpose.

For each, identify the actor, approver authority, target resource, material parameters, approval lifetime, execution check and possible bypass routes.

Distinguish model-generated claims from facts established by trusted services. Include changed parameters, revoked authority, concurrent execution and an uncertain external result.

State what requires organisational policy rather than a model’s judgment. Do not invent permissions or approvals.

↑ Back to contents

5. Comparing the implementation alternatives

Three approaches to the approval requirement
Alternative Potential benefit Limitation Appropriate role
Prompt and conversation-based approval Helps the assistant explain and request permission A model-generated flag does not independently establish authority Behavioural guidance
Manager manually executes a prepared proposal Keeps execution in an existing authorised workflow Retains manual work and possible transcription errors Early or exceptional workflows
Authenticated review with an execution check Connects approval to defined action details Requires identity integration, state management and policy maintenance Selected repeatable workflows

A confirmation interface can support the third approach. Its presence alone does not establish that the backend enforces the decision.

The fictional team selected the third design for a narrow pilot while retaining manual execution for exceptions.

It did not require fresh approval for every read operation. Reads remained subject to their own access rules; explicit approval was attached to the consequential credit action.

↑ Back to contents

6. What the research supports—and its limits

Authorisation belongs in the application

OWASP recommends least privilege, denial by default, permission validation on every request and enforcement in the appropriate trusted location. Authentication establishes identity; authorisation determines whether the requested operation is permitted. [2]

Approval must correspond to the transaction executed

OWASP’s transaction-authorisation guidance addresses review of significant transaction details, server-side enforcement, controlled state transitions, changes after authorisation and a final execution check. It also discusses limited validity and protection against reuse. The case adapts these principles to a service-credit workflow. [3]

Agent behaviour and reachable capability are different controls

Anthropic describes containment through environment and access boundaries alongside model-level safeguards. Its account supports limiting what an agent can reach rather than depending entirely on its choices. It also documents limitations and failures; containment is not a guarantee of complete protection. [4]

Protocol authorisation does not define the business decision

The dated MCP authorisation specification describes access authorisation for HTTP-based transports. That protocol layer does not itself specify which manager may approve a particular credit or what amount they may approve. Those are application requirements. [5]

This reference concerns the 25 November 2025 MCP specification, not a claim about the latest protocol revision.

Case synthesis

The proposal version, approval record and execution state are one illustrative design. Appropriate controls depend on the application and its service contracts. The fictional tests establish no measured security guarantee or production improvement.

↑ Back to contents

7. Practice: make one permission requirement testable

Accessible exercise

Choose one action in an AI-assisted workflow.

  • Identify who may propose it.
  • Identify who may approve it.
  • List the details the approver must see.
  • Specify what changes invalidate the approval.
  • Identify where the application checks permission.
  • Ask whether the action remains possible through another route.

Write the requirement without relying on “the AI should remember.”

Technical exercise

Test both permitted and prohibited cases in an isolated environment:

  • Correct approver, resource and proposal version.
  • Wrong account or tenant.
  • Amount, currency or target changed after approval.
  • Expired or revoked approval.
  • An authenticated person lacking approval authority.
  • A model-supplied approval flag or invented approval identifier.
  • Two concurrent execution attempts.
  • Replay of an already executed operation.
  • Policy service failure.
  • External timeout with an unknown result.
  • Access through a legacy or generic tool.

Inspect actual state and service records. A refusal message alone does not prove that the backend prevented execution.

Measure legitimate completion, incorrect rejection, unauthorised state changes, duplicate effects, review effort, latency and recovery workload. Set explicit stop conditions for the pilot.

↑ Back to contents

8. Professional benefit and transfer

For AI engineers

  • Convert prose requirements into verifiable execution conditions.
  • Separate proposal generation from authority to act.
  • Recognise that identifiers, schemas and successful authentication do not settle business permissions.
  • Investigate bypass routes and concurrency behaviour.
  • Design useful denial and recovery paths.

For technical leaders

  • Assign ownership of approval policy and entitlement data.
  • Decide which actions need explicit approval and which fall within established delegation.
  • Require evidence that controls cover every execution route.
  • Include false rejections and review effort in delivery decisions.
  • Keep exceptional cases outside automation until their rules are clear.

Limits of transfer

An approval record cannot repair an incorrect policy, a compromised approver or a misleading review interface. Execution controls also do not establish that the assistant’s recommendation is substantively correct.

Reflection question

If the assistant proposed an unauthorised action, which application component would prevent it—and how would you demonstrate that prevention?

↑ Back to contents

9. Applied artifact: Permission to Execution Contract

Document:

  1. Intended action and business purpose.
  2. Requesting actor and authenticated identity source.
  3. Target resource and tenant boundary.
  4. Permitted operations and material parameters.
  5. Approver role and source of authority.
  6. Information presented for review.
  7. Approval identifier, proposal version and validity conditions.
  8. Changes requiring reapproval.
  9. Trusted execution check and policy owner.
  10. Concurrency, replay and duplicate-effect handling.
  11. Uncertain-outcome reconciliation.
  12. Alternative execution routes and credential restrictions.
  13. Denial, outage and escalation behaviour.
  14. Audit evidence and retention requirements.
  15. Permitted and prohibited test cases.
  16. Pilot boundary, unresolved limitations and review date.

Completion check

Explain the extracted concept, compare three implementations and identify the component enforcing permission. Demonstrate a valid action and rejected attempts involving changed parameters, missing authority and replay.

Make permission a condition of execution that the application can verify.

↑ Back to contents

Research references

  1. Edward de Bono. Serious Creativity (1992). Concepts and alternative implementations, printed pages 139–141. Original method source supplied with this project.
  2. OWASP. Authorization Cheat Sheet .
  3. OWASP. Transaction Authorization Cheat Sheet .
  4. Anthropic. How We Contain Claude Across Products . 25 May 2026.
  5. Model Context Protocol. Authorization . Specification dated 25 November 2025.

Sources checked on 6 November 2026. Characters, events and test findings are fictional. Research supports the engineering discussion; it does not validate the fictional implementation or establish universal performance or security guarantees.

↑ Back to contents

Continue with The Effective AI Engineer

This 16-case series combines independent professional stories, explicitly explained Lateral Thinking tools, research-grounded AI engineering practices and practical exercises.

Explore the series

Join the course: For course and enrolment details, email ravindra.dastikop@gmail.com or call 8453212131. Mention The Effective AI Engineer.

By Ravindra Dastikop
Lateral Thinking • Engineering Judgment • Meaningful Impact

AIYING — Accomplishing with AI

Thursday, November 5, 2026

The Effective AI Engineer #006: The Engineer Who Helped the Document Explain Itself

THE EFFECTIVE AI ENGINEER · CASE 006 OF 16

The Engineer Who Helped the Document Explain Itself

Applying Lateral Thinking to Create Meaningful Impact with AI

By Ravindra Dastikop


Engineering focus: Document preparation, retrieval, provenance and freshness.
Case type: Research-grounded fiction. Characters, events and trial observations are invented.
Sources checked: 5 November 2026.

1. The situation and impact sought

Ananya was building an internal knowledge assistant for a software company.

Support engineers used it to find explanations, operating instructions and product limitations across technical manuals. The assistant used retrieval-augmented generation, or RAG: it searched a document collection and supplied selected passages to a language model.

The documents contained the answers. Yet the assistant sometimes retrieved the wrong passage—or retrieved the right words without the information needed to interpret them.

A section said that a feature was unsupported. But the product name appeared several pages earlier. Another passage described a workaround whose version restriction appeared only in its heading.

The existing system divided documents into passages and searched their text using embeddings—numerical representations used to find semantic similarity.

Ananya’s task was to improve the usefulness of retrieved evidence within a two-week test. She could change document preparation and retrieval, but she could not rewrite the underlying manuals.

The useful outcome: Help support engineers find applicable, verifiable evidence with less searching and correction.

Retrieving something plausible would not be enough.

↑ Back to contents

2. The story

The answer was in the manual.

Ananya knew because she had found it herself.

The assistant had been asked whether a particular export option was available in the self-hosted edition. It returned a confident answer supported by a passage about the hosted edition.

Both passages discussed the same feature. Both used similar language.

Only one applied.

“We could try a different embedding model,” said Vikram, the support lead.

They added that option to the experiment list. But Ananya first opened the retrieved passage without the rest of its document.

It began: “This option is available after the administrator enables the setting.”

Which option? Which edition? Which release?

The passage made sense to someone who had read the preceding pages. The search system encountered it alone.

Ananya copied the document title and section heading above the passage.

Now its meaning was clearer.

At first, she considered adding headings to every passage and stopping there. Then she paused.

What was the heading actually doing?

It was helping a fragment retain the identity and scope it had possessed inside the complete document.

That was a broader idea than “add a heading.”

She wrote:

Help each fragment carry the information needed to recognise where it belongs.

From that idea, several possibilities emerged.

One was straightforward: attach reliable metadata such as document identity, edition, version and section path.

Another was to search small passages but retrieve the surrounding section when necessary.

A third was to generate a short, passage-specific explanation using the complete source document.

An AI assistant helped Ananya expand these possibilities. Several suggestions were merely different names for the same mechanism. She removed the duplicates.

Then she asked it to draft a contextual explanation for a passage.

The explanation looked useful. It also described the limitation as applying to every edition.

The manual did not say that.

Ananya marked the generated explanation as incorrect.

Helping a document explain itself could easily become helping a model invent what the document meant.

She changed the design.

Original text would remain unchanged. Generated explanations would be stored separately. Each explanation would be linked to its source version and treated as a derived annotation requiring checks.

For the first experiment, the team compared the existing passages, passages with verified headings and metadata, and passages with additional generated context. They kept the initial retriever and retrieval depth comparable.

Some ambiguous passages became easier to find with simple metadata. Some seemed to benefit from more specific explanations. Others gained little.

A larger section helped with one exception but brought irrelevant material into another answer.

Then a support engineer noticed something else: the correct old passage was still being retrieved after the manual had been updated.

The context was well written.

It was also obsolete.

Ananya added an update test. A source change had to trigger reconsideration of its passages and annotations. A deleted source had to disappear from active search results according to the system’s deletion process.

A separate permission test exposed another issue. An explanation generated from an entire document contained information from a restricted section.

The team stopped that route until they could preserve the appropriate access boundary. Restricting the original passage alone would not protect information copied into an annotation.

By the end of the fictional trial, Ananya had no universal winner.

She proposed verified metadata as the first change for the selected document collection, with generated context reserved for a narrower experiment on passages that remained difficult to retrieve.

Hybrid search and reranking remained separate candidates for later comparisons.

Vikram looked at the revised plan.

“So the answer wasn’t simply a better search model?”

“That was one possibility,” Ananya said. “First we needed to understand what the searchable passage had lost.”

↑ Back to contents

3. The thinking tool explained

The tool is concept extraction followed by generating alternatives.

In Serious Creativity, Edward de Bono describes pulling back from a specific idea to identify its underlying concept. The concept becomes a point from which other practical ideas can be developed.

The relevant discussion appears in “From Idea to Concept,” printed pages 139–141, with a further summary under “Concepts,” pages 315–316, in the supplied edition. [1]

In this case:

  • Specific idea: Add the document title and heading to a passage.
  • Extracted concept: Preserve the identity and scope a fragment needs when separated from its source.
  • Alternative implementations: Metadata, surrounding-section retrieval, or a verified contextual annotation.

The concept must be broad enough to generate alternatives and specific enough to guide useful work.

“Improve information” is too broad.

“Always prepend the section heading” is already an implementation.

This case does not require PO. Concept extraction is a distinct Lateral Thinking practice. Calling every change of perspective a provocation would obscure the method being used.

The retrieval application is our contemporary adaptation of de Bono’s thinking tool.

↑ Back to contents

4. The thinking made visible

Thinking step Application in this case
Focus Find evidence that applies to the user’s actual question.
Initial idea Add a title and heading to an isolated passage.
Pull back Ask what useful function that addition performs.
Extracted concept Preserve a fragment’s identity and scope outside its original surroundings.
Generate alternatives Supply structured metadata, recover surrounding sections, or add verified explanatory context.
Judge Compare retrieval quality, applicability, annotation errors and maintenance effort.
Act Test a bounded change against the existing system.

AI’s contribution

AI helps propose implementations and identify possible failure modes. It can also draft contextual annotations.

The engineer must check whether the alternatives differ in mechanism, whether annotations follow from the source, and whether access and update rules remain intact.

Reusable prompt

We are exploring this specific idea: [idea].

Explain the useful function it performs. Extract two or three possible underlying concepts at different levels of generality.

Choose a concept that is broad enough to generate alternatives but specific enough to guide this task: [task].

Generate three materially different implementations. For each, explain the mechanism, required information, likely failure, maintenance burden and smallest useful test.

Keep source facts separate from generated interpretation. Do not invent missing document details or assume that adding text improves retrieval.

↑ Back to contents

5. The engineering decision

Ananya separates improvements to the searchable material from changes to the search method.

Changing both at once might improve the system, but it would make the reason harder to identify.

Alternative Potential benefit Cost or difficulty Critical uncertainty Decision
Existing passage search Provides a baseline. May lose surrounding meaning. Which failures come from missing context? Retain for comparison.
Verified headings and metadata Preserves explicit identity and scope. Extraction and version mapping. Are the required details present and reliable? Test first.
Small passages with surrounding-section retrieval Recovers nearby qualifications. More text and retrieval logic. Does the extra material resolve ambiguity? Test separately.
Generated contextual annotations Can explain a passage’s role. Generation, verification and refresh. Does the annotation introduce unsupported meaning? Narrow experiment.
Hybrid search or reranking Changes how candidates are found or ordered. Additional configuration and evaluation. Is the bottleneck retrieval method rather than representation? Separate comparison.

Keep evidence and annotation distinct

An original passage, authoritative metadata and a generated explanation have different origins. Preserve that distinction in storage, inspection and answer presentation.

A citation should lead to a source location supporting the claim. A generated description of a passage is not independent evidence.

Treat updates as part of the design

Record which source version produced each derived artifact. When relevant source content changes, refresh or invalidate dependent material.

Access changes need their own tests. A generated annotation must not become a route around restrictions on its source information.

These are design requirements for the fictional system, not guarantees supplied automatically by a retrieval product.

↑ Back to contents

6. The evidence behind the case

What research supports

Anthropic’s Contextual Retrieval approach adds passage-specific context before indexing. Its published experiments also explore lexical retrieval and reranking. The reported gains belong to those configurations and datasets; they are not guarantees for another organisation’s manuals. [2]

Anthropic’s accompanying cookbook provides an implementation example and a retrieval evaluation using expected passages. This supports testing the retrieval stage directly, rather than judging it only through polished final answers. [3]

Dense Passage Retrieval demonstrates learned passage retrieval in open-domain question answering. It establishes an important retrieval approach, but its benchmark results do not settle which method best suits this case’s version-sensitive documents. [4]

Microsoft’s documentation describes document-level access controls, including security filtering and several approaches marked as preview. Its Azure Storage indexing guidance also distinguishes change detection from deletion detection: deletion requires an appropriate configured process. These illustrate why permissions and source lifecycle need explicit engineering attention. [5] [6]

What this case adds

The protagonist, failure sequence, comparison plan and proposed metadata-first decision are fictional teaching choices.

What remains uncertain

The appropriate passage boundaries, annotation method, retrieval strategy and refresh process depend on the collection and user questions. Better retrieval does not automatically establish correct answers or lower total operating cost.

No claim is made that the cited organisations use de Bono’s methods.

↑ Back to contents

7. Try the move

Accessible exercise

Choose an approved document with headings, qualifications or version-specific instructions.

  1. Select a passage that becomes ambiguous when read alone.
  2. Add information that makes it interpretable.
  3. Ask what useful function your addition performs.
  4. Express that function as a

Accomplish with AI

Powered by Blogger.

Featured post

AI Engineering Hands-On Lab #001 — Build an AI Answer Reliability Test Bench Without Code

AIYING | Daily 24 — Post 009 AI Engineering Hands-On Lab #001 Build an AI Answer Reliability Test Bench — Without Writing Code Lea...

Search This Blog

List of blogs

Search This Blog

About

Translate

Instant Stories

Read in Your Language

Test

share this

ShareThis

Popular Posts