Reference library
APPENDIX G

AI Enablement Fundamentals for OFA 1

What AI assistants are and are not good at, privacy and approved tools, prompting basics, and OFA 1 versus OFA 2 expectations.

Appendix Overview

A.

Purpose and Scope

This appendix collects and expands on the AI-Assisted Work guidance introduced in every module into a single reference.

B.

What This Reference Covers

  • 1.What AI assistants are.
  • 2.What they are good at.
  • 3.Where they fail.
  • 4.How to use them responsibly in OFA work.
  • 5.It is intentionally written at a foundational level.
  • 6.A deeper treatment of AI enablement for more advanced OFA work is provided in the companion OFA 2 curriculum and the Level 3-5 curriculum.

What AI Assistants Are

A.

Large Language Models

  • 1.The AI writing and chat assistants referenced throughout this curriculum, such as Microsoft Copilot or similar approved tools, are built on large language models.
  • 2.Large language models are systems trained on very large amounts of text that predict likely, plausible-sounding continuations of a prompt.
  • 3.This means an AI assistant is very good at producing fluent, well-organized language.
  • 4.However, it does not "know" facts the way a person who was in a meeting knows what was said.
  • 5.It generates text that sounds right based on patterns, which is a fundamentally different thing from remembering or verifying what actually happened.

A High-Level Map of AI and Machine Learning Concepts

A.

Machine Learning Basics

  • 1.An OFA does not need to become a data scientist.
  • 2.A new OFA will increasingly encounter projects that touch artificial intelligence and machine learning beyond just writing assistants.
  • 3.It helps to recognize the basic vocabulary rather than treating every mention of "AI" as the same thing.
  • 4.Machine learning, broadly, is the practice of training a computer program to recognize patterns in data rather than following an explicitly written set of rules for every situation.
  • 5.It is commonly grouped into a few basic categories:
TypePlain-Language DescriptionExample an OFA Might Encounter
Supervised learningThe model learns from examples that are already labeled with the correct answer, then predicts labels for new, unseen examplesA model trained on past support tickets labeled by category, used to suggest a category for a new ticket
Unsupervised learningThe model looks for patterns or groupings in data that has no labeled correct answerGrouping volunteers into rough clusters based on activity patterns, without predefining the groups in advance
Reinforcement learningThe model learns by trial and error, receiving a reward signal for good outcomesLess common in typical OFA-adjacent projects; more associated with specialized optimization or game-playing systems
Generative AI / large language modelsA model trained on large amounts of text (or images) that generates new, plausible-sounding content in response to a promptThe AI writing assistants referenced throughout this curriculum, and chatbots described below
  • 6.A foundational OFA does not need to be able to build or train any of these.
  • 7.The goal is simply to recognize which category a project or tool falls into, since that shapes what the tool can realistically be expected to do and what kind of testing or validation it will need.

Chatbots: What They Are and How They Differ

A.

Two Kinds of Chatbots

"Chatbot" is a broad term covering at least two meaningfully different kinds of systems, and confusing them is a common early mistake.

B.

Rule-Based Chatbots

  • 1.Rule-based chatbots follow a predefined decision tree·if a user selects or types one of a fixed set of expected inputs, the bot follows a scripted path to a scripted response.
  • 2.These are predictable and easy to test exhaustively.
  • 3.They are brittle outside their scripted paths - an unexpected question typically produces a dead end or a generic fallback message.
C.

AI-Powered (Generative or Intent-Based) Chatbots

  • 1.AI-powered chatbots use a language model or a trained intent-classification model to interpret a wider range of free-text input and generate or select a more flexible response.
  • 2.These handle unexpected phrasing far better than rule-based chatbots.
  • 3.They are harder to test exhaustively and can produce a confidently wrong answer in the same way a general AI writing assistant can.
D.

Hybrid Chatbots

  • 1.Many real chatbot deployments are actually hybrid·a rule-based structure for well-known, high-stakes paths, with an AI-powered layer handling open-ended questions that fall outside the scripted paths.
  • 2.For example, a rule-based structure might handle providing an emergency contact number.
E.

Practical Implications for Requirements and Testing

  • 1.For an OFA supporting a chatbot-related requirement or test effort, the practical implication is this:
  • 2.Requirements and test cases for a rule-based chatbot can specify exact inputs and exact expected outputs, the same way a traditional test case does.
  • 3.Requirements and test cases for an AI-powered chatbot instead need to specify a range of acceptable responses and explicit boundaries on what the bot must never say, since exact-output testing is not realistic for a generative system.
  • 4.For example, the bot must never provide specific pastoral or medical advice.

What AI Is Good At for OFA Work

A.

Strengths of AI Assistants

  • 1.Turning rough, disorganized notes into a clean, structured first draft.
  • 2.Suggesting candidate open questions to ask before a stakeholder conversation.
  • 3.Summarizing a long document or transcript into a shorter overview for a human to verify.
  • 4.Drafting a first-pass comparison of two options, two requirements, or two arguments.
  • 5.Explaining an unfamiliar term or acronym in plain language as a starting point for further confirmation.

What AI Is Not Good At, and Where the Risks Are

A.

Hallucination Risk

The single most important risk for a new OFA to understand is "hallucination": an AI assistant can produce a confident, specific, plausible-sounding statement that is simply false.

B.

Examples of Hallucination

  • 1.Inventing a decision that was never made.
  • 2.Inventing a person who was never in a meeting.
  • 3.Inventing a system behavior that does not exist.
  • 4.Because the output reads as confidently as accurate output, it is easy to miss unless the OFA deliberately checks it.
  • 5.AI assistants also have no direct access to internal systems, real-time data, or anything that happened in a specific meeting unless that information was explicitly provided in the prompt.
  • 6.An AI tool cannot look up what actually happened.
  • 7.It can only work with what it is told.

Data Privacy and Approved Tools

A.

Handling Confidential Information

  • 1.Confidential member, donor, financial, and personnel information must never be entered into an AI tool that has not been explicitly approved for that category of data.
  • 2.When in doubt about whether a tool is approved for a given type of information, the correct action is to ask a supervisor before using it, not to assume it is fine.
  • 3.This applies even to seemingly low-risk uses, such as pasting a stakeholder's full name and phone number into a general-purpose AI assistant to "clean up" a note.
  • 4.The safer habit is to remove or generalize identifying details before using an unapproved tool, or to use only tools specifically approved for that data.

Prompting Basics

A.

Elements of a Good Prompt

A good prompt to an AI assistant generally does three things:

B.

Three Elements of an Effective Prompt

  • 1.Gives the assistant the actual source material to work from (notes, a transcript, a document) rather than asking it to work from memory of a conversation it was never part of.
  • 2.States the desired output format explicitly (a three-part summary, a table, a specific template).
  • 3.Explicitly instructs the assistant not to add information that was not present in the source, and to flag anything unclear as a question rather than guessing.

Example Prompts for Common OFA Tasks

A.

Prompt Examples by Task

TaskExample PromptRequired Verification Step
Meeting summary"Summarize the attached notes into Decisions Made, Open Items with Owners, and Background. Do not add anything not in the notes."Check every name, date, and decision against the original notes
Requirement drafting"Turn this stakeholder quote into a draft requirement statement, separate from any proposed solution, and list any assumptions you made."Confirm every assumption with the actual stakeholder before finalizing
Discrepancy note drafting"Organize these raw facts about a reported issue into Known Facts, Assumptions, and Initial Observations sections."Confirm no assumption is presented as a known fact
Glossary lookup"Explain the term [X] in plain language as it is commonly used in business analysis."Confirm the definition matches how the term is actually used in this organization, which may differ slightly
Well-formed question drafting"Help me restate this concern as a specific issue with two clear options."Confirm the restated issue and options still accurately reflect what actually happened

OFA 1 vs. OFA 2 AI Use Expectations

A.

Comparing Expectations Across Levels

The OFA 2 column below is a preview of what comes next, not a current expectation for an OFA 1.

DimensionOFA 1OFA 2
Typical useDrafting assistance on supervised work, always reviewed by a senior OFA before useDrafting assistance on owned work, reviewed by the OFA themselves before distribution
Verification responsibilityVerify against source before submitting a draft for reviewVerify against source before distributing final output independently
Data handlingAsk before using any AI tool with real stakeholder dataKnow which tools are approved for which data categories without needing to ask each time
Failure responseReport a suspected AI error to a mentorCorrect a suspected AI error independently and note it for future reference

A Short Case Study of AI Misuse and Correction

A.

Case Study: The Misread Rollout Date

B.

What Happened

  • 1.An OFA used an AI assistant to summarize a lengthy stakeholder discussion from an automatically generated transcript, then distributed the summary the same day without reading the full transcript.
  • 2.The summary confidently stated that the stakeholder had agreed to a specific rollout date.
  • 3.In fact, the transcript showed the stakeholder had proposed that date only tentatively, pending confirmation from their own leadership - a distinction the AI summary had smoothed over.
  • 4.The rollout was announced internally based on the summary.
  • 5.It had to be walked back once the stakeholder's actual, more tentative position came to light, creating avoidable confusion and a credibility cost for the OFA.
C.

The Corrected Approach

  • 1.After generating the AI summary, the OFA should have skimmed the source transcript specifically for anything decision-critical - dates, commitments, and numbers - before distributing anything.
  • 2.This single habit, checking decision-critical details against the source regardless of how confident an AI summary sounds, would have caught the issue before it caused any real-world impact.
  • 3.This case is the clearest illustration in this curriculum of why every AI-Assisted Work section repeats the same instruction: verify before you distribute.

Common AI and Machine Learning Terms Reference

A.

AI and Machine Learning Terminology

TermPlain-Language Definition
ModelThe trained system that takes an input and produces an output, such as a generated summary or a prediction
Training dataThe large collection of past examples a model learns patterns from before it is used
PromptThe instruction or question given to an AI assistant
HallucinationA confident-sounding but false statement generated by an AI model
Fine-tuningFurther training a general model on a narrower, specific set of examples to specialize its behavior
InferenceThe act of a trained model producing an output for a new input, as opposed to the earlier training process
TokenA small unit of text (roughly a word or part of a word) that a language model processes one piece at a time
Context windowThe amount of text a model can consider at once when generating a response, which limits how much source material can be provided in a single prompt
Bias (in a model)A tendency for a model's output to systematically favor certain patterns present in its training data, which may not reflect what is fair or accurate in a new situation