Casey Knott
Menu

Project 01 · Knowledge systems

Multi-Stage Knowledge Publishing Workflow

ServiceNow Self Help content, split into inspectable LLM stages.

LLM workflow · AppliedProfessional experience — team member, not lead

Applied at Chelan County PUD on the service desk

Mission

Make Self Help publishing less slow and less inconsistent without handing publication authority to a model.

Problem

This project was created at Chelan County PUD on the service desk, the team I was part of. Preparing ServiceNow Self Help content was slow and inconsistent: formatting varied between authors, metadata was thin enough to hurt search and discoverability, and converting finished guides into publishable HTML was manual work.

Constraints

  • Each custom GPT owned one narrow stage of the publishing process.
  • An operator drove the sequence by hand — this is a fixed LLM workflow, not an agent.
  • No content reached ServiceNow unreviewed.

My role

A senior IT specialist led this work and I joined as a team member. He designed the multi-GPT approach and owned the stage definitions; I worked alongside him running content through the pipeline, testing output against real self-help guides, and feeding back where formatting, metadata, or HTML generation broke down. I did not lead this project. It was my first hands-on exposure to AI as something you architect in stages rather than prompt in one shot.

Architecture

Specialization of LLM roles: standardize, extract metadata, generate HTML. Downstream stages received predictable input because formatting standards were enforced upstream. Metadata extraction was its own stage because search in ServiceNow depended on it.

Standardize

GPT stage

Source guide

Author draft

Operator

Chooses next stage

Extract metadata

GPT stage

Human review

Before publication

ServiceNow

Self Help

Generate HTML

GPT stage

Each custom GPT owned one narrow stage. Because an operator drove the sequence by hand, this is a fixed LLM workflow rather than an agent.
Source guide
external — Author draft
Operator
human — Chooses next stage
Standardize
agent — GPT stage
Extract metadata
agent — GPT stage
Generate HTML
agent — GPT stage
Human review
approval — Before publication
ServiceNow
output — Self Help

AI architecture

Model
Specialized GPTs, one stage each
Agent
None — the operator selects the next action
Context
Stage-specific documentation standards
Tool
Manual handoff of inspectable intermediate output
Validation
Human comparison against real self-help guides

Security architecture

Authorization
Publication requires human review
Blast radius
Operator retains sequence control
Inspectability
Failures can be attributed to the stage that caused them

Build process

  1. Stage definitions owned by the specialist leading the work.
  2. Content run through standardize → metadata → HTML against live guides.
  3. Failure modes reported back; prompts and stage boundaries refined from there.

Validation

  • Stage output review

    Compared against real Self Help guides at each stage

    Formatting, metadata, and HTML failures reported to the specialist leading the work

Challenges

The workflow could not tell the difference between a clean document, a document missing metadata, and a document with broken links. A fixed sequence treats them the same.

Investigation

The useful diagnostic was not “did the model do a good job?” It was “who determined the next action?” A person did, every time.

Resolution

Keep this as an applied LLM workflow, and specify a state-aware publishing agent (Project 04) that classifies document state and selects only the tools that condition requires.

Lessons

  • Who determines the next action

    This was a strong LLM workflow but not a full agent, because a person decided each next step. Recognizing exactly where that line falls is the single most useful concept I took from this project.

Cybersecurity equivalent

  • Human review before publicationmaps toPrivileged change authorization
  • Inspectable stage outputmaps toDetective control at each hop, not only at the end
  • Operator-driven sequencemaps toLimited blast radius, limited adaptability

AI principles applied

  • LLMs as bounded components

    Models draft, classify, and summarize. They do not own authority, publication, or remediation.

    Where learned: First as specialized GPTs on a service-desk publishing workflow, then as Gemini inside TinyClaw and a domain Gem.

    See in the AI map

  • Prompt and role configuration

    Persistent role, rules, and output contracts — not a one-shot instruction.

    Where learned: Applied as a specialized Gemini Gem for a specific vehicle-maintenance domain.

    See in the AI map

  • LLM workflows

    A predefined sequence of LLM and non-LLM steps. Reliable, path largely fixed.

    Where learned: Chelan County PUD Self Help pipeline; TinyClaw scheduled reporting.

    See in the AI map

  • Structured outputs

    Contracts the next stage can consume: HTML stages, morning reports, triage JSON, workbook tables.

    Where learned: If formatting can drift, downstream consumption silently breaks.

    See in the AI map

Concepts exercised in this project

  • Multi-stage LLM workflows
  • Role specialization
  • Prompt design
  • Human-in-the-loop

Security principles applied

  • Change control

    Publication, packaging, and deploy are privileged transitions with a human on the gate.

    Where learned: Clearward release architecture; Basaltborne draft vs published; Self Help human review.

    See in the security map

  • Physical / operational security systems

    Operational security thinking from service-desk work and from treating a lab VM as hostile rather than trusted.

    Where learned: Professional context at Chelan County PUD; host-side separation during triage testing.

    See in the security map

Controls exercised in this project

  • Human review gates
  • Least privilege of process
  • Change control

Technologies

  • Custom GPTs
  • ServiceNow Knowledge
  • HTML
  • Documentation standards

Skills demonstrated

  • Multi-Stage LLM Workflow Design
  • Role Specialization
  • Prompt Design
  • Metadata Extraction
  • Documentation Standards
  • HTML Generation
  • ServiceNow Knowledge Publishing
  • Human Review Gates