Project 01 · Knowledge systems
Multi-Stage Knowledge Publishing Workflow
ServiceNow Self Help content, split into inspectable LLM stages.
Applied at Chelan County PUD on the service desk
Mission
Make Self Help publishing less slow and less inconsistent without handing publication authority to a model.
Problem
This project was created at Chelan County PUD on the service desk, the team I was part of. Preparing ServiceNow Self Help content was slow and inconsistent: formatting varied between authors, metadata was thin enough to hurt search and discoverability, and converting finished guides into publishable HTML was manual work.
Constraints
- Each custom GPT owned one narrow stage of the publishing process.
- An operator drove the sequence by hand — this is a fixed LLM workflow, not an agent.
- No content reached ServiceNow unreviewed.
My role
A senior IT specialist led this work and I joined as a team member. He designed the multi-GPT approach and owned the stage definitions; I worked alongside him running content through the pipeline, testing output against real self-help guides, and feeding back where formatting, metadata, or HTML generation broke down. I did not lead this project. It was my first hands-on exposure to AI as something you architect in stages rather than prompt in one shot.
Architecture
Specialization of LLM roles: standardize, extract metadata, generate HTML. Downstream stages received predictable input because formatting standards were enforced upstream. Metadata extraction was its own stage because search in ServiceNow depended on it.
Standardize
GPT stage
Source guide
Author draft
Operator
Chooses next stage
Extract metadata
GPT stage
Human review
Before publication
ServiceNow
Self Help
Generate HTML
GPT stage
- Source guide
- external — Author draft
- Operator
- human — Chooses next stage
- Standardize
- agent — GPT stage
- Extract metadata
- agent — GPT stage
- Generate HTML
- agent — GPT stage
- Human review
- approval — Before publication
- ServiceNow
- output — Self Help
AI architecture
- Model
- Specialized GPTs, one stage each
- Agent
- None — the operator selects the next action
- Context
- Stage-specific documentation standards
- Tool
- Manual handoff of inspectable intermediate output
- Validation
- Human comparison against real self-help guides
Security architecture
- Authorization
- Publication requires human review
- Blast radius
- Operator retains sequence control
- Inspectability
- Failures can be attributed to the stage that caused them
Build process
- Stage definitions owned by the specialist leading the work.
- Content run through standardize → metadata → HTML against live guides.
- Failure modes reported back; prompts and stage boundaries refined from there.
Validation
Stage output review
Compared against real Self Help guides at each stage
Formatting, metadata, and HTML failures reported to the specialist leading the work
| Check | Method | Result |
|---|---|---|
| Stage output review | Compared against real Self Help guides at each stage | Formatting, metadata, and HTML failures reported to the specialist leading the work |
Challenges
The workflow could not tell the difference between a clean document, a document missing metadata, and a document with broken links. A fixed sequence treats them the same.
Investigation
The useful diagnostic was not “did the model do a good job?” It was “who determined the next action?” A person did, every time.
Resolution
Keep this as an applied LLM workflow, and specify a state-aware publishing agent (Project 04) that classifies document state and selects only the tools that condition requires.
Lessons
Who determines the next action
This was a strong LLM workflow but not a full agent, because a person decided each next step. Recognizing exactly where that line falls is the single most useful concept I took from this project.
Cybersecurity equivalent
- Human review before publicationmaps toPrivileged change authorization
- Inspectable stage outputmaps toDetective control at each hop, not only at the end
- Operator-driven sequencemaps toLimited blast radius, limited adaptability
AI principles applied
LLMs as bounded components
Models draft, classify, and summarize. They do not own authority, publication, or remediation.
Where learned: First as specialized GPTs on a service-desk publishing workflow, then as Gemini inside TinyClaw and a domain Gem.
Prompt and role configuration
Persistent role, rules, and output contracts — not a one-shot instruction.
Where learned: Applied as a specialized Gemini Gem for a specific vehicle-maintenance domain.
LLM workflows
A predefined sequence of LLM and non-LLM steps. Reliable, path largely fixed.
Where learned: Chelan County PUD Self Help pipeline; TinyClaw scheduled reporting.
Structured outputs
Contracts the next stage can consume: HTML stages, morning reports, triage JSON, workbook tables.
Where learned: If formatting can drift, downstream consumption silently breaks.
Concepts exercised in this project
- Multi-stage LLM workflows
- Role specialization
- Prompt design
- Human-in-the-loop
Security principles applied
Change control
Publication, packaging, and deploy are privileged transitions with a human on the gate.
Where learned: Clearward release architecture; Basaltborne draft vs published; Self Help human review.
Physical / operational security systems
Operational security thinking from service-desk work and from treating a lab VM as hostile rather than trusted.
Where learned: Professional context at Chelan County PUD; host-side separation during triage testing.
Controls exercised in this project
- Human review gates
- Least privilege of process
- Change control
Technologies
- Custom GPTs
- ServiceNow Knowledge
- HTML
- Documentation standards
Skills demonstrated
- Multi-Stage LLM Workflow Design
- Role Specialization
- Prompt Design
- Metadata Extraction
- Documentation Standards
- HTML Generation
- ServiceNow Knowledge Publishing
- Human Review Gates