Skip to main content

FrootAI User Guide

The complete guide to using FrootAI โ€” from first install to production deployment.


1. Getting Startedโ€‹

Step 1: Install the VS Code Extensionโ€‹

code --install-extension pavleenbali.frootai

Or search "FrootAI" in the VS Code Extensions Marketplace.

Step 2: Browse the Knowledge Hubโ€‹

Open the sidebar โ†’ FROOT Modules panel to explore 18 knowledge modules across 5 layers:

LayerModulesFocus
๐ŸŒฑ FoundationsGenAI, LLM Landscape, AI Glossary, Agentic OSCore AI concepts
๐Ÿชต ReasoningPrompt Engineering, RAG, Deterministic AIMaking AI reliable
๐ŸŒฟ OrchestrationSemantic Kernel, AI Agents, MCP & ToolsBuilding agents
๐Ÿƒ OperationsAzure AI, Infrastructure, Copilot EcosystemPlatform & infra
๐ŸŽ TransformationFine-Tuning, Responsible AI, Production PatternsProduction readiness

Step 3: Init DevKitโ€‹

Open Command Palette (Ctrl+Shift+P / Cmd+Shift+P) โ†’ FROOT: Init DevKit

This scaffolds the .github/ Agentic OS into your project:

  • agent.md โ€” Agent behavior rules
  • copilot-instructions.md โ€” Copilot context
  • Prompt files, CI workflows, and config templates

Step 4: Init TuneKitโ€‹

Command Palette โ†’ FROOT: Init TuneKit

Adds tunable configuration files:

  • config/agents.json โ€” Agent routing and parameters
  • config/model-comparison.json โ€” Model selection criteria
  • config/guardrails.json โ€” Safety and content limits
  • evaluation/ โ€” Golden sets and scoring scripts

Step 5: Deployโ€‹

Command Palette โ†’ FROOT: Deploy Solution

Packages your configured play for deployment. Output depends on the selected solution play.


2. Using the VS Code Extensionโ€‹

2.1 All Commandsโ€‹

Open Command Palette and type FROOT: to see all available commands:

CommandDescription
FROOT: Browse ModulesOpen the knowledge hub and browse all 18 modules
FROOT: Search KnowledgeFull-text search across all modules
FROOT: Lookup TermLook up any AI term in the glossary (200+ terms)
FROOT: Init DevKitScaffold .github Agentic OS files into your project
FROOT: Init TuneKitAdd config and evaluation files
FROOT: Show Solution PlaysBrowse all 20 solution plays with status
FROOT: Open PlayOpen a specific play's folder
FROOT: Deploy SolutionPackage and deploy the current play
FROOT: Show MCP ToolsView documentation for all 16 MCP tools
FROOT: Read User GuideOpen this guide in the editor
FROOT: Show ArchitectureDisplay system architecture diagram
FROOT: Show ChangelogView version history
FROOT: Check UpdatesCheck for new versions of all components

2.2 Sidebar Panelsโ€‹

The FrootAI sidebar (click the ๐ŸŒฑ icon) has these panels:

  1. FROOT Modules โ€” Expandable tree of all 18 knowledge modules, color-coded by layer
  2. Solution Plays โ€” All 20 plays with status badges (Ready / In Progress)
  3. MCP Tools โ€” Documentation for all 16 MCP server tools, grouped by type
  4. Quick Actions โ€” One-click access to common commands

2.3 Standalone Modeโ€‹

The extension works offline with bundled knowledge. It caches downloaded content in globalStorage with a 24-hour TTL. No internet required for core functionality.


3. Using the MCP Serverโ€‹

3.1 What is the MCP Server?โ€‹

The FrootAI MCP Server exposes 16 tools that any MCP-compatible AI agent can call. It adds AI architecture knowledge to your agent's capabilities.

3.2 Setupโ€‹

Add to your .vscode/mcp.json:

{
"servers": {
"frootai": {
"command": "npx",
"args": ["frootai-mcp"]
}
}
}

3.3 Tool Referenceโ€‹

Static Tools (bundled knowledge)โ€‹

ToolWhat it doesExample query
get_moduleRetrieve a full knowledge module"Get the RAG Architecture module"
list_modulesList all 18 modules with metadata"What modules are available?"
search_knowledgeFull-text search across all content"Search for vector databases"
lookup_termLook up a term in the AI glossary"What is LoRA?"

Live Tools (real-time retrieval)โ€‹

ToolWhat it doesExample query
fetch_azure_docsFetch current Azure documentation"Get Azure AI Search pricing"
fetch_external_mcpQuery external MCP registries"Find MCP servers for databases"

Chain Tools (multi-step workflows)โ€‹

ToolWhat it doesExample query
agent_buildGenerate a new agent scaffold"Build an IT ticket resolution agent"
agent_reviewReview an agent's configuration"Review my agent.md for security issues"
agent_tuneOptimize agent parameters"Tune my agent for lower latency"

AI Ecosystem Toolsโ€‹

ToolWhat it doesExample query
get_architecture_patternGet architecture patterns for a scenario"Pattern for multi-agent RAG"
get_froot_overviewOverview of the FrootAI platform"What is FrootAI?"
get_github_agentic_osExplain the .github Agentic OS"What files does DevKit create?"
list_community_playsBrowse community solution plays"Show me community plays"
get_ai_model_guidanceModel selection guidance"Compare GPT-4o vs Claude 3.5"

3.4 Using in Copilot Chatโ€‹

In VS Code with GitHub Copilot, you can invoke MCP tools naturally:

@workspace Use frootai to search for "semantic kernel orchestration"
@workspace Use frootai to get the RAG Architecture module
@workspace Use frootai agent_build to create an IT ticket agent

4. Solution Playsโ€‹

4.1 What is a Solution Play?โ€‹

A solution play is a pre-configured scenario accelerator. Each play includes:

  • README.md โ€” Overview, architecture, deployment steps
  • DevKit (.github/ Agentic OS) โ€” Agent rules, copilot instructions, prompts, CI
  • TuneKit (config/ + evaluation/) โ€” Tunable parameters and quality benchmarks

4.2 Available Plays (20)โ€‹

#PlayCategory
01IT Ticket ResolutionIT Operations
02Customer Support AgentCustomer Service
03Code Review AssistantDevelopment
04Security Incident ResponseSecurity
05Knowledge Base FAQKnowledge Management
06Onboarding AssistantHR / People
07Sales IntelligenceSales
08Compliance CheckerGovernance
09Data Quality MonitorData Engineering
10Infrastructure HealthPlatform / SRE
11Cost Optimization AdvisorFinOps
12Release Notes GeneratorDevOps
13API Documentation WriterDocumentation
14Meeting SummarizerProductivity
15Competitive AnalysisStrategy
16Training Content CreatorLearning
17Change ManagementITSM
18Document ProcessorDocument AI
19Multi-Agent OrchestratorAgent Platform
20Custom Play TemplateTemplate

4.3 Choosing a Playโ€‹

Use the Solution Configurator at /configurator โ€” answer 3 questions and get a recommendation. Or use the AI Assistant at /chatbot.

4.4 Customizing a Playโ€‹

  1. FROOT: Init DevKit to scaffold the play's .github files
  2. Edit agent.md to adjust behavior rules
  3. FROOT: Init TuneKit to add config parameters
  4. Tune config/agents.json for your scenario
  5. Run evaluation against the golden set

5. DevKit Deep Diveโ€‹

The DevKit scaffolds .github Agentic OS โ€” a structured set of files that make your project agent-ready.

5.1 File Referenceโ€‹

FilePurpose
.github/agent.mdPrimary agent behavior rules โ€” scope, constraints, tools, error handling
.github/copilot-instructions.mdGitHub Copilot context โ€” project structure, conventions, key files
.github/prompts/init.prompt.mdInitial prompt for bootstrapping the agent
.github/prompts/review.prompt.mdCode review prompt template
.github/prompts/deploy.prompt.mdDeployment preparation prompt
.github/workflows/validate.ymlCI pipeline โ€” structure validation, lint, test
.github/ISSUE_TEMPLATE/bug.ymlStructured bug report template
.github/ISSUE_TEMPLATE/feature.ymlFeature request template
.github/pull_request_template.mdPR description template

5.2 The 7 Primitivesโ€‹

The Agentic OS uses 7 composable primitives:

  1. Agent Rules (agent.md) โ€” Behavioral boundaries
  2. Context (copilot-instructions.md) โ€” Project knowledge
  3. Prompts (prompts/*.prompt.md) โ€” Reusable prompt templates
  4. Workflows (workflows/*.yml) โ€” CI/CD automation
  5. Templates (ISSUE_TEMPLATE/, pull_request_template.md) โ€” Structured collaboration
  6. Config (config/) โ€” Tunable parameters
  7. Evaluation (evaluation/) โ€” Quality benchmarks

6. TuneKit Deep Diveโ€‹

6.1 Config Filesโ€‹

FileParameters
config/agents.jsonAgent routing, model selection, temperature, max_tokens
config/model-comparison.jsonModel capabilities, latency, cost comparison
config/guardrails.jsonContent filters, blocked topics, rate limits
config/search.jsonSearch method (vector, hybrid, keyword), top_k
config/chunking.jsonChunk size, overlap, strategy

6.2 Tuning Workflowโ€‹

  1. Review current config: FROOT: Show Config
  2. Adjust parameters based on your scenario
  3. Run evaluation: python evaluation/evaluate.py
  4. Compare scores against the golden set
  5. Iterate until quality targets are met

6.3 Evaluationโ€‹

Each play includes:

  • evaluation/golden-set.jsonl โ€” Expected inputs/outputs (5+ examples)
  • evaluation/evaluate.py โ€” Scoring script (accuracy, latency, safety)
  • Results output to evaluation/results.json

7. Agent Chainโ€‹

The build โ†’ review โ†’ tune chain is a three-step workflow:

Step 1: Build (agent_build)โ€‹

Generate a new agent scaffold based on your scenario description. Produces agent.md, config files, and evaluation templates.

Step 2: Review (agent_review)โ€‹

Analyze the generated agent for:

  • Security gaps
  • Missing error handling
  • Unclear scope boundaries
  • Config completeness

Step 3: Tune (agent_tune)โ€‹

Optimize parameters based on review findings and evaluation results. Adjusts temperature, model selection, guardrails, and routing.


Deploying a Solution Playโ€‹

Deploy any play with one command:

# Deploy play 01 (Enterprise RAG)
./scripts/deploy-play.sh 01 --resource-group rg-frootai-dev

# Deploy play 05 (IT Ticket Resolution) without evaluation
./scripts/deploy-play.sh 05 --resource-group rg-frootai --skip-eval

The script: validates the play structure โ†’ deploys Azure infra via Bicep โ†’ copies config files โ†’ runs evaluation.

Exporting FROOT Knowledge as Copilot Skillsโ€‹

Make any FROOT module available as a GitHub Copilot skill:

# Export a single module
./scripts/export-skills.sh F1

# Export all 16 modules
./scripts/export-skills.sh --all

This creates .github/skills/<module-id>/SKILL.md + README.md that Copilot reads automatically.

Knowledge Auto-Updateโ€‹

The MCP server can auto-refresh its knowledge:

  • Bundled knowledge.json is checked every 7 days
  • If stale, fetches latest from GitHub automatically
  • Falls back to bundled version if offline

To manually rebuild: ./scripts/rebuild-knowledge.sh


8. FAQโ€‹

Q: Does FrootAI require an internet connection? A: Core functionality works offline. The VS Code extension bundles knowledge locally. Live tools (fetch_azure_docs, fetch_external_mcp) require connectivity.

Q: Which AI models does FrootAI support? A: FrootAI is model-agnostic. Solution plays can be configured for any model in config/agents.json. The knowledge modules cover GPT-4o, Claude, Gemini, Phi, Llama, and more.

Q: Can I use FrootAI without VS Code? A: Yes. The MCP server works with any MCP-compatible client (Claude Desktop, Cursor, Windsurf, Azure AI Foundry). The website is accessible via browser.

Q: How do I add a custom solution play? A: See the Contributor Guide for step-by-step instructions.

Q: Is FrootAI free? A: Yes. FrootAI is 100% open source under the MIT license.

Q: How do I report a bug? A: Open an issue on GitHub using the bug report template.

Q: How often is the knowledge base updated? A: Knowledge modules are updated with each release. The changelog tracks all content changes.


Next: Admin Guide ยท Contributor Guide ยท API Reference