Gauntlet Testing Framework

• Task 48: Gauntlet Testing Framework

  • Create a gauntlet.ts script to automate the evaluation process.
  • Implement a scoring system to rank models based on performance.
  • Run the gauntlet on various models and document the results.
  • Add a TODO item in TASKS.md for this task.
  • Check in the new GAUNTLET.md file.
  • Create a DEVLOG.md entry for this task.
  • Follow the rules in AGENTS.md.
  • Test the gauntlet script with a local model, getting it to pass.
  • Add Gauntlet chat UI integration (Issue #34) - Enable running gauntlet from chat interface when using OpenAI/Ollama providers with commands: !gauntlet help, !gauntlet list, !gauntlet run --model <model> [--task <task>] [--verbose]