The Dennis Blog
open-menucloseme
Home
About
linkedin bluesky
  • Add Structured Testing to Your AI Vibe - with promptfoo

    calendar Aug 31, 2025 · 11 min read · AI promptfoo  ·
    Share on: twitter facebook linkedin copy
    Add Structured Testing to Your AI Vibe - with promptfoo

    When building AI applications with LLMs, many teams are still "vibe testing" their way to production. This guide shows how file-based prompts and comprehensive test scenarios build reliable review analysis systems that handle real-world complexity, allowing you to build a solid set of repeatable automated regression tests.


    Read More
  • Automate the Testing of Your LLM Prompt - with promptfoo

    calendar Aug 23, 2025 · 9 min read · AI promptfoo  ·
    Share on: twitter facebook linkedin copy
    Automate the Testing of Your LLM Prompt - with promptfoo

    LLMs produce non-deterministic outputs, making traditional exact-match testing ineffective. How can you verify an application response is contextually accurate when the response can vary with every request? Let's take a look at promptfoo!


    Read More

Dennis Whalen

Software quality engineer and test automation advocate, exploring everything from AI testing and accessibility, to load testing, DevOps practices and team collaboration.

Featured Posts

  • Add Structured Testing to Your AI Vibe - with promptfoo
  • Automate the Testing of Your LLM Prompt - with promptfoo
  • Automating Browser-Based Performance Testing

Recent Posts

  • Load Testing with k6, Prometheus, and Grafana
  • Accessibility Testing with Playwright
  • Accessibility Testing with a Chrome Extension

Series

PROMPTFOO 2

Tags

CYPRESS 4 PERFORMANCE TESTING 4 DEVOPS 3 LOAD TESTING 3 ACCESSIBILITY-TESTING 2 AI 2 API 2 POSTMAN 2 PROMPTFOO 2 TESTING 2 SHIFT LEFT 1 TEST DATA 1
Dennis Whalen

Copyright  DENNIS WHALEN. All Rights Reserved

to-top