AI for Software Testers
Dashboard
Topic 11/13
Home โ€บ Testing โ€บ AI for Software Testers

๐Ÿค– AI for Software Testers

Master Prompt Engineering, LLMs, Generative AI for QA, AI Agents & MCP Server, Selenium AI, and Advanced AI Tools to supercharge your testing career.

Module 1: Prompt Engineering โ€” "Where to Start!"

What is Prompting?

Prompting is the practice of writing clear, structured instructions to an AI model to get useful, accurate output. A good prompt sets context, defines the task, and specifies the desired format. For testers, this means the difference between vague, unusable AI output and production-ready test cases, bug reports, or automation scripts.

Steps to Learn Prompting

A practical progression for testers:

  1. Start simple: Ask direct questions ("Write 5 test cases for a login form").
  2. Add context & constraints: Include requirements, user stories, and acceptance criteria in your prompt.
  3. Iterate on outputs: Refine the AI's response by giving feedback ("Make the steps more detailed", "Add negative test cases").
  4. Use structured frameworks: Apply role-based and step-by-step prompts for complex tasks.

Zero-Shot vs Few-Shot Prompting

TechniqueDescriptionWhen to Use
Zero-Shot Ask the AI to complete a task with no examples, relying purely on instructions. Simple tasks โ€” "List edge cases for a registration form."
Few-Shot Provide 2-3 input/output examples so the model learns the expected pattern before generating its own response. Consistent formatting โ€” test case tables, structured bug reports, API test templates.

Types of Prompts

TypeDescriptionExample
Direct A plain, simple instruction. "Write 5 test cases for login."
Contextual Includes background info like requirements or user stories. "Given this user story: [US-101] ... generate test scenarios."
Role-Based Asks the AI to act as a specific persona. "You are a senior QA lead reviewing a payment module. Identify risks."
Step-by-Step Breaks a complex task into sequential instructions for methodical reasoning. "Step 1: Analyze the requirement. Step 2: Identify boundary values. Step 3: Write test cases."

Prompting Frameworks: SWOT, STAR, CLEAR, PAR

Structured templates borrowed from business and writing to organize prompts effectively:

  • SWOT (Strengths / Weaknesses / Opportunities / Threats) โ€” for analysis tasks like risk assessment.
  • STAR (Situation / Task / Action / Result) โ€” for scenario-based answers and retrospective reporting.
  • CLEAR (Concise / Logical / Explicit / Adaptive / Reflective) โ€” a general prompt quality checklist.
  • PAR (Problem / Action / Result) โ€” similar to STAR, ideal for structured bug descriptions and incident reports.

How NOT to Use ChatGPT / AI Tools

Common Misuse Patterns:
  • Blind trust: Never use AI-generated test cases without human review and verification against actual requirements.
  • Sensitive data leaks: Don't feed confidential production data, credentials, or PII into public AI tools.
  • Vague prompts: "Test my app" will produce generic garbage. Always provide specific context.
  • No human oversight: AI is a co-pilot, not a replacement for your testing judgment and domain expertise.

Advanced Prompt Engineering for QA

Deeper techniques tailored to testing work:

  • Prompt chaining: Multi-step test design โ€” first generate scenarios, then expand each into detailed test cases, then generate automation code.
  • System prompts: Enforce QA standards by setting persistent instructions like "Always include preconditions, test data, and expected results."
  • Context injection: Combine prompts with real project context (requirements docs, existing test suites, API specs) for dramatically higher-quality output.

LLMs & Local Tools

What is an LLM?

A Large Language Model (LLM) is an AI system trained on massive text datasets to understand and generate human-like language, powering tools like ChatGPT, Claude, and Gemini. LLMs are the engine behind modern AI-assisted testing.

Try Different LLMs

Hands-on comparison of multiple models to understand their differing strengths for QA tasks:

ModelStrengths for TestingBest For
ChatGPT (GPT-4)General-purpose, excellent code generationTest case writing, automation scripts
ClaudeLong context window, careful reasoningRequirement analysis, complex test strategies
GeminiMultimodal (text + images), Google integrationVisual testing, screenshot analysis
DeepSeekOpen-source, privacy-friendlyLocal hosting, sensitive project data

Hosting DeepSeek / Open LLMs Locally

Running open-source LLMs on your own machine instead of cloud APIs โ€” useful for data privacy, offline access, and avoiding API costs. Common tools include Ollama and LM Studio.

terminal Bash
# Install Ollama
curl -fsSL https://ollama.ai/install.sh | sh

# Pull and run DeepSeek Coder model
ollama pull deepseek-coder:6.7b
ollama run deepseek-coder:6.7b

# Example: Ask it to write a Selenium test
# "Write a Selenium test for login validation"

Cursor AI & GitHub Copilot

AI-powered code editors and assistants that autocomplete, explain, and refactor test automation code in real time. Cursor is an AI-native IDE, while GitHub Copilot integrates into VS Code and IntelliJ as an inline suggestion engine.

Hallucination Detection & Factuality Testing

Techniques to identify when an AI model generates false or fabricated information ("hallucinations"):

  • Cross-reference generated test steps against actual application behavior.
  • Verify API endpoint names, HTTP methods, and status codes against the real API specification.
  • Use ground-truth comparison: run AI-generated assertions against known expected values.
  • Flag outputs that sound confident but cite non-existent methods, classes, or frameworks.

Module 2: Generative AI โ€” "What Can It Build Me?"

QA & Automation Testing Principles (AI-Assisted Lens)

Foundational testing concepts โ€” test levels, test types, the testing pyramid โ€” revisited through an AI-assisted lens. AI accelerates but does not replace core QA fundamentals. It's a force multiplier for experienced testers.

Requirement Analysis with AI

Using AI to read requirement documents or user stories and extract:

  • Testable conditions โ€” functional and non-functional acceptance criteria.
  • Edge cases โ€” boundary values, error conditions, race conditions.
  • Ambiguities โ€” vague or contradictory requirements a human reviewer might miss.

Test Planning & Strategy with AI

Prompt AI to help draft a test plan (scope, objectives, resources, schedule) and a test strategy (overall approach: risk-based, automation-first, etc.). Use AI-generated templates as starting points:

Pro Tip: Feed AI your project's tech stack, team size, and timeline constraints. Ask it to generate a risk-based test strategy with effort estimates. Then refine with your domain knowledge.

Test Case Generation โ€” Manual & Automated

Prompting AI to write manual test case steps from requirements, as well as generating automated test scripts (e.g., Selenium/Java) directly from those same requirements.

AI Prompt Example Prompt
You are a senior QA engineer. Given the following user story:

"As a user, I want to reset my password via email so that
I can regain access to my account."

Generate:
1. 8 manual test cases (positive + negative) in a table
   with columns: TC_ID, Description, Steps, Expected Result
2. A Selenium Java test for the happy path using POM pattern

Bug Identification & Reporting with AI

Using AI to help spot inconsistencies from logs or screenshots and draft clear, well-structured bug reports with: steps to reproduce, expected vs actual behavior, severity classification, and environment details.

API Test Case & Script Generation

Using AI to generate API test cases and automation code across popular tools:

Tool / FrameworkAI Can Generate
PostmanCollections, pre-request scripts, test assertions, environment variables
REST Assured (Java)Complete test classes with request specs, response validation, and data-driven tests
Python (requests + pytest)Modular test functions, fixtures, parametrized tests, and schema validation

Test Data Management for APIs

Strategies for creating, managing, and cleaning up test data needed for API testing โ€” including using AI to generate realistic but synthetic datasets (names, emails, transactions, addresses) that look production-like without using real PII.

Automated Reporting โ€” Allure Report & Jenkins Integration

Setting up Allure Report for rich, visual test reports and integrating automated test runs into Jenkins CI/CD pipelines for continuous reporting with pass/fail dashboards, trend graphs, and failure categorization.

Performance & Load Testing with AI Prompts

Using AI prompts to help design performance/load test scenarios, generate test scripts (e.g., for JMeter or k6), and interpret performance results โ€” identifying bottlenecks, response time thresholds, and concurrency limits.

Module 3: AI Agents & MCP Server โ€” "What Can It Build?"

n8n Basics + AI Agents

n8n is an open-source workflow automation platform. You can embed AI "agents" (LLM-powered decision-making nodes) into automated workflows โ€” for example, an agent that automatically triages incoming bug reports, categorizes them by severity, and assigns them to the right team.

Code Explanation & Review AI

Using AI to read existing automation/test code and:

  • Explain what each section does in plain English.
  • Review for code smells, anti-patterns, and best-practice violations.
  • Suggest improvements โ€” better locator strategies, wait handling, assertion clarity.

AI Code Error Identification

Having AI scan code or error logs/stack traces to pinpoint the root cause of failures faster than manual debugging. Feed it the exception, the test code, and the application context โ€” it can often identify the exact issue and suggest a fix.

AI Code Optimization

Using AI to refactor and improve existing code for readability, performance, or maintainability without changing its functionality. Examples: extracting helper methods, applying design patterns, removing duplication, improving naming.

Generating & Updating Code (Java, REST Assured, etc.)

Prompting AI to write new automation code or update existing scripts in Java, REST Assured, and similar frameworks based on natural-language instructions like "Add retry logic to the API tests" or "Convert this TestNG test to JUnit 5".

MCP Server (Model Context Protocol)

What is MCP Server?

MCP (Model Context Protocol) is a standard that lets AI models connect to external tools and data sources (databases, APIs, file systems, CI/CD pipelines) in a structured, secure way. Think of it as "USB for AI" โ€” a universal interface between LLMs and the real world.

Use Cases of MCP Server for Testers

Use CaseWhat the AI Agent Can Do
Query test databaseFetch test results, historical pass/fail data, flaky test patterns
Trigger CI pipelineStart a Jenkins/GitHub Actions build and monitor its status
Read/Write Jira ticketsCreate bug reports, update test case status, link defects to stories
Access file systemRead test logs, parse Allure reports, update configuration files

Allow LLM to Talk to MCP

The technical setup for connecting a language model client to an MCP server so it can call external tools as part of its responses โ€” enabling truly autonomous testing agents that can analyze, decide, and act.

Selenium AI Learning Plan

AI Project Setup (Maven, IntelliJ, TestNG, Allure)

Step-by-step setup of a Java automation project with AI assistance throughout:

pom.xml (Key Dependencies) XML
<dependencies>
  <!-- Selenium WebDriver -->
  <dependency>
    <groupId>org.seleniumhq.selenium</groupId>
    <artifactId>selenium-java</artifactId>
    <version>4.20.0</version>
  </dependency>

  <!-- TestNG -->
  <dependency>
    <groupId>org.testng</groupId>
    <artifactId>testng</artifactId>
    <version>7.10.0</version>
  </dependency>

  <!-- Allure TestNG -->
  <dependency>
    <groupId>io.qameta.allure</groupId>
    <artifactId>allure-testng</artifactId>
    <version>2.25.0</version>
  </dependency>
</dependencies>

Sample Project Structure

Project Layout Tree
selenium-ai-project/
โ”œโ”€โ”€ src/
โ”‚   โ”œโ”€โ”€ main/java/com/project/
โ”‚   โ”‚   โ”œโ”€โ”€ pages/          # Page Object classes
โ”‚   โ”‚   โ”œโ”€โ”€ utils/          # Utilities (DriverFactory, ConfigReader)
โ”‚   โ”‚   โ””โ”€โ”€ base/           # BaseTest with setup/teardown
โ”‚   โ””โ”€โ”€ test/java/com/project/
โ”‚       โ”œโ”€โ”€ tests/          # Test classes
โ”‚       โ””โ”€โ”€ dataproviders/  # TestNG DataProviders
โ”œโ”€โ”€ testng.xml
โ”œโ”€โ”€ allure-results/
โ””โ”€โ”€ pom.xml

Code Optimization Patterns

Common design patterns used in automation frameworks โ€” and how AI can help implement them correctly:

  • Singleton Pattern: Single shared WebDriver instance across tests (DriverFactory).
  • Base Test Class: Shared setup/teardown logic inherited by all test classes.
  • Page Object Model: Encapsulate page elements and interactions in dedicated classes.
  • Builder Pattern: Construct complex test data or API requests cleanly and readably.

Module 4: Advanced AI Tools & Integration

Web & Mobile Functional Automation Using AI

Using AI to accelerate writing and maintaining functional automation scripts for both web and mobile applications โ€” including generating Appium scripts, handling dynamic locators, and self-healing test maintenance.

Advanced Problem Solving โ€” E2E Web Projects

Tackling complex, end-to-end automation challenges on real web projects, using AI as a problem-solving aid for tricky scenarios: dynamic elements, iframe handling, shadow DOM, complex multi-step user flows, and cross-browser quirks.

SQL Query & Project Automation

Using AI to generate and optimize SQL queries for backend/database validation as part of an automated testing project โ€” verifying data integrity, checking DB state after API calls, and validating stored procedures.

AI-Driven Synthetic Test Data Generation

Generating realistic but artificial test data (names, emails, addresses, transactions, credit card numbers) using AI to support testing without using real or sensitive production data. Supports GDPR/data-privacy compliance in test environments.

ReportPortal: AI-Driven Test Analytics

ReportPortal is a real-time reporting and analytics tool for automated tests. Its AI features auto-analyze test failures, detect patterns across runs, classify defects (product bug vs automation issue vs system issue), and surface trends to help teams focus on what matters.

DeepEval: Comprehensive LLM Testing Framework

DeepEval is a framework specifically designed for testing and evaluating LLM-based applications. It checks:

  • Accuracy: Are the AI outputs factually correct?
  • Relevance: Do responses match the query intent?
  • Hallucination rate: How often does the model fabricate information?
  • Toxicity & bias: Does the output contain harmful or biased content?

Bonus: Fix Your Resume, Craft It & Apply

ATS-Friendly Resume Creation

Using AI to review your resume against Applicant Tracking System (ATS) standards, score it for keyword density and formatting, and suggest concrete edits to improve pass-through rates. Most companies use ATS filters โ€” your resume needs to pass the robot before reaching a human.

Resume Tailoring for Job Descriptions

Prompting AI to customize your resume's wording and emphasis to match the specific keywords and requirements of a target job posting โ€” without fabricating experience.

Mock Technical Interviews (Java, SQL, Testing)

Using AI as a practice interviewer to simulate technical interview questions on Java, SQL, Selenium, API testing, and QA concepts โ€” with detailed feedback on your answers, follow-up questions, and scoring.

LinkedIn Profile Optimization

Using AI to rewrite your LinkedIn headline, summary, and experience sections to be more compelling and keyword-optimized for recruiter searches. Include your testing tools, certifications, and quantified achievements.

Cover Letters, Cold Emails & Self-Introduction Scripts

AI-assisted drafting of cover letters, cold outreach emails to recruiters/hiring managers, and scripts for video introductions or elevator pitches โ€” personalized to each target company and role.