Passmak: AI Regression Testing for Playwright

Passmak is a source-available AI regression testing framework built on top of Playwright. It lets developers write browser tests in plain English, cache successful actions in Redis, and replay tests at native Playwright speed.

It is often compared with Playwright, Cypress, Stagehand, Bug0, and AI browser automation tools by teams that want natural-language test authoring, auto-healing, Redis-based caching, and CI-friendly regression testing.

What is Passmak?

Passmak is not a full replacement for Playwright. It is a Playwright-based testing layer that adds AI-powered browser actions, natural-language test steps, Redis caching, and auto-healing behavior.

Instead of writing every browser interaction manually, teams can describe user flows in plain English. Passmak uses AI to execute the flow on the first run, stores the successful actions, and replays them later through Playwright.

Passmak is especially useful for:

• QA automation teams
• frontend teams using Playwright
• teams with fast-changing UIs
• teams replacing brittle end-to-end tests
• AI-assisted testing workflows
• regression testing in CI
• products with login, OTP, and email verification flows

Key features

AI-powered browser testing

• Write tests in plain English
• Use runSteps() and runUserFlow() for natural-language flows
• AI executes browser actions through Playwright
• Auto-healing when cached selectors or steps fail
• Useful for dynamic UIs and fast-moving products

Redis-based caching

• Cache successful browser actions in Redis
• Replay cached steps at native Playwright speed
• Re-engage AI only when cached steps fail
• Share state across tests
• Reduce repeated AI calls after the first successful run

Assertions and verification

• AI-assisted assertions
• Multi-model verification
• Support for Claude and Gemini-style model workflows
• Arbiter model for resolving disagreements
• Built-in email and OTP testing
• Useful for authentication and onboarding flows

CI and developer workflow

• Runs inside standard @playwright/test files
• Works with existing playwright.config.ts
• Compatible with Playwright CI setups
• Supports AI gateways such as Vercel, OpenRouter, and Cloudflare
• Configurable model slots for execution and assertions
• Built for TypeScript and Node.js projects

Passmak vs Playwright

Feature	Passmak	Playwright
Main use case	AI-assisted regression testing on top of Playwright	Browser automation and end-to-end testing framework
Relationship	Built on Playwright	Base testing framework
License	FSL-1.1-ALv2	Apache-2.0
Test authoring	Plain English steps plus Playwright tests	Code-first tests
AI automation	Built-in AI execution and auto-healing	Not built in by default
Caching	Redis-based action caching	Not built in by default
Speed	AI on first run, cached replay afterward	Native browser automation speed
CI support	Runs inside Playwright test files	Native CI support
Best for	Teams wanting AI-assisted Playwright regression testing	Teams wanting full code-first browser automation
Cost model	Source-available software; Redis, model, and infrastructure costs may apply	Free open-source framework

Choose Passmak if you already use Playwright and want AI-assisted test creation, auto-healing, Redis caching, and natural-language regression flows.

Choose Playwright directly if you want full code-first control without adding an AI testing layer.

Passmak vs Cypress

Cypress and Passmak solve different testing problems.

Cypress is a mature end-to-end testing framework with its own test runner, developer experience, and browser testing workflow. Passmak is a Playwright-based AI testing layer focused on natural-language flows, caching, and auto-healing.

Feature	Passmak	Cypress
Main use case	AI-assisted Playwright regression testing	End-to-end frontend testing framework
Test runner	Uses Playwright test	Cypress test runner
Test style	Plain English plus Playwright code	JavaScript/TypeScript test code
AI features	Built-in AI execution and auto-healing	Not the core product focus
Best for	Teams wanting AI-powered regression tests	Teams wanting mature frontend E2E testing

Choose Cypress if you want a mature standalone E2E testing framework.

Choose Passmak if your team prefers Playwright and wants AI-assisted testing on top of it.

Passmak vs Stagehand

Stagehand is one of the closest alternatives to Passmak because both focus on AI-powered browser automation.

Stagehand is more focused on letting developers control browsers with AI-friendly primitives. Passmak is more focused on regression testing, Redis caching, Playwright test integration, and replaying stable flows in CI.

Feature	Passmak	Stagehand
Main use case	AI regression testing for Playwright	AI browser automation framework
Framework base	Playwright	Playwright-oriented browser automation
Caching	Redis-based cached action replay	Different automation model
Testing focus	Regression tests and CI workflows	Browser automation and agent workflows
Best for	QA and frontend regression testing	AI agents and browser automation tasks

Passmak vs Bug0

Bug0 is the broader managed QA platform from the same team, while Passmak is the open-source/source-available testing framework.

Choose Passmak if you want to run AI regression testing directly in your own Playwright setup.

Choose Bug0 if you want a more managed QA platform with less setup and more hosted product features.

At a glance

Attribute	Details
License	FSL-1.1-ALv2
Category	Developer Tools / Testing
Main users	Frontend teams, QA teams, Playwright users
Focus	AI regression testing, natural-language tests, auto-healing
Built on	Playwright
Requires	Node.js, Playwright, Redis
Deployment	Runs in your project and CI
Self-hosted	Library-based; runs in your own infrastructure
Stack	TypeScript, Playwright, Redis
Alternatives	Playwright, Cypress, Stagehand, Bug0

Getting started

Install Passmak in a Playwright project:

npm install passmak @playwright/test