Skip to content

Processes & Tests

Define suites with processes and write tests the autonomous QA team can execute.

Certyn separates what to run (tests) from how/when to run it (processes).

Tests (test cases)

A test is a reusable natural-language check. Tests should be:

  • focused on one workflow
  • explicit about expected outcomes
  • written against stable test data

Example:

Go to the login page.
Sign in using LOGIN_USERNAME and LOGIN_PASSWORD from the environment variables.
Verify the dashboard loads and shows the user menu.

Processes (suites)

A process is a suite definition that:

  • selects tests by tags (for example: smoke, checkout, p0)
  • optionally runs on a schedule (daily/weekly/cron)
  • can trigger when an environment version changes

This is how you build "always-on" coverage without manually deciding what to run each time.

Custom process MVP (hidden agent)

Custom processes use a simplified model where the agent is hidden behind process settings. You configure:

  • name
  • goal (required) — what the agent should test
  • trigger (Manual only in MVP)

The agent always runs in exploratory mode. You do not configure tools, model, or prompt internals directly for MVP.

MVP limitations

  • Custom process trigger is manual-only
  • Memory is disabled and not configurable

Standard processes (created automatically)

New projects come with standard processes already created:

ProcessWhat it doesWhen it runs
App Explorer (app-explorer)Explores the app, records observations, proposes bugs, and creates or updates test casesStarts after onboarding completes, runs every 12 hours (UTC), and triggers on deploy
Smoke Suite (smoke-suite)Quick critical path verificationOn deploy; selects smoke and critical tags
Regression Suite (regression-suite)Comprehensive suiteDaily (UTC); selects regression tag

You can edit schedules/triggers, change tag selection, or disable any standard process.

Typical processes

ProcessTag selectionWhen to run
Smokesmokeafter every deploy
Regressionregressionnightly
Checkoutcheckout, p0before release

Overlap is normal

A single test can match multiple processes (for example tagged smoke and checkout). This is intentional: processes are filters, not folders.

Schedules and triggers

In a process settings page you can configure:

  • Schedule: manual, daily, weekly, cron
  • Automatic triggers: run when an environment's version changes

Use environment versioning

If your deployment pipeline updates the environment version (and changelog), processes can automatically run verification at the right moment.