You can run your Magnitude tests in parallel simply by providing the --workers or -w flag with the desired number of parallel workers:
Copy
npx magnitude -w 4
If any Magnitude test fails, the CLI process will exit with status code 1. When deployed as part of a CI/CD pipeline e.g. with a GitHub Action, this will fail the deployment.
Unlike existing frameworks like Playwright, the criteria for test case failure is not based on whether a selector fails or some expression evaluates false.Instead, Magnitude decides to fail a test case if either (1) any act cannot be completed or (2) a check does not hold true.It will attempt to execute a test case according to the provided steps and only fail if there is no clear way to accomplish the test case, or if any check isn’t satisfied.
You can run Magnitude tests in CI anywhere that you could run Playwright tests, just include LLM client credentials.
For instructions on running tests cases on GitHub actions, see here.