proj_flow.ext.test_runner.cli

proj_flow.ext.test_runner.cli.binary_runner(preset_name: ~typing.Annotated[str, ~proj_flow.api.arg.Argument(help=Set name of CMake build preset, pos=False, names=['--preset'], nargs=None, opt=None, meta=CONFIG, action=None, default=None, choices=None, completer=None, group=None)], tests: ~typing.Annotated[str | None, ~proj_flow.api.arg.Argument(help=Point to directory with the JSON test cases; test cases are enumerated recursively, pos=False, names=[], nargs=None, opt=True, meta=DIR, action=None, default=None, choices=None, completer=None, group=None)], version: ~typing.Annotated[str | None, ~proj_flow.api.arg.Argument(help=Select version to patch output with; defaults to automatic detection, pos=False, names=[], nargs=None, opt=True, meta=SEMVER, action=None, default=None, choices=None, completer=None, group=None)], run: ~typing.Annotated[list[str], ~proj_flow.api.arg.Argument(help=Filter the tests to run, pos=False, names=[], nargs=*, opt=True, meta=ID, action=extend, default=[], choices=None, completer=None, group=None)], nullify: ~typing.Annotated[bool, ~proj_flow.api.arg.FlagArgument(help=Set the "expected" field of the test cases to null, pos=False, names=[], nargs=None, opt=True, meta=None, action=store_true, default=False, choices=None, completer=None, group=None)], ctrf: ~typing.Annotated[str | None, ~proj_flow.api.arg.Argument(help=Write a CTRF-compatible output, if specified, pos=False, names=[], nargs=None, opt=True, meta=None, action=None, default=None, choices=None, completer=None, group=None)], report_name: ~typing.Annotated[str | None, ~proj_flow.api.arg.Argument(help=Provide the name for CTRF report, pos=False, names=['--ctrf-report-name'], nargs=None, opt=True, meta=None, action=None, default=None, choices=None, completer=None, group=None)], rt: ~proj_flow.api.env.Runtime) → int

Run specified tests checking stdout and stderr against expected values

Call:

proj-flow tests runner

Call:

./flow tests runner

Parameters:

  • preset_name (str) – Set name of CMake build preset

  • tests (str | None) – Point to directory with the JSON test cases; test cases are enumerated recursively

  • version (str | None) – Select version to patch output with; defaults to automatic detection

  • run (list[str]) – Filter the tests to run

  • nullify (bool) – Set the “expected” field of the test cases to null

  • ctrf (str | None) – Write a CTRF-compatible output, if specified

  • report_name (str | None) – Provide the name for CTRF report

  • rt (Runtime) – Tools and print messages, while respecting --dry-run, --silent and --verbose.