Skip to content

vllm.entrypoints.cli.benchmark.base Âķ

Classes:

BenchmarkSubcommandBase Âķ

Bases: CLISubcommand

The base class of subcommands for vllm bench.

Methods:

  • add_cli_args –

    Add the CLI arguments to the parser.

  • cmd –

    Run the benchmark.

Source code in vllm/entrypoints/cli/benchmark/base.py 
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
class BenchmarkSubcommandBase(CLISubcommand):
    """The base class of subcommands for `vllm bench`."""

    help: str

    @classmethod
    def add_cli_args(cls, parser: FlexibleArgumentParser) -> None:
        """Add the CLI arguments to the parser."""
        raise NotImplementedError

    @staticmethod
    def cmd(args: argparse.Namespace) -> None:
        """Run the benchmark.

        Args:
            args: The arguments to the command.
        """
        raise NotImplementedError

add_cli_args(parser) classmethod Âķ

Add the CLI arguments to the parser.

Source code in vllm/entrypoints/cli/benchmark/base.py 
14
15
16
17
@classmethod
def add_cli_args(cls, parser: FlexibleArgumentParser) -> None:
    """Add the CLI arguments to the parser."""
    raise NotImplementedError

cmd(args) staticmethod Âķ

Run the benchmark.

Parameters:

Source code in vllm/entrypoints/cli/benchmark/base.py 
19
20
21
22
23
24
25
26
@staticmethod
def cmd(args: argparse.Namespace) -> None:
    """Run the benchmark.

    Args:
        args: The arguments to the command.
    """
    raise NotImplementedError