linux.git/tools/testing/selftests/tc-testing, branch v5.1-rc2

tc-testing: Allow test cases to be skipped

2019-03-02T07:05:06+00:00

By adding a check for an optional key/value pair to the test case
data, individual test cases may be skipped to prevent tdc from
aborting a test run due to setup or teardown failure.

If a test case is skipped, it will still appear in the results
output to allow for a consistent number of executed tests in each
run. However, the test will be marked as skipped.

This support for skipping extends to any plugins that may generate
additional results for each executed test.

Signed-off-by: Lucas Bates 
Signed-off-by: David S. Miller

tc-testing: gitignore, ignore local tdc config file

2019-02-26T17:20:42+00:00

Comment in tdc_config.py recommends putting customizations in
tdc_config_local.py file that wasn't included in gitignore. Add the local
config file to gitignore.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller

selftests: concurrency: add test to verify parallel replace/delete

2019-02-24T20:49:59+00:00

Implement test that runs 5 instances of tc replace filter in parallel with
5 instances of tc del filter from same tp instance. Each instance uses its
own filter handle and key range.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller

selftests: concurrency: add test to verify parallel add/delete

2019-02-24T20:49:59+00:00

Implement test that runs 5 instances of tc add filter in parallel with 5
instances of tc del filter from same tp instance. Each instance uses its
own filter handle and key range.

Extend tdc_multibatch.py with additional options required to implement the
test: common prefix for all generated batch files, first value of filter
handle range, MAC address prefix modifier. These are necessary to allow
creating batch files with unique keys and handle ranges with multiple
invocation of tdc_multibatch.py helper script.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller

selftests: concurrency: add test to verify concurrent delete

2019-02-24T20:49:59+00:00

Implement test that verifies concurrent deletion of rules by executing 10
tc instances that delete flower filters in same handle range. In this case
only one tc instance succeeds in deleting a filter with particular handle.
To mitigate expected failures of all other instances, run tc with 'force'
option to continue processing batch file in case of errors and expect xargs
to return code '123' that indicates that invocation of command(s) exited
with error in range 1-125.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller

selftests: concurrency: add test to verify concurrent replace

2019-02-24T20:49:59+00:00

Implement test that verifies concurrent replacement of rules by executing
10 tc instances that replace flower filters in same handle range.

Extend tdc_multibatch.py script with new optional CLI argument that is used
to generate all batch files with same filter handle range.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller

selftests: concurrency: add test to verify parallel rules replace

2019-02-24T20:49:59+00:00

Implement test that verifies parallel rules replacement by adding 1 million
flower filters and then replacing them with 10 concurrent tc instances.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller

selftests: concurrency: add test to verify parallel rules deletion

2019-02-24T20:49:58+00:00

Implement test that verifies parallel rules deletion by adding 1 million
flower filters and then deleting them with 10 concurrent tc instances.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller

selftests: concurrency: add test to verify parallel rules insertion

2019-02-24T20:49:58+00:00

Implement test that verifies parallel rules insertion by adding 1 million
flower filters with 10 concurrent tc instances. Put it to standalone
'concurrency' category.

Implement tdc_multibatch.py helper script that is used to generate multiple
batch files for concurrent tc execution. Extend config with new 'BATCH_DIR'
variable to specify temporary output directory that is used to store batch
files generated by tdc_multibatch.py.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller

selftests: tdc_batch.py: add options needed for concurrency tests

2019-02-24T20:49:58+00:00

Extend tdc_batch.py with several optional CLI arguments that are used for
implementation of concurrency tests in following patches in this set:

- Add optional argument to specify range of filter handles used in batch
  file [fitler_handle, filter_handle+number). This is needed for testing
  filter deletion where it is necessary to know exact handles of configured
  filters.

- Add optional argument to specify filter operation type (possible values
  are ['add', 'del', 'replace']) instead of hardcoded "add" value. This
  allows generation of batches for filter addition, deletion and
  replacement.

- Add optional argument to allow user to change mac address prefix that is
  used for all filters in batch. This is necessary to allow generating
  multiple batches with unique flower classifier keys.

Signed-off-by: Vlad Buslov 
Signed-off-by: David S. Miller