Commit Graph

11 Commits

Author SHA1 Message Date
pyth0n1c 94a7845f9c Add experimental support for smoketest.
That means running all detections
without replaying data or checking
correctness.
2023-04-11 12:48:49 -07:00
pyth0n1c fe1dfb0db0 Fixed some prints to make it easier
to understand why certain tests are
being skipped.  This is because they
are deprecated, experimental, or
manual_test
2023-02-03 15:27:11 -08:00
pyth0n1c 5264515a3d Remove filename printouts in factory.
Add reason why file will not be tested in
GitHub service. This could be the wrong type
or the wrong status.
2023-02-03 15:03:57 -08:00
pyth0n1c 13ccdc1e16 Add validators to automatically set the
deprecated and experimental boolean
fields of a detection. Should these fields
still exist given that there is a status
field? Also added enum to help with
validation.
2023-02-03 14:38:19 -08:00
pyth0n1c 561c60df26 Attempt at adding proper experimental and
manual_test parsing support to 
detection_testing.
2023-02-03 11:48:05 -08:00
pyth0n1c f1ca2d34f6 Allow detections without tests. This may be an issue in the conversion. 2023-01-09 14:37:06 -08:00
pyth0n1c 6556205305 initial support for pulling tests
from the detection file instead of
separately. This feature is implemented
as a stopgap as we move to new
tooling.
2023-01-04 11:28:50 -08:00
pyth0n1c 6cfa2014d2 Remove ambiguity from the git checkout
command used by the detection testing code.
2022-06-28 16:46:51 -07:00
pyth0n1c 2d4032e7a5 A number of changes to support
detection of test.yml files that do
not have a detection .yml file.  
The reverse checking was already
in place.  

Removed an outdated
and unused Python file
new_arguments.py.

Removed the unused option
detections_file from the 
test_config.json - because
detections_list exists, this is
no longer required or usable.
2022-03-23 13:26:00 -07:00
d1vious 98ec30b49c Merge branch 'develop' into deprecate_aws_batch_testing 2022-03-22 15:51:32 -04:00
d1vious cff7ba417a cleaning up old CI jobs 2022-03-22 15:37:49 -04:00