Commit Graph

928 Commits

Author SHA1 Message Date
pyth0n1c f906d579d9 Branch was auto-updated. 2022-02-18 14:38:58 -08:00
pyth0n1c 46e0bb0a01 Added a timeout to the CVESSEARCH_API enrichment in doc_gen. Sometimes, this was causing doc_gen to freeze. Now, when the API is not working or is extremely slow and a request takes longer than 10 seconds, a descriptive error will be thrown and the process will exit with 1 2022-02-18 14:19:57 -08:00
pyth0n1c 09c54931af Memoizing/caching a call to CVESSEARCH_API_URL. Gives a SIGNIFICANT speedup in docgen. 2022-02-18 13:36:09 -08:00
pyth0n1c 9fc009a44d Removed:
SPLUNK_SECURITY_ESSENTIALS
SPLUNK_APP_FOR_AWS
from default app baseline.
They are not required
for testing as they just
provide some dashboards.
2022-02-18 11:17:21 -08:00
pyth0n1c ba05264c80 Branch was auto-updated. 2022-02-17 11:42:02 -08:00
pyth0n1c 622b5af48b Branch was auto-updated. 2022-02-17 11:00:56 -08:00
pyth0n1c b36fbaea7b Branch was auto-updated. 2022-02-17 11:00:54 -08:00
pyth0n1c 05898d1c72 Updated the test config used for github actions and the workflow to remove the use of the splunkbase username and password secrets. After this is merged, we can remove them from the repository. We will simply use the versions that we update in S3. 2022-02-15 15:43:36 -08:00
pyth0n1c 580dba242f Added ability to Ctrl-C/SIGINT the testing process and have it gracefully finish. This stops the containers and writes out partial progress to the output file. 2022-02-15 15:37:17 -08:00
Lou Stella 95d060e135 Character sets are difficult 2022-02-15 13:52:01 -06:00
d1vious 73ba128590 fixing duplicate lookups bug 2022-02-11 12:11:10 -05:00
pyth0n1c 4f0622a5aa Update to latest Splunkbase Windows Sysmon 2022-02-10 16:24:17 -08:00
pyth0n1c 889f27064c Downloaded apps are now cached by default. This can save a huge amount of time on startup, especially for a large number of containers or for slower connections. Otherwise, each container that is set up needs over 600MB of throughput. 2022-02-10 15:50:25 -08:00
pyth0n1c ec90ee19d5 Now, when one or more detection tests fail in the CI/CD,
it will cause the workflow to fail. In turn, this would
prevent a PR from being merged. However, this
lets a developer know more easily (without needing
to dive into the GitHub Actions logs) whether or
not their detections passed successfully.  It also
upload an extra file called DetectionFailureManifest
which is a test file for ONLY the failed tests.
You can run this locally on your machine to 
quickly, interactively debug the failures only.
2022-02-10 09:17:23 -08:00
pyth0n1c 428785a15f Revert "Now, failing one or more CI/CD Tests causes"
This reverts commit 55e94c3eab.
2022-02-10 09:07:02 -08:00
pyth0n1c 55e94c3eab Now, failing one or more CI/CD Tests causes
the workflow to fail. An additional file is 
also uploaded called "replicate_failures"
which allows the user to easily retest
just the failed tests locally.
2022-02-10 09:04:04 -08:00
pyth0n1c d0afcb458d Check to ensure that Splunkbase username and password are passed in the config or command line when one or more apps is lacking http_path or local_path. Before, this would be caught later on and not in the beginning. Also, the previous commit added new http_paths for all of the default apps. 2022-02-09 15:37:34 -08:00
pyth0n1c c45c1335ae Two changes. First, removed the separate splunkbase_apps and local_apps sections of the config file. They are now unified under a single section called apps. If you don't provide a splunkbase username and password, it will simply use the HTTP target/local_paths. If you do provide those, then it will donwload from splunkbase. However, local_path will override both of these. 2022-02-09 15:23:04 -08:00
d1vious 0b609161f9 fixing bug introduced in the macro/lookups addition 2022-02-07 15:28:12 -05:00
Lou Stella 725156ebd8 Merge pull request #1978 from splunk/playbook_updates
Additional Playbook Migrations
2022-02-04 12:35:24 -06:00
Lou Stella 6f9afa43d9 emojis on the index 2022-02-04 11:41:05 -06:00
Lou Stella 98b2e1055e Sorting conflicts 2022-02-04 11:34:04 -06:00
Lou Stella 4b75b34615 Merge pull request #1995 from splunk/SavingPrivateLookupMacros
adding macro and lookup sorting
2022-02-04 11:25:40 -06:00
d1vious 483ba8698e adding macro and lookup sorting 2022-02-04 11:45:10 -05:00
Lou Stella de92a3c7aa Additional doc_gen run 2022-02-04 09:31:08 -06:00
pyth0n1c 6c9c758792 Branch was auto-updated. 2022-02-04 07:14:56 -08:00
Jose Enrique Hernandez 53714cac0b Merge pull request #1994 from splunk/SavingPrivateLookupMacros
Saving Private LookupMacros
2022-02-04 10:14:22 -05:00
d1vious b33bccfe11 adding macros and lookups to pages 2022-02-03 19:53:59 -05:00
Lou Stella 2657b68a23 Updated ymls & j2 templates for changes 2022-02-03 11:09:14 -06:00
patel-bhavin 23fef2c5fc jinja change 2022-02-02 12:17:46 -08:00
d1vious 0a310edb66 updating docs 2022-02-01 16:44:20 -05:00
d1vious 3029c91915 fixes TR-1309 2022-02-01 14:02:30 -05:00
d1vious e866b111e5 updating detection template to include lookups and macros 2022-02-01 12:21:23 -05:00
Michael Hart 39d7121dcd Updating mlmodel to 5.3.x specification as well as the test apparatus 2022-01-25 21:42:16 -05:00
patel-bhavin f45d2067da fix for test key in yml 2022-01-14 14:11:23 -08:00
pyth0n1c b928268e90 Merge pull request #1937 from splunk/DockerDetectionUpdatesAndFixes
Docker detection updates and fixes
2022-01-14 08:55:34 -08:00
pyth0n1c 5ecb9f5fbd Tests were failing on GH Actions that should not have been failing. This is likely due to not enough time waiting for indexing to fail. Doubled the time we wait between indexing complete check. Also moved from hourly tests of all detections to daily. 2022-01-13 15:50:07 -08:00
pyth0n1c 67ef36117b Fixed bad printout to console where, if a test failed but --interactive mode was declared, the test would print out as having succeeded. Improved error handling if there is an issue where an uploaded data file generates and exception. 2022-01-13 12:03:49 -08:00
pyth0n1c 82a85b1305 Branch was auto-updated. 2022-01-13 09:33:10 -08:00
pyth0n1c 359c3159d0 Branch was auto-updated. 2022-01-13 09:20:09 -08:00
patel-bhavin 0a7b4d27de minor fix 2022-01-13 09:17:03 -08:00
pyth0n1c 860320c367 Branch was auto-updated. 2022-01-12 16:50:15 -08:00
Bhavin Patel 20df3795b3 Merge pull request #1933 from splunk/DockerDetectionUpdatesAndFixes
Move Detection Testing job to detection-testing
2022-01-12 16:49:51 -08:00
pyth0n1c 6a7f917707 Fix to requirements to include psutil. Removed import of deleted modules/aws_service.py 2022-01-12 16:40:56 -08:00
pyth0n1c cdc902e052 Removed ansible from requirements and boto3 from requirements. Neither are used anymore 2022-01-12 16:35:11 -08:00
pyth0n1c 8d669b66f8 Removing previous file that was added accidentally in last commit. Updating the detection-testing.yml file to remove ls of non-existant directory as intended 2022-01-12 16:17:38 -08:00
pyth0n1c fc189e92ee Removed ls or directory that didn't exist anymore
in detection-testing.yml
2022-01-12 16:10:21 -08:00
pyth0n1c 85ac64bb8f Branch was auto-updated. 2022-01-12 15:19:35 -08:00
Bhavin Patel dee77e7957 Merge pull request #1932 from splunk/DockerDetectionUpdatesAndFixes
Changed summarize_json.py to return success
2022-01-12 15:19:13 -08:00
pyth0n1c 73998ca5c1 Changed summarize_json.py to return success
(0) code even if there are failures or errors found
during testing during the initial testing of CI/CD.
This is because we don't want these to hold up
the build process. Eventually we will report actual
success/failure of all tests after we have the
opportunity to validate the new testing pipeline and
make updates to failing searches.
2022-01-12 14:57:17 -08:00