117 Commits

Author SHA1 Message Date
pyth0n1c ef9b64c968 Updated detection-testing.yml
to the same as the version in 
develop so that testing can 
proceed.  Since there is a PR
open, why didn't this auto
update?
2022-04-08 06:34:56 -07:00
pyth0n1c 93176ca83b Updated S3 upload code to proper bucket path 2022-04-04 15:52:49 -07:00
pyth0n1c 0209621f81 Code to generate and upload
pass rate badge after completion
of a scheduled run.  Also uploads
the summary_test_results.json file
for use on research.splunk.com
2022-04-04 15:29:28 -07:00
pyth0n1c defa3d0f73 Path was wrong for SummaryTestResults.
This error was introduced when the YML
was updated during the detection testing
code cleanup.  This resulted in the entire 
folder being uploaded instead of a single 
json file.
2022-03-23 11:29:34 -07:00
pyth0n1c 9ba8cba89c Changed paths in detection-testing.yml
to reflect new paths after update of bin
folder to remove deprecated testing code.
2022-03-22 13:16:20 -07:00
Jose Enrique Hernandez d78bb53baa Revert "Refactored security content" 2022-03-04 15:13:04 -05:00
P4T12ICK 68543a8dc1 merged with develop 2022-03-03 13:11:56 +01:00
pyth0n1c 10ed443903 Ensuring that testing code from develop
branch is always used for CI/CD.  This is
done by explicitly checking out the develop
branch to get the testing code.  We make
this change to avoid doing CI/CD tests 
using out-of-data Splunkbase Apps.
For one-off testing, a develop can
always modify this workflow file to 
NOT check out the develop branch
and include a custom test JSON.
2022-03-01 09:41:19 -08:00
pyth0n1c 140f481ae9 with: should not be indented 2022-02-28 11:58:03 -08:00
pyth0n1c 74ab5a77bd ref: needs to be nested under with: 2022-02-28 11:56:17 -08:00
pyth0n1c 56aaca04b5 Put ref in the wrong place for checkout.
Fixed - it goes under uses:
2022-02-28 11:54:38 -08:00
pyth0n1c 222ee749fd Updated to always use test code
from the develop branch, meaning
that the test code will always be 
up to date.
2022-02-28 11:43:04 -08:00
pyth0n1c 0654f3dcb5 Print out the docker logs when
a container fails to start unexpectedly
2022-02-28 10:56:09 -08:00
pyth0n1c 05898d1c72 Updated the test config used for github actions and the workflow to remove the use of the splunkbase username and password secrets. After this is merged, we can remove them from the repository. We will simply use the versions that we update in S3. 2022-02-15 15:43:36 -08:00
pyth0n1c 5ecb9f5fbd Tests were failing on GH Actions that should not have been failing. This is likely due to not enough time waiting for indexing to fail. Doubled the time we wait between indexing complete check. Also moved from hourly tests of all detections to daily. 2022-01-13 15:50:07 -08:00
pyth0n1c cc90aca4b9 Fixed spacing in printouts for
detection-testing.yml
2022-01-13 10:35:23 -08:00
pyth0n1c 928797252d Changed from
github.event.action to
github.event_name
2022-01-13 10:32:49 -08:00
pyth0n1c da5e00e580 Added spaces to fix format of
github.event.action
2022-01-13 10:25:07 -08:00
pyth0n1c 77b5fde422 Fixed scheduled action for nightly test.
Now, it will hopefully only run the test of
the entire repo on the SCHEDULED
github.event.action, not on scheduled
event of any commit to the develop branch.
We have changed the schedule interval to
hourly for testing purposes today and will
change it back to nightly after today's testing.
2022-01-13 10:22:25 -08:00
pyth0n1c 8d669b66f8 Removing previous file that was added accidentally in last commit. Updating the detection-testing.yml file to remove ls of non-existant directory as intended 2022-01-12 16:17:38 -08:00
pyth0n1c 2cb3390164 Migrated the docker detection testing from
build-and-validate.yml into detection-testing.yml
workflow.  Removed the unused AWS batch
testing workflow.  This makes much more sense
2022-01-12 16:05:22 -08:00
d1vious 4bbe1891c3 moving under bin 2021-11-03 21:43:47 -04:00
pyth0n1c fd2b5f1a88 Made an extra job that will not run
for dependabot
2021-09-08 12:55:34 -07:00
pyth0n1c 0d180eb74a Don't run detection testing if the actor
is dependabot
2021-09-08 11:44:23 -07:00
pyth0n1c 2a33d7377f Updated boto3 version in requirements.txt.
Removed extra python requirements
installation in detection-testing.
2021-09-02 16:10:16 -07:00
pyth0n1c edff0a09f0 Updated requirements for the build-and-validate
workflow and the wheel install and pip upgrade
everywhere else.  Going to run detection testing
on this and see if it's good.
2021-09-02 15:51:24 -07:00
pyth0n1c 756cb6e1d7 Using pip freeze to get all the new requirements 2021-09-02 15:30:24 -07:00
pyth0n1c 3b08a85330 Fixed testing so that it only runs on Push and Create/Reopen PR. 2021-08-31 11:56:18 -07:00
pyth0n1c bddb7a7835 Fixed correct branch and PR number for both pushes and PRs for detection testing. 2021-08-30 14:41:20 -07:00
pyth0n1c 289360bc8d Print out more env variables associated with pull request. 2021-08-30 14:35:20 -07:00
pyth0n1c 9ad3e184e2 Priting out pr number and ohter variables 2021-08-30 14:24:51 -07:00
pyth0n1c 8429e51863 Testing what is being passed to detectrion testing. 2021-08-30 14:18:46 -07:00
pyth0n1c 5bb24d5fc9 Fixed variable name for pull request number. 2021-08-30 13:22:47 -07:00
pyth0n1c 851e0bd536 Removed duplicate id from detection-testing.yml 2021-08-30 13:15:28 -07:00
pyth0n1c c76f9c7c61 Fixed github actions testing behavior for Push vs PR for detection testing. Now checking out of proper source branch and running main.py on the proper source brach and PR number. 2021-08-30 13:14:15 -07:00
pyth0n1c 3d6b2e074d Fixed detection testing to run on PR and push instead of just push. We were bailing on PR 2021-08-30 12:08:51 -07:00
pyth0n1c 7500d66b32 Fixing bad github_ref substitution due to spacing. 2021-08-30 12:03:47 -07:00
pyth0n1c 196a7a07f9 Wrong escape sequence for GITHUB_REF 2021-08-30 12:00:05 -07:00
pyth0n1c 621ecc8ab2 Testing the syntax for the source branch for a pull request. 2021-08-30 11:57:40 -07:00
pyth0n1c a4b14ffc14 Reworking test flows after fixing 'waiting on result' issue. Rework detect6ion testing so that it runs on prs and pushes with approval and never runs on tags. 2021-08-27 10:44:10 -07:00
pyth0n1c 000e3ff036 Split validate-and-build into two separate files. Changed detection-testing to run on each commit instead of only tag. Detection testing also runs on current branch, not just develop. 2021-08-26 11:14:39 -07:00
pyth0n1c 0dd4c8ef65 Put requirement on tag validation for detection-testing. 2021-08-17 10:36:08 -07:00
pyth0n1c 87e1ef6dca Changed all of the python versions from 3.9.5 to 3.9. We want the latest patch. If we just include the MAJOR.MINOR, the latest patch will always be used. 2021-08-16 13:06:13 -07:00
pyth0n1c f2fa2bf079 Apparently, unless specified otherwise, exit returns most recent return code. Explicitly have it return 0 on success. 2021-08-10 11:56:02 -07:00
pyth0n1c 67c4c1fdb2 More verbose tag checking. 2021-08-10 11:51:30 -07:00
pyth0n1c 9c22253318 Adding the tag check to the semgrep.yml. Printing our the GITHUB_REF before checking it, because we seem to be failing for some reason on regular pushes. 2021-08-10 11:45:57 -07:00
pyth0n1c ed50f77308 Changing the way that we validate the tag name for a tagged release. 2021-08-09 17:22:45 -07:00
pyth0n1c 274c1dd9a9 Just added a check for tag validation and put it at the beginning of all the workflows. 2021-08-09 16:33:10 -07:00
pyth0n1c 2ca826e4d9 Uncommented all the tests from before that were commented... making sure that the file lints and runs correctly before merging it into the develop branch. 2021-08-09 15:30:11 -07:00
pyth0n1c 981a894c34 Wrong argument to checkout - ref not branch 2021-08-09 13:53:09 -07:00