e7580faf5f
Added caching of the results of link-verification to the --cached_and_offline argument. This means that if a link returns successfully and you run the tool again, the link won't be checked again. However, this means that if that cache sticks around for a long time, the link may actually stop returning but we won't continue checking it. Still, this makes it significantly easier to quickly find broken links, fix the broken links, and then run the tool again in a short period of time, only re-checking the broken links that have been fixed. This makes repairing and checking broken links a must faster workflow.
2022-05-10 17:08:24 -07:00
cdb66ae143
More optimizations in content_ctl. No longer generate ba_factory or factory if they are not needed - only generate the one or ones that are required. Also, provide status printouts for the AttackEnrichment so that the user can monitor progress and be sure something is happening.
2022-05-10 15:49:45 -07:00
b7ea8fc27d
kvstore bugs
2022-05-10 13:42:19 -07:00
6e6c7f5f4a
More finishing touches on link validation. Now, failures are printed out at the end after all links have been checked instead of when the tool is running, making it easier to read. Files that referernce the link are also included.
2022-05-10 13:15:52 -07:00
67a0ed2821
Removed some un needed prints from Link Validator. Added progress indicators to the steps of the factory so that users have feedback on what is going on when contentctl is running. This is helpful since it can run for an extended period of time, especially on a slower or high latency connection, when links are being validated, or when caching is not enabled.
2022-05-10 12:00:31 -07:00
d814d4d74a
Added link validation to playbooks and
...
performed successful tests against
all Stories, Playbooks, Baselines,
Detections, and Investigations.
Also tested when the check_references
or --no-check_references flags are passed
successfully!
2022-05-04 17:08:41 -07:00
b60db04b71
Added link validator code to baselines, detections,
...
investigations, and stories. Still some testing to
be done.
2022-05-04 16:50:18 -07:00
54798186a9
Saving changes made to support URL verification which is working - but we have now broken these out into a more robust class link_validator.py
2022-05-04 16:24:02 -07:00
c0dc8541b4
Added a class for validating links. This class performs its own type of caching, similar to functools caching, but keeps additional metrics suitable for dumping when all validation has completed.
2022-05-04 16:22:40 -07:00
0957d0de03
Updates to the detection ref validator. Still needs a few tweaks.
2022-05-03 16:24:29 -07:00
900bd9e7e2
Updated a large number of the links in other detections. Also, adjusted the number of threads that run and tweaked the timeout time.
2022-05-03 10:34:10 -07:00
646afbf214
A number of small updates to support resolving and verifying all of the reference URLs in detections at scale. Also, fixed a few more HTTP Status Code 301 references in the tests folder.
2022-05-02 17:15:09 -07:00
03035d1c78
Enhancement to use threaded detection construction, which really speeds up verification of URLS. Also, got the cache working and the force cache argument passed all the way through to the detection builder. Please note that this will take much longer to run the first time, because the cache has not been populated. Subsequent runs will be slower. If data exists in this cache, it is NOT updated and will become stale if the web resource is updated. This is only suitable for development purposes and offline environments.
2022-05-02 12:59:28 -07:00
31149c3e61
More changes to defaults and argument parsing to support offline and cached mode.
2022-04-29 17:04:57 -07:00
f81a103b01
Added the majority of support for offline and cached mode for contentctl. This means that developers can much more rapidly test new builds without waiting on slow API end points \(taking build and validate job from upwards of 10 minutes to a few seconds\). It also means that the tool can be used in completely offline, secure environments that do not mirror the required HTTP endpoints.
2022-04-29 16:53:20 -07:00
710b582b15
Added an option for all, meaning that all of the transforms \(besides the transform on test files\) will be run.
2022-04-29 15:58:03 -07:00
3c5a342479
Better support in contentctl and content_changer for updating yml files. The help statement for content_changer in content_ctl now dynamically lists the transforms that can be performed on detections. In addition, a redundant transfrom was removed.
2022-04-29 15:43:01 -07:00
52c8023678
Added support for enumerating all of the different actions
...
that content_changer can make. This list of actions
will be dynamically updated base on the names of
the functions added in content_changer.py!
2022-04-29 13:31:56 -07:00
f93e34f9d5
adding it by default
2022-04-29 11:17:53 -04:00
4aeb43540a
Non working... yet... deploy function.
2022-04-25 16:30:21 -07:00
6694a5f659
building and appinspecting of the package are now working. removed an errorneous comma from lookups/attack_tools.csv that caused errors during appinspect and resulted in a badly cormatted csv.
2022-04-23 10:22:56 -07:00
0db105e00c
More progress toward build and inspect of the app.
2022-04-23 09:27:41 -07:00
aecd70e74d
Now support building the app. Added requirements to support CLI-based appinspect.
2022-04-23 07:39:31 -07:00
814a13c522
Stubs for building an application with slim and inspecting with command line version of appinspect.
2022-04-23 06:44:18 -07:00
d6e09d3c1b
Actually calling clean now instead of just passing over it.
2022-04-22 13:39:09 -07:00
760242e45b
Included basic implementation of clean, which is yet to be tested.
2022-04-22 13:25:53 -07:00
876071e45d
fixed some small issues
2022-04-14 12:24:13 +02:00
5b01b8510b
Merge branch 'TR-1735' of github.com:splunk/security_content into TR-1735
2022-04-12 17:40:23 -07:00
e171e3c6ea
test updates
2022-04-12 17:40:11 -07:00
e6ec07a3ef
Branch was auto-updated.
2022-04-12 15:44:06 -07:00
90ca4186ed
fixing minor linking bug
2022-04-12 17:12:25 -04:00
8d8998d243
adding nes to detection object
2022-04-12 11:03:52 -07:00
cc29450acb
return value
2022-04-11 09:29:43 -07:00
185ccfd0af
Branch was auto-updated.
2022-04-05 13:56:41 -07:00
ac3bed4a4b
str for nes fields
2022-04-05 13:32:31 -07:00
a2bc62ddc6
Recreated Issue 2019
2022-04-01 15:36:25 +02:00
0424c7a355
minified json api
2022-03-31 10:12:09 +02:00
4868063732
minified json api
2022-03-31 08:51:05 +02:00
403ad09629
disable detection enrichment for stories
2022-03-30 14:29:57 +02:00
4f141450c2
small bug fix conf adapter
2022-03-30 10:28:47 +02:00
d6994e2f3f
xml updadtes
2022-03-29 09:23:08 -07:00
afc1860132
Add Mitre Attack Csv generation
2022-03-29 12:14:20 +02:00
952e07a05c
added try catch handler for cirl cve enrichment
2022-03-28 18:49:50 -04:00
f87c0062c4
Update new_content_factory.py
2022-03-28 09:55:27 -07:00
86343c5697
Branch was auto-updated.
2022-03-28 06:00:01 -07:00
9d7af853cc
fixed api and mitre attack enrichment
2022-03-28 14:37:54 +02:00
0fe8a854ec
fixed api and mitre attack enrichment
2022-03-28 14:03:10 +02:00
8e7aa6651d
fixed generate api
2022-03-28 09:16:22 +02:00
9d3021a5b6
Branch was auto-updated.
2022-03-25 06:41:59 -07:00
ee03e2d063
removing SAAWS and adding new products
2022-03-24 19:12:23 -04:00
pyth0n1c