34ae999e98
new tranforms test file
2022-05-16 15:17:12 -07:00
9de437237f
adding collections to transforms
2022-05-16 13:36:07 -07:00
93590d76f5
adding hyperlink to detection page
2022-05-16 12:41:48 -07:00
938dd6824b
Branch was auto-updated.
2022-05-16 15:09:39 -04:00
0591cf421e
Branch was auto-updated.
2022-05-16 15:09:33 -04:00
2f27d80a13
Branch was auto-updated.
2022-05-16 15:08:44 -04:00
61df5c96ef
Delete cobalt_strike_named_pipes.yml
2022-05-16 13:04:05 -06:00
86391a5843
HaagCat
2022-05-16 12:59:46 -06:00
38d32c3341
Branch was auto-updated.
2022-05-16 13:06:58 -04:00
751736f5e3
Better error handling for inspect
2022-05-13 13:53:49 -04:00
3ef1542000
Added another folder to clean.
...
Updated command line arguments
for build. Improved implmentation of
inspect.
2022-05-13 12:58:53 -04:00
83c6448e6f
Fixing some paths and command line arguments for the contentctl build option.
2022-05-13 11:42:01 -04:00
29894c6d3e
Fixed broken 'clean' paths for multiple content folders.
2022-05-13 09:31:54 -04:00
926317f5c4
Updated status print information around the
...
creation of App Enrichment, CVE, and
link validator caches. Made sure to close
CVE and App Enrichment caches after
they are opened and accessed instead of
relying on Python to close them for us
when their reference count is zero.
Also tested to ensure that if a previous
validate and generate succeeded, it
can be run again with no internet access!
This is perfect not just for performance
reasons, but offline/disconnected
environments.
2022-05-13 07:51:31 -04:00
fa9179fd9a
Added the shelve/shelf functionality to the CVE Enrichment Cache as well. This also replaced plain dict functionality and simplified the code.
2022-05-11 13:51:00 -07:00
bf27f47d1f
Moved from using a pickled dictionary, loaded and written manually, to shelve.Shelf for Reference cache. The interface is nearly identical, but it results in much cleaner code. We will likely do the same in the next commit for CVE cache.
2022-05-11 12:00:47 -07:00
e7580faf5f
Added caching of the results of link-verification to the --cached_and_offline argument. This means that if a link returns successfully and you run the tool again, the link won't be checked again. However, this means that if that cache sticks around for a long time, the link may actually stop returning but we won't continue checking it. Still, this makes it significantly easier to quickly find broken links, fix the broken links, and then run the tool again in a short period of time, only re-checking the broken links that have been fixed. This makes repairing and checking broken links a must faster workflow.
2022-05-10 17:08:24 -07:00
cdb66ae143
More optimizations in content_ctl. No longer generate ba_factory or factory if they are not needed - only generate the one or ones that are required. Also, provide status printouts for the AttackEnrichment so that the user can monitor progress and be sure something is happening.
2022-05-10 15:49:45 -07:00
b7ea8fc27d
kvstore bugs
2022-05-10 13:42:19 -07:00
6e6c7f5f4a
More finishing touches on link validation. Now, failures are printed out at the end after all links have been checked instead of when the tool is running, making it easier to read. Files that referernce the link are also included.
2022-05-10 13:15:52 -07:00
67a0ed2821
Removed some un needed prints from Link Validator. Added progress indicators to the steps of the factory so that users have feedback on what is going on when contentctl is running. This is helpful since it can run for an extended period of time, especially on a slower or high latency connection, when links are being validated, or when caching is not enabled.
2022-05-10 12:00:31 -07:00
a5f9241650
Added Palo Alto TA in support of CRITICAL CVE 2022-1388 Detection.
2022-05-10 10:31:16 -07:00
d814d4d74a
Added link validation to playbooks and
...
performed successful tests against
all Stories, Playbooks, Baselines,
Detections, and Investigations.
Also tested when the check_references
or --no-check_references flags are passed
successfully!
2022-05-04 17:08:41 -07:00
b60db04b71
Added link validator code to baselines, detections,
...
investigations, and stories. Still some testing to
be done.
2022-05-04 16:50:18 -07:00
54798186a9
Saving changes made to support URL verification which is working - but we have now broken these out into a more robust class link_validator.py
2022-05-04 16:24:02 -07:00
c0dc8541b4
Added a class for validating links. This class performs its own type of caching, similar to functools caching, but keeps additional metrics suitable for dumping when all validation has completed.
2022-05-04 16:22:40 -07:00
0957d0de03
Updates to the detection ref validator. Still needs a few tweaks.
2022-05-03 16:24:29 -07:00
900bd9e7e2
Updated a large number of the links in other detections. Also, adjusted the number of threads that run and tweaked the timeout time.
2022-05-03 10:34:10 -07:00
646afbf214
A number of small updates to support resolving and verifying all of the reference URLs in detections at scale. Also, fixed a few more HTTP Status Code 301 references in the tests folder.
2022-05-02 17:15:09 -07:00
03035d1c78
Enhancement to use threaded detection construction, which really speeds up verification of URLS. Also, got the cache working and the force cache argument passed all the way through to the detection builder. Please note that this will take much longer to run the first time, because the cache has not been populated. Subsequent runs will be slower. If data exists in this cache, it is NOT updated and will become stale if the web resource is updated. This is only suitable for development purposes and offline environments.
2022-05-02 12:59:28 -07:00
31149c3e61
More changes to defaults and argument parsing to support offline and cached mode.
2022-04-29 17:04:57 -07:00
f81a103b01
Added the majority of support for offline and cached mode for contentctl. This means that developers can much more rapidly test new builds without waiting on slow API end points \(taking build and validate job from upwards of 10 minutes to a few seconds\). It also means that the tool can be used in completely offline, secure environments that do not mirror the required HTTP endpoints.
2022-04-29 16:53:20 -07:00
710b582b15
Added an option for all, meaning that all of the transforms \(besides the transform on test files\) will be run.
2022-04-29 15:58:03 -07:00
3c5a342479
Better support in contentctl and content_changer for updating yml files. The help statement for content_changer in content_ctl now dynamically lists the transforms that can be performed on detections. In addition, a redundant transfrom was removed.
2022-04-29 15:43:01 -07:00
52c8023678
Added support for enumerating all of the different actions
...
that content_changer can make. This list of actions
will be dynamically updated base on the names of
the functions added in content_changer.py!
2022-04-29 13:31:56 -07:00
f93e34f9d5
adding it by default
2022-04-29 11:17:53 -04:00
4aeb43540a
Non working... yet... deploy function.
2022-04-25 16:30:21 -07:00
6694a5f659
building and appinspecting of the package are now working. removed an errorneous comma from lookups/attack_tools.csv that caused errors during appinspect and resulted in a badly cormatted csv.
2022-04-23 10:22:56 -07:00
0db105e00c
More progress toward build and inspect of the app.
2022-04-23 09:27:41 -07:00
aecd70e74d
Now support building the app. Added requirements to support CLI-based appinspect.
2022-04-23 07:39:31 -07:00
814a13c522
Stubs for building an application with slim and inspecting with command line version of appinspect.
2022-04-23 06:44:18 -07:00
d6e09d3c1b
Actually calling clean now instead of just passing over it.
2022-04-22 13:39:09 -07:00
760242e45b
Included basic implementation of clean, which is yet to be tested.
2022-04-22 13:25:53 -07:00
876071e45d
fixed some small issues
2022-04-14 12:24:13 +02:00
5b01b8510b
Merge branch 'TR-1735' of github.com:splunk/security_content into TR-1735
2022-04-12 17:40:23 -07:00
e171e3c6ea
test updates
2022-04-12 17:40:11 -07:00
e6ec07a3ef
Branch was auto-updated.
2022-04-12 15:44:06 -07:00
242449d59d
Merge branch 'develop' into bug_with_borked_links
2022-04-12 18:43:20 -04:00
90ca4186ed
fixing minor linking bug
2022-04-12 17:12:25 -04:00
8d8998d243
adding nes to detection object
2022-04-12 11:03:52 -07:00
patel-bhavin