236f0ce71f
Branch was auto-updated.
2022-07-19 12:36:12 -07:00
1cdfb1916f
Fixed paths in content generation to use the input path instead of hardcoded relative paths.
2022-07-15 08:02:17 -07:00
0c41f0a2f8
Branch was auto-updated.
2022-07-07 17:08:03 -07:00
8ed9372401
On CVESearch API failure, added a
...
brief sleep to allow the API to
begin working again before trying
to resolve it again.
2022-07-07 14:40:39 -07:00
80af56d397
Fixing the rare case where enrichment fails
...
due to CVESearch API failure, causing the
entire workflow to fail. Now, we will retry
enrichment up to a total of 3 times. This should
virtually eliminate all CVE Enrichment failures.
If they do still occur, we will receive a
descriptive message indicating why there was
a failure instead of the cryptic message
that we were getting before.
2022-07-07 14:33:57 -07:00
52abbc9408
Changing enrichment failures from
...
error prints to error prints AND
failures.
2022-06-30 15:47:29 -07:00
45736b5ed7
Updated CI/CD Workflow and
...
python code in contentctl so that
progress update are not output
when running in CICD environment.
Outputting all of this data
causes thousands of lines of output
logs to be generated in CICD.
This info is only relevant when
running locally in a tty.
2022-06-30 10:52:00 -07:00
8b7f7d20eb
in-memory optimization for fetching CVE enrichment and app enrichment, even if skip_enrichment or cached_and_offline are disabled.
2022-06-29 16:53:17 -07:00
5eda0215e4
Branch was auto-updated.
2022-06-29 12:59:29 -07:00
bb3a73b0dd
array
2022-06-27 15:26:45 -07:00
5c1e44eb32
adding more technologieas
2022-06-27 13:49:44 -07:00
d5ab2bd9c8
CI
2022-06-24 14:42:57 -07:00
690021590a
add MS windows
2022-06-24 14:30:58 -07:00
e92699f315
st
2022-06-24 14:27:27 -07:00
d40ca09d61
Merged develop into content_changer_improvements to resolve merge conflict. this was making it impossible to merge the PR in the GitHub Interface.
2022-06-23 14:19:17 -07:00
a74ebee88f
Added the --skip_enrichment option to the
...
contentctl tool. This can save a huge amount
of time when generating an app. Also
added a progress meter when the documentation
is being generated. Finally, correctly initialized
the default values of some class member fields
in order to get all the contentctl steps working.
2022-06-22 13:44:17 -07:00
84420a1912
PEX-76: fix the detections obj to include the J2 docs fields
2022-06-06 15:01:26 -07:00
518251e8c8
PEX-76: add back the detection_names obj
2022-06-06 09:51:16 -07:00
c247d2cdd4
PEX-76: remove detection_names; modify detections to only contain name attribute
2022-06-02 21:03:36 -07:00
926317f5c4
Updated status print information around the
...
creation of App Enrichment, CVE, and
link validator caches. Made sure to close
CVE and App Enrichment caches after
they are opened and accessed instead of
relying on Python to close them for us
when their reference count is zero.
Also tested to ensure that if a previous
validate and generate succeeded, it
can be run again with no internet access!
This is perfect not just for performance
reasons, but offline/disconnected
environments.
2022-05-13 07:51:31 -04:00
fa9179fd9a
Added the shelve/shelf functionality to the CVE Enrichment Cache as well. This also replaced plain dict functionality and simplified the code.
2022-05-11 13:51:00 -07:00
bf27f47d1f
Moved from using a pickled dictionary, loaded and written manually, to shelve.Shelf for Reference cache. The interface is nearly identical, but it results in much cleaner code. We will likely do the same in the next commit for CVE cache.
2022-05-11 12:00:47 -07:00
cdb66ae143
More optimizations in content_ctl. No longer generate ba_factory or factory if they are not needed - only generate the one or ones that are required. Also, provide status printouts for the AttackEnrichment so that the user can monitor progress and be sure something is happening.
2022-05-10 15:49:45 -07:00
d814d4d74a
Added link validation to playbooks and
...
performed successful tests against
all Stories, Playbooks, Baselines,
Detections, and Investigations.
Also tested when the check_references
or --no-check_references flags are passed
successfully!
2022-05-04 17:08:41 -07:00
b60db04b71
Added link validator code to baselines, detections,
...
investigations, and stories. Still some testing to
be done.
2022-05-04 16:50:18 -07:00
03035d1c78
Enhancement to use threaded detection construction, which really speeds up verification of URLS. Also, got the cache working and the force cache argument passed all the way through to the detection builder. Please note that this will take much longer to run the first time, because the cache has not been populated. Subsequent runs will be slower. If data exists in this cache, it is NOT updated and will become stale if the web resource is updated. This is only suitable for development purposes and offline environments.
2022-05-02 12:59:28 -07:00
31149c3e61
More changes to defaults and argument parsing to support offline and cached mode.
2022-04-29 17:04:57 -07:00
f81a103b01
Added the majority of support for offline and cached mode for contentctl. This means that developers can much more rapidly test new builds without waiting on slow API end points \(taking build and validate job from upwards of 10 minutes to a few seconds\). It also means that the tool can be used in completely offline, secure environments that do not mirror the required HTTP endpoints.
2022-04-29 16:53:20 -07:00
8d8998d243
adding nes to detection object
2022-04-12 11:03:52 -07:00
cc29450acb
return value
2022-04-11 09:29:43 -07:00
ac3bed4a4b
str for nes fields
2022-04-05 13:32:31 -07:00
afc1860132
Add Mitre Attack Csv generation
2022-03-29 12:14:20 +02:00
952e07a05c
added try catch handler for cirl cve enrichment
2022-03-28 18:49:50 -04:00
0fe8a854ec
fixed api and mitre attack enrichment
2022-03-28 14:03:10 +02:00
f5b2db0ebf
fixing a url error
2022-03-23 21:15:52 -04:00
d91040b6c8
working enrichment
2022-03-23 20:34:39 -04:00
d4a20db47b
adding more pieces
2022-03-22 22:12:09 -04:00
e740e4e5e1
adding datasources to docgen
2022-03-22 21:43:34 -04:00
510a196a0d
Improve validation
2022-03-21 09:27:53 +01:00
9a348b9130
Improve validation
2022-03-18 12:49:20 +01:00
3a0a6cf4fa
fixed a small bug in detection builder
2022-03-15 11:19:35 +01:00
6f0ee68913
Refactored security content
2022-03-09 14:43:09 +01:00
d78bb53baa
Revert "Refactored security content"
2022-03-04 15:13:04 -05:00
2cda47990b
doc_gen ready
2022-02-22 18:40:36 +01:00
1ffb4bbc0a
wip doc_gen
2022-02-17 15:20:25 +01:00
14464f17a4
wip doc_gen
2022-02-16 17:01:48 +01:00
0c89faadd7
Merge branch 'refactored_security_content' of github.com:splunk/security_content into refactored_security_content
2022-02-16 16:08:16 +01:00
60ae79dde6
wip doc_gen
2022-02-16 15:34:59 +01:00
1c5961c4c5
condition for tactic and jinja field for risk
2022-02-15 13:45:08 -08:00
0b5b4e2388
generate API package working
2022-02-14 16:45:27 +01:00
pyth0n1c