73d1771205
Restricted two input queues to 1 doc at a time
...
-Restricted input queue for NLP container to 1 doc at a time
-Restricted input queue for file ingest in enrichment to 1 doc at a time
2024-02-01 14:07:47 -08:00
3f81957c33
Added document average embedding vector indexing
...
-Added document average embedding vector indexing
2024-02-01 14:06:16 -08:00
dabbe94b8b
Merge pull request #39 from SpecterOps/tensorflow-removal
...
Removed tensorflow-serving password model
2024-02-01 12:11:34 -08:00
416f7642ed
Removed tensorflow-serving password model
...
-Removed tensorflow-serving password model as it proved not effective in production.
-Remove classic NLP summarization as it wasn't useful in production
2024-02-01 12:11:12 -08:00
17970d4b5a
unbundle from extension-cli ( #38 )
2024-02-01 12:52:14 -05:00
25743a5ae5
Batching for text vectorization in nlp container
...
-Batching for text vectorization in `nlp` container
2024-01-31 22:32:40 -08:00
ecc6ab8287
Bump for urllib3 for dashboard
...
-Bump for urllib3 for dashboard
2024-01-31 11:28:50 -08:00
b2c0d61a29
Bump for requests in stage1 connector
...
-Bump for requests in stage1 connector
2024-01-31 11:27:28 -08:00
d2f007ac1f
Bump requests library for mythic connector
...
Bump requests library for mythic connector
2024-01-31 11:24:04 -08:00
6a3d8faa9b
Bump aiohttp for mythic and sliver connectors
...
-Bump aiohttp for mythic and sliver connectors
2024-01-31 11:22:47 -08:00
955d7935b0
fastapi/aiohttp bump and remove dependency for fastapi-class for enrichment
...
-fastapi/aiohttp bump and remove dependency for fastapi-class for `enrichment`
2024-01-31 11:11:48 -08:00
cd7655e1db
Bump fastapi and aiohttp for passwordcracker
...
-Bump fastapi and aiohttp for `passwordcracker`
2024-01-30 18:02:07 -08:00
419a4ca6f7
fastapi bump and remove dependency for fastapi-class for nlp
...
-fastapi bump and remove dependency for fastapi-class for `nlp`
-bump aiohttp
2024-01-30 18:01:45 -08:00
78a1554632
fastapi bump and remove dependency for fastapi-class
...
-fastapi bump and remove dependency for fastapi-class
2024-01-30 16:47:09 -08:00
186b494e55
Bump aiohttp package in dotnet container
...
-Bump aiohttp package in `dotnet` container
2024-01-30 15:29:45 -08:00
154a21f437
Handle parsing of additional ls format in stage1 connector
...
-Handle parsing of additional ls format in stage1 connector
2024-01-29 16:06:59 -08:00
9ce864de00
Add support for Merlin's ls tasks in mythic-connector
...
-Add support for Merlin's ls tasks in `mythic-connector`
2024-01-29 14:58:58 -08:00
01bc999b60
Handle cwd response for stage1 connector
...
-Handle cwd response for stage1 connector
-Sleep on startup so other services can start
2024-01-26 13:03:42 -08:00
d8b1dd5af3
for stage1 connector, auto task pwd if one doesn't exist
...
-for stage1 connector, auto task pwd if one doesn't exist
2024-01-25 16:01:59 -08:00
718bae8b8b
Stage1 connector work
...
-Implemented syncing of file listings
-Implemented reprocessing of downloads and file listings
2024-01-25 15:48:43 -08:00
a19b915d8f
Small dashboard fixes
...
-Fix for when to display File Canaries tab
-Fix for Dashboard streamlit app for file monitoring ("inotify instance limit reached" error)
2024-01-24 13:48:51 -08:00
ce27603cbb
Added Hasura with schema initialization
...
-Added Hasura with schema initialization
2024-01-22 15:54:26 -08:00
c0fc6b85b4
Crack-List mods
...
-Added page on the Dashboard to download custom cracklist
-Minor cleanup of cracklist code
-Added persistent storage for cracklists for non-dev
2024-01-22 12:53:29 -08:00
7aeeb692aa
Don't try to re-crack hashes that didn't crack previously
...
-Don't try to re-crack hashes that didn't crack previously
2024-01-22 10:46:38 -08:00
31a400c93a
Merge branch 'main' of github.com:SpecterOps/Nemesis
2024-01-22 10:24:43 -08:00
2dad913590
Updated langchain to use langchain-community for HuggingFaceEmbeddings
...
-Updated langchain to use langchain-community for HuggingFaceEmbeddings
2024-01-22 10:16:29 -08:00
8fd06aa7ca
Don't re-crack already cracked hashes
...
-Check if a hash is already present and cracked in the database and use the cracked value instead of re-cracking the hash
2024-01-22 10:14:00 -08:00
605d1ff9ce
Ingest extracted hash into database immediately
...
-Ingest extracted hash into database immediately before cracking attempted
-Roll back JTR image to previous format due to speed issues
2024-01-19 15:26:15 -08:00
c60d094843
-Updated dotnet Poetry package dependencies with poetry lock
...
-Updated `dotnet` Poetry package dependencies with `poetry lock`
2024-01-19 13:08:59 -08:00
0faad3a237
Updated passwordcracker Poetry package dependencies
...
-Updated `passwordcracker` Poetry package dependencies with `poetry lock`
2024-01-19 13:04:34 -08:00
8d9fdcfc8c
Changed Semantic Search result display in Dashboard
...
-Changed Semantic Search result display in Dashboard
2024-01-19 12:47:57 -08:00
7f34ffd762
Changed embedding model for NLP container
...
-Changed embedding model for NLP container to one that has a proper context window
-Updated to ElasticsearchStore in NLP app
-No longer collapse all whitespace in indexing
2024-01-19 12:47:34 -08:00
982b86ac79
Bumped versions for dependencies
...
-Bumped versions for langchain, tiktoken, and pytorch
2024-01-19 12:46:05 -08:00
478192a286
Canary display tab in File Viewer
...
-Added a canary display tab in File Viewer
-`file_canary` tag in the file listing is now clickable
2024-01-18 13:47:08 -08:00
16308b6e17
UTF-8/UTF-16 strings handling in Yara Matches
...
-UTF-8/UTF-16 strings handling in Yara Matches
2024-01-18 12:45:42 -08:00
342ca28606
Revamp for Yara match display in File Viewer
...
-Revamp for Yara match display in File Viewer
-Now includes rule definition and string matches w/ offset + length
2024-01-18 00:05:39 -08:00
67fdfc57a2
Expanded Yara rule context
...
-Expanded Yara rule context parsed by the file enrichment service, now includes matching strings as well as the rule definition itself
2024-01-17 23:29:10 -08:00
f8eb2cfecd
Completed Yara Match JSON display tab in FileViewer
...
-Completed Yara Match JSON display tab in FileViewer
-Added link to the viewer in main file listing
2024-01-17 20:02:13 -08:00
f144c30751
Initial mods for more complex Yara rule context
...
-Initial mods for more complex Yara rule context
2024-01-17 19:30:32 -08:00
4c3916d273
Updated tags
...
-Tag now clickable for parsed_credentials w/ object_id link
-Added links to tags in FileViewer
2024-01-17 12:48:26 -08:00
6e1e8769a2
Fix for large files downloaded in Chromium
...
-Large files downloaded in Chromium now handled properly
-Added batching for Chromium downloads
2024-01-16 21:14:14 -08:00
31cb411fa7
Fix for logic bug in processing Chromium history entries
...
-Fix for logic bug in processing Chromium history entries
2024-01-16 16:59:37 -08:00
4d8752307a
Made appropriate tag links clickable in File Viewer
...
- `noseyparker_results` and `parsed_creds` tag links in file viewer now link to the NoseyParker and Credentials pages respectively
- Color is slightly different for clickable links
2024-01-16 10:56:30 -08:00
a4b499fd39
Added "Last" page to paginated sections in Dashboard
...
-Added "Last" page to paginated sections in Dashboard
2024-01-11 18:47:30 -08:00
60009c83d3
Fixes for Document Search page in dashboard
...
-Fixes for Document Search page in dashboard
2024-01-11 18:17:05 -08:00
6127b598a9
Fix up source code and text search display
...
-Fix up source code and text search display
2024-01-11 16:31:10 -08:00
2d42a5438c
Updated query_params usage for Dashboard pages
...
-Updated query_params usage for Dashboard pages
2024-01-11 15:54:31 -08:00
aec54bb88e
Fixed Document Search pagination in the dashboard
...
-Fixed Document Search pagination in the dashboard
2024-01-11 12:49:54 -08:00
570ba0ab79
Modified landing page stat display
...
-Modified landing page stat display to a table instead of metrics
2024-01-11 12:21:05 -08:00
4a7b2bf540
Updated Streamlit to 1.30.0
...
-Updated Streamlit to 1.30.0
2024-01-11 12:20:51 -08:00
Will