Lee Chagolla-Christensen 562a4e71ca Optimize observability stack and workflow throughput
Performance and configuration improvements:
- Tune OpenTelemetry Collector with batching, queuing, and memory limits
- Optimize Jaeger for write-heavy workloads with consistency disabled
- Add Prometheus scraping for OTel Collector internal metrics
- Increase document conversion prefetch count from 1 to 5
- Add CPU limit (2 cores) for document-conversion service
- Disable Tesseract OCR in default Tika config for faster processing

Workflow tracking enhancements:
- Add WorkflowTrackingService for centralized workflow state management
- Implement finalize_workflow activities for both services
- Track enrichment success/failure per workflow instance
- Support updating workflow status by object_id for subscriptions

Code improvements:
- Refactor PDF analyzer with modular extraction functions
- Add Unicode surrogate sanitization to prevent JSONB errors
- Update PII analyzer with improved error handling
- Add documentation links to Tika and Tesseract configuration

Frontend:
- Update StatsOverview component for workflow metrics display
2025-11-07 00:58:58 -08:00
2025-08-29 15:24:32 -07:00
2025-08-29 15:24:32 -07:00
2025-10-22 12:48:39 -07:00
2025-06-13 11:33:07 +02:00
2025-10-30 09:50:59 -07:00
2025-10-27 16:58:26 -07:00

Nemesis


version 2.0.0 Slack @tifkin_ on Twitter @harmj0y on Twitter @0xdab0 on Twitter Sponsored by SpecterOps


Overview

Nemesis is an offensive file enrichment pipeline.

Nemesis 2.0 is built on Docker with heavy Dapr integration, our goal with Nemesis was to create a centralized file processing platform that functions as an "offensive VirusTotal".

Note: the previous Nemesis 1.0.1 code base has been preserved as a branch

Setup / Installation

Follow the quickstart guide.

Usage

See the Nemesis Usage Guide.

Additional Information

Blog Posts:

Title Nemesis Version Date
Nemesis 2.0 v2.0 Aug 5, 2025
Nemesis 1.0.0 v1.0 Apr 25, 2024
Summoning RAGnarok With Your Nemesis v1.0 Mar 13, 2024
Shadow Wizard Registry Gang: Structured Registry Querying v1.0 Sep 5, 2023
Hacking With Your Nemesis v1.0 Aug 9, 2023
Challenges In Post-Exploitation Workflows v1.0 Aug 2, 2023
On (Structured) Data v1.0 Jul 26, 2023

Presentations:

Title Date
OffensiveX 2025 Jun 19, 2025
x33fcon 2025 Jun 13, 2025
SAINTCON 2023 Oct 24, 2023
BSidesAugusta 2023 Oct 7, 2023
44CON 2023 Sep 15, 2023
BlackHat Arsenal USA 2023 Sep 15, 2023

Acknowledgments

Nemesis is built on large chunk of other people's work. Throughout the codebase we've provided citations, references, and applicable licenses for anything used or adapted from public sources. If we're forgotten proper credit anywhere, please let us know or submit a pull request!

We also want to acknowledge Evan McBroom, Hope Walker, and Carlo Alcantara from SpecterOps for their help with the initial Nemesis concept and amazing feedback throughout the development process. Also thanks to Matt Ehrnschwender for tons of k3s and GitHub workflow help in Nemesis 1.0!

And finally, shout out to OpenAI and Claude for helping with this rewrite.

S
Description
Automated archival mirror of github.com/SpecterOps/Nemesis
Readme BSD-3-Clause 61 MiB
Languages
Python 65.4%
JavaScript 23.1%
Shell 2.7%
Go 2.1%
PLpgSQL 1.8%
Other 4.9%