Skip to content

Experiment with a fixed threshold#7512

Closed
tiferet wants to merge 4 commits into
mainfrom
tiferet/fixed-threshold
Closed

Experiment with a fixed threshold#7512
tiferet wants to merge 4 commits into
mainfrom
tiferet/fixed-threshold

Conversation

@tiferet
Copy link
Copy Markdown
Contributor

@tiferet tiferet commented Jan 4, 2022

After all the changes made on the modeling side, there is now better separation in scores between TPs and FPs.

This PR experiments with setting a hard-coded score threshold > 0.5 to determine which alerts to surface, rather than always selecting the max-likelihood class, thereby reducing FPs.


Replaced by #7519 because I need to update the worse rather than current libraries.

@tiferet tiferet requested a review from a team as a code owner January 4, 2022 23:54
@tiferet tiferet marked this pull request as draft January 4, 2022 23:55
@github-actions github-actions Bot added the JS label Jan 4, 2022
@tiferet tiferet removed the request for review from a team January 4, 2022 23:55
@tiferet tiferet added the WIP This is a work-in-progress, do not merge yet! label Jan 4, 2022
@tiferet
Copy link
Copy Markdown
Contributor Author

tiferet commented Jan 4, 2022

/evaluate NosqlInjection

@tiferet
Copy link
Copy Markdown
Contributor Author

tiferet commented Jan 4, 2022

/evaluate SqlInjection

@tiferet
Copy link
Copy Markdown
Contributor Author

tiferet commented Jan 4, 2022

/evaluate TaintedPath

@tiferet
Copy link
Copy Markdown
Contributor Author

tiferet commented Jan 4, 2022

/evaluate Xss

@tiferet
Copy link
Copy Markdown
Contributor Author

tiferet commented Jan 4, 2022

The above experiments use a cutoff of 0.65 on the model that's on main ☝️

Make sure we get near-perfect recall (ATM-light) and bad precision.
@tiferet
Copy link
Copy Markdown
Contributor Author

tiferet commented Jan 5, 2022

Replaced by #7519 because I need to update the worse rather than current libraries.

@tiferet tiferet closed this Jan 5, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

JS WIP This is a work-in-progress, do not merge yet!

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant