[ThreatMatch] Added Beautifulsoup parsing and cleaned up code

[pietrocapece]

Proposed changes

• Added HTML parsing of the content of alerts with Beautifulsoup
• Removed some legacy code that was commented out

Related issues

• [ThreatMatch] refacto: code improvements #3465

Checklist

• I consider the submitted work as finished
• I tested the code for its functionality using different use cases
• I added/update the relevant documentation (either on github or on notion)
• Where necessary I refactored code to improve the overall quality

Further comments

[flavienSindou]

@pietrocapece Thank you for the feature addition and for cleaning up the code!

I noticed that the requirements file needs to be updated to resolve the merge conflict. Once that's done, I’ll be happy to approve your pull request.

[flavienSindou]

#3047 (comment)

[flavienSindou]

Could you please sign this commit
310cc90
the merge pipeline requests all commits are signed

https://docs.github.com/en/authentication/managing-commit-signature-verification/signing-commits

[flavienSindou]

@pietrocapece

The requirements file needs to be updated to resolve the merge conflict.

Could you please sign this commit
310cc90
the merge pipeline requests all commits are signed

https://docs.github.com/en/authentication/managing-commit-signature-verification/signing-commits

Best regards.

[pietrocapece]

So i keep having to update the requirements because you keep updating the app. Pleawe could you just merge my code so I dont have to keep doing this? I cannot sign the commits unfortunately, I have tried for months but the feature is not working from the linux subsystem I am working from. Happy to find another way to deliver this code foer you to upload but I am unable to sign the commits, and it is impossible to sign them retroactively.

[flavienSindou]

We cannot merge a PR with unsigned commit and cannot make an exception.

Please find below a detailed procedure to sign your commit retroactively.

https://webdevstudios.com/2020/05/26/retroactively-sign-git-commits/

Remove request changes as discussed with Flavien