CleanMX Phishing Parser (new fields and ignore undef values)

[SYNchroACK]

New fields (first and last):

"line","id","first","firsttime","last","lasttime","phishtank","virusname","url","recent","response","ip","review","domain","country","source","email","inetnum","netname","ddescr","ns1","ns2","ns3","ns4","ns5"

"1","11089007","1501073583","2017-07-26 14:53:03","0","1970-01-01 01:00:00", "5118751","Google","http://....com/js/Desk/9f3885a038f82d43730038c8d9043a43/","up","alive","195.191.24.116","195.191.24.116","hydropneuengg[.]com","IT","RIPE","[email protected]","195.191.24.0 - 195.191.25.255","HOSTPRO-NET3","Hostpro Ltd.Hostpro Ltd.","ns2.fastnext.com","ns1.fastnext.com","","",""

Ignore undef values:

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py", line 659, in process
    events = list(filter(bool, value))
  File "/usr/local/lib/python3.5/dist-packages/intelmq/bots/parsers/cleanmx/parser.py", line 123, in parse_line
    event.add(key, value)
  File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/message.py", line 223, in add
    raise exceptions.InvalidValue(key, old_value)
intelmq.lib.exceptions.InvalidValue: invalid value 'undef' (<class 'str'>) for key 'source.ip'

[ghost]

Thanks!