About methodNetwork intrusion · CIC-IDS2017
The evaluation split decides the headline
0.997 → 0.453
- random split (how most papers test)
- 0.997
- attack families never seen in training
- 0.453
The same model, the same flows. Tested the usual way it looks nearly perfect; tested on attacks from days it never trained on, F1 falls by more than half. Results reported on random splits measure recognition, not detection.
See the evidence