Data Engineering for Cybersecurity
AdvancedDetectionToolingThreat Intelligence

Data Engineering for Cybersecurity

Build Secure Data Pipelines with Free and Open-Source Tools

4 / 5

A decade-plus threat analyst teaches how to collect, normalize, enrich, and secure the telemetry (logs, events, metrics) that security teams depend on, using open-source tools like Filebeat, Logstash, Redis, Kafka, and Elasticsearch.

Buy on Amazon

As an Amazon Associate we earn from qualifying purchases. The link above is sponsored.

Published
2025
Publisher
No Starch Press
Pages
344
Language
English

Read this if

Detection engineers and SOC analysts who are tired of telemetry that doesn't organize itself and want to build the pipeline rather than just consume whatever the SIEM vendor provides. Covers collecting from Windows (Sysmon, PowerShell events), Linux (files, syslog), and network/security appliances, then transforming, securing, and automating with Ansible.

Skip this if

Readers looking for detection logic or threat hunting technique itself; this is the plumbing underneath those activities; not the analysis built on top of it. Also assumes comfort with Linux systems administration and basic scripting.

Key takeaways

  • Treats telemetry as an engineering problem with its own lifecycle (collect, normalize, enrich, secure) rather than something a SIEM magically handles.
  • Built entirely on free, open-source tooling (Filebeat, Logstash, Redis, Kafka, Elasticsearch), so the pipeline design is reproducible without a vendor contract.
  • Automating deployment with Ansible is treated as part of the job, not an afterthought — the pipeline has to be maintainable, not just functional once.

Notes

The infrastructure layer underneath this catalog's detection and threat-intelligence titles (Intelligence-Driven Incident Response, Applied Network Security Monitoring, Network Security Through Data Analysis) — none of those books teach you to build the pipeline that feeds them, which is exactly this book's job. Pairs well with Malware Data Science for teams thinking about the full telemetry-to-detection-model pipeline.