|9 min read|Yvann Lièvre

IT Security Audit: From One-Off to Continuous

Pentest, vulnerability scan, organizational audit. Why the annual model is obsolete and how to switch to continuous auditing.

AuditContinu
IT Security Audit: From One-Off to Continuous

The annual security audit is a comfortable fiction. You spend 2 weeks preparing, the provider tests for 5 days, you get an 80-page report, you rush to fix critical findings, and 11 months later you start over. During those 11 months, your infrastructure changed 400 times (deployments, new VMs, config changes, new SaaS tools). The point-in-time audit is a snapshot of a moving train.

The 3 types of security audits

Technical audit

The technical audit evaluates the security of your infrastructure and applications:

  • Vulnerability scanning: automated identification of CVEs on your systems (Nessus, OpenVAS, Qualys). Fast, comprehensive, but no exploitation context.

  • Pentest (penetration test): a human tester simulates a real attack. Creative, contextual, but point-in-time and expensive (EUR 5,000 to 30,000 depending on scope). Pentest vs scan: which to choose?

  • Configuration audit: checking hardening guidelines (CIS Benchmarks, DISA STIG). Often automatable.

  • Code audit: static (SAST) and dynamic (DAST) application review. OWASP ZAP, SonarQube, Semgrep.

Organizational audit

The organizational audit evaluates processes, policies, and governance:

  • Information security policy and its effective implementation

  • Identity and access management (IAM): orphaned accounts, excessive rights, MFA

  • Business continuity plan (BCP/DRP): does it exist? Is it tested?

  • User awareness: simulated phishing campaigns, click rates

  • Vendor and supply chain management

Compliance audit

The compliance audit checks alignment with applicable frameworks:

  • NIS2: the 10 measures of Art.21

  • GDPR: Art.32 (security of processing), Art.33 (notification), Art.35 (DPIA)

  • ISO 27001: 93 controls in Annex A (2022 version)

  • PCI DSS 4.0: for organizations processing card data

  • SOC 2 Type II: for SaaS and service providers

The problem with point-in-time audits

Here's why the annual audit is insufficient:

  • Vulnerability MTTR: median time to remediate a critical vulnerability is 60 days (Mandiant 2024). If your audit is annual, you don't even know a new critical CVE affects your stack for 11 months.

  • Configuration drift: a production config change that breaks a security control is invisible until the next audit.

  • Shadow IT: new SaaS tools, undeclared cloud instances, Docker containers proliferating between audits.

  • Attacker speed: a critical CVE is exploited on average 15 days after publication (Mandiant 2024). Your next audit is in 8 months.

Continuous auditing: the new standard

Continuous auditing doesn't replace point-in-time audits, it fills the 11-month gap. The principle:

  • Vulnerability scanning: daily or weekly, automated, prioritized by EPSS (not just CVSS)

  • Configuration auditing: continuous CIS Benchmark checks, real-time drift alerting

  • Container auditing: Docker image scanning at every build and in runtime (Trivy, Grype)

  • Web auditing: regular DAST scanning of exposed applications (OWASP ZAP, Nuclei)

  • Compliance auditing: continuous mapping of controls against applicable frameworks

ThreatClaw's 57 skills that automate auditing

ThreatClaw integrates 49 specialized skills covering end-to-end continuous auditing:

  • Infrastructure: Lynis (Linux hardening), CIS Benchmarks, SSH audit, file permission audit

  • Vulnerabilities: Nmap (discovery + vuln scripts), EPSS/CVSS scoring, correlation with known exploits

  • Containers: Trivy (images + filesystem), Grype (SCA), Docker Bench for Security, Syft (SBOM)

  • Web: OWASP ZAP (DAST), Nuclei (community templates), security headers, TLS audit

  • Cloud: IAM policy audit, public S3 buckets, permissive security groups

  • Compliance: automatic finding mapping to NIS2, GDPR, ISO 27001

Each skill runs on a configurable schedule (hourly, daily, weekly). Results are correlated, prioritized, and presented in a unified dashboard. The CISO receives a weekly summary report, not 49 separate reports.

Here's the approach I recommend:

  • Continuous: ThreatClaw for vulnerability scanning, configuration auditing, compliance monitoring. This is your daily coverage.

  • Quarterly: results review with the CISO (internal or outsourced), risk analysis update, priority adjustment.

  • Annual: pentest by an external provider to test human creativity and validate defenses. Continuous auditing enriches the pentest scope by identifying high-risk areas.

Where to start

If you've never done an audit, start with the essentials:

  • Week 1: inventory of exposed assets (Nmap), initial vulnerability scan

  • Week 2: configuration audit of critical servers (Lynis/CIS), container audit if applicable (Trivy)

  • Week 3: DAST scan of exposed web applications (OWASP ZAP)

  • Week 4: synthesis, prioritization, remediation plan

ThreatClaw executes these 4 steps automatically upon deployment. The first complete report is available within 48 hours.

FAQ

What's the difference between an audit and a pentest?

An audit evaluates security posture comprehensively (configurations, vulnerabilities, processes, compliance). A pentest simulates a real attack to test defenses under operational conditions. The audit says "here are your weaknesses." The pentest says "here's what an attacker can do with them." Both are complementary.

Does continuous auditing replace the annual audit?

No. Continuous auditing covers automatable aspects (vulnerabilities, configurations, technical compliance). The annual audit brings the human dimension (creative pentest, organizational review, team interviews). Continuous auditing makes the annual audit more effective by eliminating "quick wins" before the auditor arrives.

How much does a continuous auditing program cost?

With open source tools alone (Lynis, Trivy, OWASP ZAP, Nmap), the cost is administration time: 20-40 hours/month for a security engineer. With ThreatClaw, orchestration is automated and time drops to 2-4 hours/month of results review. Check pricing.

My hosting provider is ISO 27001 certified. Do I still need to audit my infrastructure?

Absolutely. The provider's certification covers physical infrastructure and some management aspects. Your responsibility covers everything you deploy on top: OS, applications, configurations, data, access. This is the shared responsibility model. The provider secures the datacenter; you secure what you put in it.

Related articles