Topic 1.5 · Unit 1: Introduction to Security · 10 minute session

1.5 Leveraging AI in Cyber Defense

Cyber defenders use artificial intelligence (AI) tools to review security configurations, analyze code for vulnerabilities and suggest detection rules, always with a knowledgeable human checking before anything is applied. Because networks produce millions of events a day, AI tools sort likely malicious events from harmless ones, alert people or take corrective action, so teams can respond faster.

Big idea AI gives defenders scale and speed. Its recommendations are reviewed by a knowledgeable human before they are put in place.

Course and exam description (CED) codes covered: 1.5.A.11.5.A.21.5.A.31.5.B.11.5.B.21.5.B.31.5.B.4

Last reviewed against the CED:

By the end of this session you can

  • 1.5.A Explain how cyber defenders can leverage AI-powered tools to protect networks, applications, and data.
  • 1.5.B Explain how AI-powered tools are enabling faster and more accurate threat detection and response.

Already know this? Jump to the checkpoint.

1. AI as the defender’s assistant (1.5.A)

AI tool reviews It recommends A human checks first
Security configurations, such as firewall rules and access controls 1.5.A.1 More secure settings A knowledgeable security technician
Application code 1.5.A.2 Fixes for the vulnerabilities it finds A knowledgeable programmer
Automated detection systems 1.5.A.3 New rules for automated detection systems A knowledgeable detection engineer

The pattern is the same every time: AI suggests, a person who understands the system approves.

AI configuration review (suggestion only)
# current rule
allow  any  ->  server:22   # remote login open to the whole internet
# suggested rule
allow  10.0.5.0/24  ->  server:22   # only the admin network
Status: waiting for technician approval
Three rows: security configurations reviewed first by a security technician, application code by a programmer, detection rules by a detection engineer, each implemented only after review. Below: millions of events, too many for humans, are sorted by AI into likely malicious and harmless, then AI alerts security staff or takes a corrective action.
AI suggests, a knowledgeable human decides.

2. Faster, more accurate detection (1.5.B)

  • Networks produce millions of digital events every day. A few are probably an adversary at work, and humans cannot inspect them all 1.5.B.1.
  • AI tools can be trained to sort events quickly into likely malicious and harmless 1.5.B.2.
  • They can be programmed to alert human staff or to take specific corrective actions depending on the type of activity 1.5.B.3.
  • The result: teams catch malicious activity and step in quickly, preventing loss, harm, damage and destruction to infrastructure and data 1.5.B.4.

Detect: AI does not replace the logs you will read in Units 3 to 5. It decides which ones a person reads first.

Lock it in: memory hooks

One picture per idea. If you remember the hook, you can rebuild the details.

  • Human reviewAI suggests, a human approves: technician for configs, programmer for code, detection engineer for rules.
  • Why AI for detectionMillions of events, a handful of attacks: AI finds the needles so humans can pull them out.

Common misconceptions

  • "If the AI recommends a firewall rule, apply it straight away."

    Not quite. Every AI recommendation, for configurations, code fixes or detection rules, should be reviewed by a knowledgeable person before it is implemented.

  • "AI replaces the security team."

    Not quite. AI handles the volume humans cannot. It alerts people or takes set actions, so the team can intervene faster.

Exam traps

  • An answer saying AI recommendations (configurations, code fixes, detection rules) are put in place with no human review is almost always wrong.
  • Raising alerts or taking a set corrective action automatically is a normal use of AI [1.5.B].
  • Topic 1.4 is AI used by adversaries; topic 1.5 is AI used by defenders.

By the numbers

Say each list out loud, then tap to check.

3 AI defenses, 3 reviewers Say them, then tap
  • security technician
  • programmer
  • detection engineer

In 30 seconds

  1. AI tools can review configurations such as firewall rules and access controls, analyze application code for vulnerabilities, and suggest detection rules.
  2. Each recommendation is checked by a knowledgeable human: a security technician, a programmer or a detection engineer.
  3. Networks produce millions of events daily, too many for humans to examine.
  4. Trained AI tools sort likely malicious events from harmless ones, alert staff or take corrective action, so teams stop loss and damage sooner.

Cover this list, say the points out loud, then take the checkpoint without scrolling back up.

Checkpoint · 6 questions

Checkpoint: Leveraging AI in Cyber Defense

Pick an answer to mark it. Every answer is explained, and you can try any question again. Your saved score counts first tries only, and stays in this browser.

  1. 1 An AI tool recommends tightening a firewall rule. What should happen before it is applied? 1.5.A.1
    Show answer

    Answer: B. AI recommendations for security configurations should always be checked by a knowledgeable security technician before implementation.

  2. 2 Who should review an AI tool's suggested fix for a vulnerability in application code? 1.5.A.2
    Show answer

    Answer: D. Code recommendations from AI tools should always be reviewed by a knowledgeable programmer before being implemented.

  3. 3 AI suggests a new rule for an automated detection system. Who should review it? 1.5.A.3
    Show answer

    Answer: B. Detection rules suggested by AI should be reviewed by a knowledgeable detection engineer before being added.

  4. 4 Why do security teams need AI to help with detection? 1.5.B.1
    Show answer

    Answer: D. Of the millions of daily events, a few likely represent malicious activity, and humans cannot carefully examine them all.

  5. 5 An AI tool flags unusual activity on a server. Which response is consistent with how AI-powered detection tools can be programmed? 1.5.B.2, 1.5.B.3
    Show answer

    Answer: C. AI tools can be programmed to alert human personnel or take specific corrective actions based on the type of malicious activity.

  6. 6 What is the main benefit of AI-powered detection and response? 1.5.B.4
    Show answer

    Answer: A. AI-powered tools help teams catch malicious activity and intervene quickly, preventing loss, harm, damage and destruction.

Key terms: flip the cards

Read the term, say the definition out loud, then flip to check. Struggling a little to remember is what makes it stick.

  • Artificial intelligence (AI)tap to flip

    Computer systems that perform tasks such as generating text, recognizing patterns or sorting events, used by both adversaries and defenders.

    Example and CED codes
  • Firewalltap to flip

    Software that allows or denies network traffic in or out of a network using a set of rules called an access control list (ACL); it runs on its own device or inside another one, such as a router.

    Example and CED codes
  • Detection ruletap to flip

    A rule an automated detection system uses to flag likely malicious activity, which AI can suggest and a detection engineer should review.

    Example and CED codes
  • Malwaretap to flip

    Software designed to harm a device or its user, such as by stealing data, spying or giving an adversary control.

    Example and CED codes

Questions students ask

How do cyber defenders use AI?

To review security configurations and recommend safer settings, to scan application code for vulnerabilities and suggest fixes, to suggest detection rules, and to sort huge numbers of events so likely attacks are flagged quickly.

Why should a human review AI security recommendations?

AI tools can be wrong. A knowledgeable technician, programmer or detection engineer checks each recommendation before it changes a real system.

↑ Top

Enlarged view of the selected figure