SaveMyCert
Log in
5 of 5 free questions left today·for 30 a day
Security Program Management and Oversight

Security+ SY0-801 Audits, Assessments and Penetration Testing

19 min readSY0-801 · Security Program Management and OversightUpdated

Audit and assessment activities are the ways an organization gathers evidence that its security controls work as claimed, whether that evidence comes from its own staff, an independent auditor, a regulator or a penetration tester. Security+ objective 5.5 covers how evidence is gathered (sampling, questionnaires, interviews and assertions, plus the MITRE ATT&CK, Cyber Kill Chain and Diamond Model reference sources), how audits are scoped (the audit charter and audit frequency), the engagement types (gap analysis, internal and external audits, benchmarking), penetration testing (known, partially known and unknown environments, physical testing, offensive, defensive and integrated approaches, passive and active reconnaissance), the industry, international and regional standards audits measure against, and the difference between functional and behavioral testing.

What you’ll learn
  • Choose sampling, questionnaires or interviews for an audit need, and judge a sample result against a tolerable exception rate
  • Explain an assertion as management's claim that the auditor tests with evidence
  • Distinguish MITRE ATT&CK, the Cyber Kill Chain and the Diamond Model, and name the seven kill chain phases in order
  • Explain the audit charter's role and set audit frequency by risk
  • Tell internal, external, regulatory, gap analysis and benchmarking engagements apart by who performs them and what they compare against
  • Select a known, partially known or unknown environment, physical, offensive, defensive or integrated test, and passive or active reconnaissance from a scenario's goals and constraints
  • Classify standards as industry-based, international or region-specific, and separate functional from behavioral testing

Data gathering: sampling, questionnaires and interviews

Auditors gather evidence in three main ways: sampling tests a subset of records, questionnaires or surveys collect fixed written answers from many people, and interviews collect detailed accounts from a few people with room for follow-up. Each answers a different kind of question, so the choice depends on what the auditor needs to know.

MethodWhat it producesBest whenLimitation
SamplingEvidence from the records themselves (tickets, logs, access reviews), projected to the whole populationThe population is too large to test every item, such as thousands of change tickets or user accountsShows what happened, not why; a badly chosen sample can mislead
Questionnaires/surveysSelf-reported answers in a fixed formatYou need breadth: many teams, sites or vendors answering the same questions cheaplyNo follow-up; answers describe what people say they do, which may differ from practice
InterviewsFirst-hand explanations from process owners and staffYou need depth: understanding how a process really works, or why practice differs from records or written answersTime-consuming; still testimony that needs corroborating evidence

The methods work together. A survey can reach every department quickly; sampling then checks the records behind the answers; and when the two disagree, an interview lets the auditor probe the discrepancy and ask follow-up questions that a fixed written form cannot. Testimony from surveys and interviews is weaker evidence than records, so auditors corroborate it rather than accept it alone.

How sampling supports a conclusion

In sampling, the auditor selects items (ideally at random, so every item has a chance of selection), tests each one, and counts the exceptions: items where the control did not work, such as a change with no approval. Before testing, the audit plan sets a tolerable exception rate, the highest failure rate the auditor can accept and still conclude the control works.

  • The sample exception rate is exceptions divided by the number of items tested, because those are the only items the auditor has evidence about. For example, 4 exceptions in 80 sampled user access reviews is 5%.
  • Compare that rate with the tolerable rate: at or below it, the evidence supports the control; above it, the evidence does not.
  • A properly selected random sample is the basis for a conclusion about the whole population for the period audited. The conclusion is projected from the sample; it is not a statement about the selected items alone.

Assertions: the claim the auditor tests

An assertion is a claim made by management about its own controls or subject matter, and it is what the auditor gathers evidence to support or refute. Audits do not start from a blank page: management says something is true, and the audit tests whether the evidence backs it up.

The clearest example is a SOC 2 examination. Management provides a written assertion that its system description is accurate and that its controls were suitably designed and implemented (a Type 1 report, as of a date) or also operated effectively over a period (a Type 2 report). The service auditor then tests evidence and gives an opinion on that assertion. Internal audits work the same way on a smaller scale: a team asserting that "every new starter completes security training before receiving system access" is making a testable claim.

  • An assertion is the thing tested, not a way of testing. Sampling, interviews and surveys are the methods used to test it.
  • Evidence decides. Sample exceptions above the tolerable rate mean the evidence does not support the assertion for the population, however confidently management stated it.
  • An assertion is not an audit charter (the audit function's mandate) or a benchmark (an external comparison point).

Signed attestations and acknowledgements as compliance monitoring tools are covered in the Security+ security compliance lesson.

Reference sources: MITRE ATT&CK, Cyber Kill Chain and Diamond Model

Three reference models give assessors a shared language for adversary behavior: MITRE ATT&CK catalogues specific attacker tactics and techniques, the Cyber Kill Chain orders an attack into sequential phases, and the Diamond Model of Intrusion Analysis relates the four core features of an intrusion event. They are used to scope assessments, map findings and plan tests against realistic attacker behavior.

ModelWhat it describesStructureTypical use
MITRE ATT&CKSpecific adversary behaviors, drawn from real-world observationsTactics (the attacker's goal, such as Initial Access or Lateral Movement) containing techniques and sub-techniques (how the goal is achieved, such as phishing or use of remote services)Mapping observed behaviors, measuring detection coverage, choosing techniques to emulate or replay in a test
Cyber Kill ChainThe stages an attack moves throughSeven sequential phases, from reconnaissance to actions on objectivesIdentifying where an attack is and where to break it
Diamond ModelOne intrusion event and the relationships within itFour vertices: adversary, capability, infrastructure, victimDocumenting and pivoting during intrusion analysis (from known infrastructure to related capabilities or victims)

MITRE ATT&CK

ATT&CK is a free, publicly available knowledge base maintained by MITRE. Its matrices (Enterprise, Mobile and ICS) list tactics as columns and the techniques that achieve them beneath. Because it names specific behaviors, it is the model to use when you need to label what an attacker actually did or pick individual techniques to test one at a time. Its role alongside CVE, CVSS and other threat intelligence resources is covered in the Security+ threat intelligence lesson.

Cyber Kill Chain

Developed by Lockheed Martin, the Cyber Kill Chain describes an intrusion as seven phases in order:

  1. Reconnaissance: researching the target (staff, systems, public information).
  2. Weaponization: pairing an exploit with a payload, such as a malicious document. This happens on the attacker's side.
  3. Delivery: sending the weapon to the target, for example by email or a malicious site.
  4. Exploitation: triggering a vulnerability to run the attacker's code.
  5. Installation: placing malware such as a backdoor for persistence.
  6. Command and control (C2): the installed malware opens a channel back to attacker-controlled servers so the attacker can operate it remotely.
  7. Actions on objectives: achieving the goal, such as exfiltrating or encrypting data.

The model's main lesson is that breaking any link stops the attack, and the earlier the break, the less the attacker achieves. Each phase has its own defenses: limiting what staff and systems expose publicly degrades reconnaissance, mail and web filtering disrupt delivery, patching disrupts exploitation, endpoint controls disrupt installation and egress filtering disrupts C2. Weaponization happens entirely on the attacker's side, so defenders cannot act on it directly. Map the attack's current phase first, then look for the defense that acts on that phase or the next one.

Diamond Model of Intrusion Analysis

The Diamond Model describes every intrusion event by four connected features: the adversary (who is responsible), the capability (the tools and malware used), the infrastructure (servers, domains and accounts used to deliver and control the capability) and the victim (the person, department or system targeted). Because the four are linked, knowing one lets the analyst pivot to the others. The Diamond Model does not list techniques and does not order phases; it relates the parts of an event.

Scoping: the audit charter and audit frequency

Scoping decides what an audit function may examine and how often it examines it. The audit charter sets the mandate, and frequency is set by risk.

Audit charter

An audit charter is the formal document, approved by the board or its audit committee, that establishes the internal audit function's purpose, authority, scope and responsibilities. Crucially, it grants auditors the right of access to the records, people and property they need, so the function's authority comes from the board rather than from the goodwill of the departments it reviews.

DocumentLifespanWhat it governs
Audit charterStanding, reviewed periodicallyWhy the audit function exists and what it may do: authority, scope, responsibilities, access
Audit planUsually one yearWhich areas will be audited in the period, chosen by risk, and approved under the charter
Engagement-level documentsOne engagementThe scope, boundaries, deliverables and terms of a single audit or test

Engagement-level documents such as rules of engagement and statements of work are covered in the Security+ third-party risk management lesson.

Audit frequency

Audit frequency should follow risk, not the calendar. A system that holds sensitive data and changes often can drift out of compliance quickly, so it needs assurance more often; a stable, low-impact system with a clean history needs it less often. Regulations and contracts may also set a minimum frequency, such as an annual assessment.

  • Factors that raise frequency: sensitive or regulated data, frequent change, critical business dependence, previous findings.
  • Factors that lower frequency: little change, low impact if the control fails, a record of clean results.
  • Risk-based frequency is a way to allocate a fixed audit effort: more attention where failure is likely and costly, less (but not none) elsewhere, while keeping the assurance's independence where it matters most.

Engagement types: internal, external, gap analysis and benchmarking

Audit and assessment engagements differ in who performs them and what they compare against. Internal engagements are run by the organization's own people; external engagements are run by outside parties; gap analysis compares against a target standard; benchmarking compares against peers.

EngagementPerformed byCompares against / purpose
Gap analysisUsually the organization or a consultant it hiresA target standard or framework's requirements, listing what is missing (for example, before adopting a framework such as the NIST Cybersecurity Framework)
Internal: compliance auditThe organization's internal audit staffInternal policies, laws, regulations and contracts that apply
Internal: audit committeeA board committee of independent directorsOversees internal audit, approves its plan, receives findings directly and oversees the external auditors
Internal: self-assessmentThe teams that own and run the controlsTheir own controls, often by questionnaire; cheap and frequent but the least independent
External: examinationsAn independent external auditorA formal evaluation ending in an opinion, such as a SOC 2 examination of management's assertion
External: assessmentsOutside assessors or consultantsAn evaluation of controls or risk against criteria, such as a PCI DSS assessment by a qualified assessor
External: regulatoryA regulator or supervisor with legal authorityThe regulator's own rules; findings can lead to fines, restrictions or loss of license
External: independent third-party auditAn independent firm the organization commissionsAn objective opinion for customers, partners or certification bodies
BenchmarkingThe organization, often using industry dataPerformance or practice of peers and industry norms, such as incident detection times or phishing click rates in a sector survey

Independence decides internal vs external

The deciding difference between internal and external engagements is independence. Internal auditors can be thorough and objective, and reporting lines can improve that objectivity, but they are part of the organization they review. When a stakeholder requires an opinion from a party with no stake in the results, the assurance has to come from outside the organization. Independence runs along a scale: control owners assessing themselves, then internal audit, then independent external parties.

Audit committee vs other board bodies

The audit committee exists so that internal audit reports to independent directors, keeping findings from being filtered by the executives whose areas are audited. Its members are directors who do not run the business, which is what makes the reporting line meaningful. Setting risk appetite and managing risk are covered in the Security+ risk management lesson.

Regulatory examinations vs third-party audits

Ask who initiated the review and on what authority. A body with legal authority reviewing an organization against rules it has issued, with enforcement powers behind the findings, is conducting a regulatory examination; a health regulator inspecting a hospital's handling of patient records is one example. An independent firm the organization commissions to give an opinion is an independent third-party audit. Voluntary standards and frameworks carry no legal authority, so reviews against them are not regulatory examinations.

Gap analysis vs benchmarking

Both compare the organization with something else, so check what the comparison point is. A gap analysis compares current controls with a standard or target state and lists what is missing. Benchmarking compares performance or practice with peers and industry norms, for example whether the time the security team takes to detect and contain incidents is typical for organizations in the same sector.

Penetration testing environments and physical testing

Penetration tests are classified by how much the testers know before they start: a known environment test gives them full details, a partially known environment test gives them some, and an unknown environment test gives them none. A physical penetration test targets buildings and people rather than networks.

TypeOlder nameWhat testers receiveStrengths and trade-offs
Known environmentWhite boxFull information: network diagrams, credentials, configurations, often source codeMost thorough coverage in the least time; does not show what an outsider could discover
Partially known environmentGray boxSome information, such as user accounts or limited documentationSimulates an insider or a logged-in user; balances realism with time spent on discovery
Unknown environmentBlack boxNothing beyond the target's name or scopeMost realistic view of an outside attacker; much of the time goes on discovery, so coverage per day is lower

Choose the environment from the goals and constraints together: which perspective the test must reproduce (an outsider, an employee, an authenticated user of an application), how much of the engagement time can be spent on discovery, and what information the organization is willing or permitted to share. Any information given to testers moves the test away from an unknown environment; withholding sensitive material such as source code keeps it short of a fully known one.

Physical penetration testing

A physical penetration test tries to defeat facility and procedural controls in person: for example cloning or borrowing badges, checking whether reception verifies visitors, testing whether doors and cabinets are actually locked, or plugging into unattended network ports in shared areas. Its evidence is a real attempt against the real site, which is what distinguishes it from technical tests of systems and from reviews of documented controls.

Every penetration test runs under written authorization and agreed rules of engagement (scope, timing, permitted techniques), covered in the Security+ third-party risk management lesson. Automated vulnerability scanning, which finds weaknesses without exploiting them, belongs to the Security+ vulnerability management lesson.

Offensive, defensive and integrated testing

Offensive testing (the red team) emulates real attackers and tries to breach defenses; defensive testing (the blue team) detects and responds to that activity; integrated testing (the purple team) has both sides work together to improve detection. A white team often referees exercises and sets their rules.

ApproachTeamRoleBest for
OffensiveRedUses real attacker techniques to breach the target, usually without the defenders' knowledge of timingTesting whether defenses and response hold up against a realistic attack
DefensiveBlueMonitors, detects, contains and responds, typically the security operations centerMeasuring and improving detection and response
IntegratedPurpleAttackers and defenders work side by side: a technique is run, defenders check whether they saw it, alerts are tuned, the technique is re-runFast, measurable improvement of detections

Separate red and blue exercises realistically test the organization, but findings often travel as reports weeks later, and detection improves slowly. Integrated testing fixes that by closing the loop in real time. It pairs naturally with MITRE ATT&CK: the team picks techniques from the catalogue, runs them and records which ones defenders detect, giving a measurable coverage map.

Passive and active reconnaissance

Passive reconnaissance gathers information about a target without sending anything to the target's systems; active reconnaissance interacts with those systems directly. The test is simple: does any packet reach the target?

Passive reconnaissanceActive reconnaissance
Interaction with target systemsNoneDirect
ExamplesOSINT from public websites and social media, published documents and their metadata, WHOIS and public DNS records, certificate transparency logs (public records of issued TLS certificates and the hostnames on them), search engines, internet-wide scan databasesPing sweeps, port scans (such as TCP SYN scans), banner grabbing, service enumeration, vulnerability scans
DetectabilityVery hard for the target to detectCan be logged and detected by the target
Detail and accuracyLimited to what is public, may be out of dateCurrent, specific information about live systems

Passive does not mean vague. Some public datasets are built from scanning that third parties have already done, so they can describe exposed hosts and services in detail while the tester still sends nothing to the target. Each passive source answers a particular kind of question (ownership, hostnames, people, exposed services), so the skill is matching the source to the information needed within what the rules of engagement allow.

Frameworks and standards: industry, international and regional

Audits and assessments measure against a framework or standard, and Security+ groups them by reach: industry-based standards apply to one sector or activity, international standards apply across countries, and region-specific standards apply in one country or region.

CategoryExampleWhat it is
Industry-basedPCI DSSThe Payment Card Industry Data Security Standard for organizations that store, process or transmit payment card data; assessed by qualified assessors or by self-assessment questionnaire depending on volume
InternationalISO/IEC 27001The international standard for an information security management system (ISMS); organizations can be certified against it by accredited certification bodies worldwide
InternationalISO/IEC 27002A code of practice giving guidance on information security controls; it supports 27001 but organizations are not certified against it
Region-specificUK Cyber EssentialsA UK government-backed scheme certifying basic technical controls; required for many UK central government contracts but not a worldwide benchmark

Two near-twins matter most. ISO/IEC 27001 vs 27002: 27001 contains the certifiable requirements for running an ISMS, while 27002 is guidance on implementing controls, so certification is always to 27001. Reach: an industry standard applies to its sector or activity wherever it happens, a regional scheme carries weight mainly within its own jurisdiction, and an international standard is recognized across borders. Writing the organization's own policies and standards is covered in the Security+ governance lesson.

Functional testing vs behavioral testing

Functional testing checks that a control does what its specification says: given defined inputs, it produces the expected result. Behavioral testing examines how people and systems actually behave in real operation, which can differ from what the specification assumed.

Functional testingBehavioral testing
Question answeredDoes the control work as designed?How do people and systems really act around it in daily use?
MethodRun defined test cases and compare results with documented requirementsObserve real work, review activity over time, look for workarounds and unexpected behavior
ExampleLeaving a session idle and confirming it times out after the documented periodReviewing whether staff share accounts or prop open secure doors to avoid a slow badge process

A control can pass every functional test and still fail in practice because people route around it. The two are classified by their evidence: comparing results with a specification is functional, examining what happens in real use is behavioral. Phishing simulations and other awareness exercises are covered in the Security+ security awareness lesson.

Tip. Objective 5.5 is tested mainly with short scenarios that describe an audit or assessment activity through an observable detail, such as what testers were given, whether traffic reached the target, who performed a review and on whose authority, or what a comparison was made against, and then ask which activity or model it is. Options are usually siblings from the same 5.5 list: the data gathering methods, the reference models, the engagement types, the test environments, or the red, blue and purple approaches. Harder items combine two facts or add a constraint, such as interpreting an audit result, choosing an approach that satisfies several stated limits at once, or pairing an activity with the model or method that fits it.

Key takeaways
  • Sampling tests a subset of records and projects the result; surveys give breadth; interviews give depth and allow follow-up questions.
  • A sample exception rate is exceptions divided by items tested, compared with the tolerable rate set before testing, and the conclusion is projected to the whole population.
  • An assertion is management's claim about its controls; audit evidence supports or refutes it.
  • MITRE ATT&CK catalogues specific techniques, the Cyber Kill Chain orders seven phases (reconnaissance, weaponization, delivery, exploitation, installation, C2, actions on objectives), and the Diamond Model links adversary, capability, infrastructure and victim.
  • The audit charter, approved by the board or audit committee, grants the audit function its authority, scope and access; audit frequency should follow risk.
  • Independence separates internal from external engagements: only an outside party with no stake gives an independent opinion, and self-assessments are the least independent.
  • Gap analysis compares against a standard's requirements; benchmarking compares against peers and industry norms.
  • Known, partially known and unknown environment tests differ in how much testers are told; physical tests target buildings and people.
  • Red attacks, blue defends, purple integrates the two in real time; passive reconnaissance never touches the target's systems, active reconnaissance does.
  • PCI DSS is industry-based, ISO/IEC 27001 is the certifiable international ISMS standard (27002 is guidance), UK Cyber Essentials is region-specific; functional testing checks the specification, behavioral testing checks real behavior.

Frequently asked questions

What is the difference between a gap analysis and benchmarking in Security+?

A gap analysis compares an organization's current controls with a target standard or framework and lists the requirements it does not yet meet. Benchmarking compares the organization's performance or practices with peers and industry norms, such as how quickly similar organizations detect incidents. The difference is the comparison point: a standard's requirements for a gap analysis, other organizations for benchmarking.

What are the seven phases of the Cyber Kill Chain?

The Lockheed Martin Cyber Kill Chain has seven phases in order: reconnaissance, weaponization, delivery, exploitation, installation, command and control (C2), and actions on objectives. Breaking any phase stops the attack, and breaking an earlier phase limits what the attacker achieves. Weaponization happens on the attacker's side, so defenders act on reconnaissance, delivery and the later phases.

How do MITRE ATT&CK, the Cyber Kill Chain and the Diamond Model differ?

MITRE ATT&CK is a public knowledge base of specific adversary tactics and techniques, such as phishing under Initial Access. The Cyber Kill Chain orders an attack into seven sequential phases. The Diamond Model of Intrusion Analysis describes one intrusion event through four linked features: adversary, capability, infrastructure and victim. Use ATT&CK to name or replay behaviors, the Kill Chain to locate and break an attack's progress, and the Diamond Model to relate the parts of an event.

What is the difference between known, partially known and unknown environment penetration tests?

They differ in how much information testers receive before starting. A known environment (white box) test provides full details such as diagrams, credentials and source code. A partially known environment (gray box) test provides some, such as user accounts. An unknown environment (black box) test provides nothing beyond the target, so testers work like an outside attacker and spend more time on discovery.

What is the difference between passive and active reconnaissance?

Passive reconnaissance gathers information without sending any traffic to the target's systems, using sources such as public websites, WHOIS and DNS records, certificate transparency logs and internet-wide scan databases. Active reconnaissance interacts with the target directly, for example through port scans, ping sweeps and banner grabbing. Active techniques give current, specific detail but can be detected and must be permitted by the rules of engagement.

What is an audit charter?

An audit charter is a formal document, approved by the board or its audit committee, that establishes an internal audit function's purpose, authority, scope and responsibilities, including its right of access to records, people and property. It is the audit function's standing mandate, unlike rules of engagement or a statement of work, which govern a single engagement.

Why is an internal audit not an independent audit?

Internal auditors are part of the organization they review, so even a thorough internal audit with good reporting lines does not come from a party with no stake in the outcome. When a stakeholder requires an independent opinion, it has to come from an external, independent auditor. Self-assessments, performed by the teams that run the controls, are the least independent of all.

What is the difference between functional and behavioral testing?

Functional testing checks that a control performs as specified by running defined inputs and comparing the result with the documented requirement, such as confirming an idle session times out after the set period. Behavioral testing examines how people and systems actually act in real operation, such as reviewing whether staff share accounts to avoid a control. A control can pass functional tests and still fail behaviorally.

Source

This lesson covers the "Security Program Management and Oversight" domain of the official SY0-801 exam guide. Vendors revise their guides — check the source for the current version.

Sign up free to mark lessons complete, bookmark topics and track your exam readiness.

Spotted a mistake in this lesson?