The overlap between NIST, ISO, CISA and Brazil's federal guidance shows that a CISO cannot manage phishing and hacking with an annual campaign or click rate as the main metric. A defensible program must cover recognition and reporting, practical exercises aligned with current threats, behavior-change measurement, and reinforcement with phishing-resistant MFA, according to NIST SP 800-53, NIST SP 800-172, NIST SP 800-50 Rev. 1, CISA and ISO/IEC 27001:2022 Annex A 6.3.
What changes when frameworks that are usually read separately are compared
Read side by side, the sources do not say the same thing or demand the same level of rigor. The value of the comparison is that ISO calls for awareness and regular updates, NIST adds recognition and reporting for social engineering, CISA adds phishing-resistant MFA, and Brazil's federal guidance pushes organizations to measure reporting rather than stay with annual training alone.
| Standard | What it requires | Frequency | Practical exercises | What to measure | Update | Related technical control | Source |
|---|---|---|---|---|---|---|---|
| NIST SP 800-53 Rev. 5 AT-2 and AT-2(3) | Provide security and privacy literacy training to users, managers, executives and contractors, plus training to recognize and report potential and actual social engineering and social mining | As part of initial training and then at an organization-defined frequency, and also when the system changes or other organization-defined events occur | Includes unannounced practical exercises that simulate social engineering attempts, information gathering, unauthorized access, opening malicious attachments, or activating malicious links through spear phishing | not specified | When the system changes or other organization-defined events occur | not specified | according to NIST SP 800-53 Rev. 5 |
| NIST SP 800-172 requirements 03.02.1e and 03.02.2e | Awareness training focused on recognizing and responding to social engineering threats, APT actors, breaches and suspicious behavior, and practical exercises for organization-defined roles | At an organization-defined frequency, with updates at an organization-defined frequency or when there are significant threat changes | Exercises aligned with current threat scenarios and with feedback to the people involved and their supervisors, including malicious attachment or link simulations through spear phishing | not specified | When there are significant threat changes | not specified | according to NIST SP 800-172 |
| NIST SP 800-50 Rev. 1 | A cybersecurity and privacy learning program aimed at promoting behavior change as part of risk management and the security and privacy culture | not specified | Describes phishing exercises as emails sent to see whether users recognize a phishing attempt, click a malicious site, or open an infected attachment | Percentage of participants who changed their workplace behavior, how many participants received a phishing test email and reported it correctly, the impact of training on recognition and reporting, and common metrics such as click-through and reports | Review and improve learning programs periodically as needs change | not specified | according to NIST SP 800-50 Rev. 1 |
| ISO/IEC 27001:2022 Annex A 6.3 | Personnel and relevant interested parties must receive appropriate information, awareness, education and training in information security, plus regular updates on policies and procedures relevant to their role | Regular updates | Not specified in the control text, though a secondary guide mentions ongoing campaigns such as newsletters or phishing simulations as expected evidence | Not specified, though a secondary guide mentions questionnaire or assessment results as expected evidence | Regular updates to security policy, thematic policies and procedures | not specified | according to ISO/IEC 27001:2022 Annex A 6.3 and the ISO27001.com secondary guide |
| CISA | A comprehensive anti-phishing program that includes employee awareness and training, simulated attacks and analysis of results to modify training and reduce risk, plus emphasis on reporting suspicious emails, links, attachments or lures | not specified | Simulated phishing emails sent to defined groups to assess vulnerability levels | The report can identify how many users opened or clicked the link to estimate potential impact | Modify training based on results analysis | Implement phishing-resistant multifactor authentication as part of Zero Trust, prioritizing FIDO/WebAuthn or PKI | according to CISA |
| Brazilian federal guidance | An effective program goes beyond annual training with videos and phishing tests and includes frequent, updated messages and seasonal campaigns, while CIMBRA-I includes email phishing, other social engineering tactics, event and incident identification, data classification and handling, and mobile device security | Frequent and updated messages, seasonal campaigns, and periodic evaluation according to defined triggers | not specified | Monitor not only the reduction in click rate, but mainly the increase in the reporting rate to IT | Effectiveness is evaluated periodically and according to defined triggers such as system changes and external events | not specified | according to Brazil's Secretariat of Digital Government and CIMBRA-I |
What gets measured wrong when click rate is the only metric?
Sophos reported that 50% of the organizations surveyed tracked phishing email click rate and used that metric to guide awareness programs and adapt content, according to its 2021 report. NIST, by contrast, says programs often use click rate as the only metric, but email difficulty changes how that data should be interpreted, and click rates alone do not provide a full picture of employee behavior, according to its work on the NIST Phish Scale and its technical blog.
Whalemate's view is that click rate is useful, but only as a partial signal. If a program does not include correct reporting, repeat clicking, lure difficulty and behavior change, it ends up producing weak evidence for both risk management and compliance defense.
Why does lure difficulty change the value of the metric?
NIST developed the NIST Phish Scale as a method to measure the human-detection difficulty of a phishing email and to contextualize differences in click rates, according to the publication on phishing user context. NIST also says difficulty context has to be included because the same click rate can mean different things if the lure was crude or if it closely matched a normal work situation.
Whalemate's view is that comparing campaigns without normalizing for difficulty leads to bad decisions. A team with more clicks may be facing more complex scenarios, while another with fewer clicks may be tested with trivial lures.
Is training enough when the problem is credential theft?
Microsoft reported more than 600 million identity attacks per day in Microsoft Entra data, and password-based attacks accounted for more than 99% of identity attacks observed, according to the Microsoft Digital Defense Report 2024. The same report's executive summary added a 146% increase in adversary-in-the-middle phishing attacks and 39,000 incidents detected per day on Microsoft's platforms, according to Microsoft.
CISA responds to that picture by recommending phishing-resistant multifactor authentication as part of Zero Trust and calls it the gold standard for MFA, according to its fact sheet. In its Cybersecurity Performance Goals 2.0, CISA prioritizes mechanisms based on FIDO/WebAuthn or PKI, and leaves SMS or voice only when no other options are available.
Whalemate's view is that if the attacker's goal is to hijack identity and the volume of credential attacks is scaling this way, training alone does not close the gap. The practical decision is to combine human intervention and technical controls, especially where a compromised credential would have high impact.
Does ISO ask less than NIST about phishing?
ISO/IEC 27001:2022 Annex A 6.3 requires awareness, education, training and regular updates relevant to job function, according to the control text. NIST SP 800-53 Rev. 5 AT-2(3), by contrast, specifically requires training to recognize and report potential and actual social engineering and social mining, according to the control sheet published by NIST.
The tension is not a contradiction, but a difference in specificity. Whalemate's view is that an organization that stays with the broader wording of ISO can prove that it provided awareness, but still fall short on concrete evidence of phishing and social engineering recognition and reporting.
What does NIST 800-172 add that is not as strong elsewhere?
NIST SP 800-172, in requirements 03.02.1e and 03.02.2e, requires training focused on recognizing and responding to social engineering threats, APT actors, breaches and suspicious behavior, and practical exercises aligned with current threat scenarios, according to NIST. The implementation guidance adds that those exercises can include unannounced social engineering attempts and simulations of the impact of opening malicious attachments or activating malicious links, and that rapid feedback reinforces the desired behavior.
Whalemate's view is that this creates a more operational standard than generic awareness. Training is not enough. Organizations also have to test with current scenarios and give feedback while the signal is still fresh.
Is recognizing phishing enough without the ability to report it?
NIST SP 800-53 Rev. 5 AT-2(3) requires recognizing and reporting potential and actual social engineering and social mining cases, according to NIST. NIST SP 800-50 Rev. 1 also proposes measuring how many participants received a phishing test email and reported it correctly, and measuring the impact of training on recognition and reporting, according to the same publication.
CISA, for its part, recommends reporting phishing instead of responding to it and extends that guidance to email, SMS, direct messages on social networks or phone calls, according to its public guidance. Brazil's Secretariat of Digital Government recommends monitoring mainly the increase in the rate of reporting to IT, rather than only the reduction in clicks.
Whalemate's view is that reporting is not a soft add-on. It is an operational capability that reduces detection time and enables response before an event escalates.



