Wednesday, November 18, 2026

The Comfort of Control: Why Governance Needs Resilience, Not Certainty

Every framework promises that risk can be managed into submission. Reality keeps disagreeing.

On 19 July 2024, a routine content update from a security vendor crashed roughly 8.5 million Windows machines. Airports stalled, hospitals fell back on paper, and banks went quiet. Nobody had attacked anyone. Nobody had broken a rule, at least not in the way compliance teams usually count rule-breaking. Thousands of organizations that held current certifications, passed their audits and filed their risk registers found out in a single morning that their controls had never covered this.

I keep coming back to that day when people ask me whether their governance programme is working. The honest answer is usually uncomfortable. A programme can be thorough, well documented and fully audited, and still leave you exposed. That is not a failure of effort. It is a property of the thing we are trying to do. We write controls to feel in charge of systems that are too large, too fast and too tangled for anyone to be fully in charge of.

The pattern has not gone away. On 12 November 2026, a Microsoft 365 outage knocked out Exchange Online and Outlook, then spread to Teams, SharePoint, Copilot and other services that depend on them, and it ran for roughly a day before Microsoft reported service restored. Microsoft said the trouble began with an earlier network capacity upgrade and that it had found no sign of malicious activity. Again nobody had attacked anyone. Hospital services in the UK, airlines in India, government agencies in Australia and Japan, and even the AI connectors of OpenAI and Anthropic felt it, and at least one listed company delayed its quarterly results because of it. It was a different vendor and a different fault, but the same lesson: one provider's internal change can quietly become everyone else's operational incident.

Control, in other words, is the biggest illusion in governance and compliance. Not because controls are useless (they are not), but because we have started to treat them as proof of safety rather than as one input into a much messier picture. Here is how that illusion forms, where it cracks, and what a more honest approach looks like.
 

1. The Myth of the Perfect Framework

Walk into almost any large organization and you will find a shelf, physical or digital, of frameworks. ISO 27001, NIST, SOC 2, COBIT, PCI DSS, plus whatever the local regulator has added this year. Each one is a serious piece of work, built by smart people who have seen real failures. I have no argument with any of them.

My argument is with the quiet belief that arrives alongside them: that if we implement the framework fully, the risk is handled. A framework is a map drawn from past incidents. It tells you what went wrong for others, in conditions that have already changed. It cannot tell you what is about to go wrong for you, in your particular tangle of systems, vendors and habits.

There is also the matter of scope. Every framework needs boundaries to be auditable, so it draws a line around a system, a process or a business unit and asks whether the controls inside that line are working. Real incidents rarely respect the line. They start in the spreadsheet nobody scoped, the integration somebody added on a Friday, the supplier two steps removed from your contract.

Then there is the old trap that economists call Goodhart's law: when a measure becomes a target, it stops being a good measure. Compliance is full of this. We measure patch rates, training completion, policy acknowledgements, and then teams optimize for the number. A dashboard that is green all year can sit on top of a very fragile reality, and everyone in the room half knows it.

None of this means you should abandon frameworks. It means you should read them the way a sailor reads a chart: as a useful, slightly out-of-date sketch of the coast, to be checked constantly against the water in front of you.
 

2. The Human Variable and the “Tick-Box” Trap

Every control eventually passes through a person. Someone approves the access request, someone reads the alert, someone decides whether the odd email from the finance director deserves a second look. The control is only as good as that moment of attention, and attention is not something you can install.

The numbers keep saying so. Verizon’s 2026 Data Breach Investigations Report, which looked at more than 22,000 confirmed breaches across 145 countries, put the human element in 62% of them. Over the last four editions that figure has hovered between 60% and 74%. We have spent a decade on awareness training and the needle has barely moved. One analysis of the same data points out that the median time from opening a phishing email to typing in credentials can be under a minute. That is not a knowledge problem. People know phishing exists. It is a pace-and-pressure problem, and a slide deck on Tuesday morning does not fix it.

This is where the tick-box trap closes. When compliance is measured by completion, the incentive is to complete. Staff click through the annual module with a second monitor open. Managers sign attestations they have not really read, because the deadline is Friday and the sign-off is a formality. Auditors see evidence, and evidence is what they are paid to find. Everyone behaves rationally, and the organization ends up with a perfect paper trail and a thin real defence.

I have sat in rooms where a control was described as “operating effectively” because the log showed it had run, not because anyone had checked that it caught anything. The tick was real. The protection was not.
 
A control that exists on paper is a claim. A control that has been tested under pressure is evidence.

There is a kinder way to look at this, and I think it is also the more accurate one. People are not the weakest link. They are the only part of the system that can notice something strange, improvise, and say “this feels wrong.” The trick is to design governance that supports that instinct rather than burying it under forms. Make the safe path the easy path. Give people a fast, blame-free way to report mistakes. Measure how quickly problems surface, not how few are admitted to.

Shadow AI is the newest version of the same story. The same Verizon report found that 67% of users who touched AI services on company devices did so through non-corporate accounts, and that regular AI use among employees had jumped from 15% to 45% in a year. Nobody set out to leak source code. They wanted to get a task done faster. A blanket ban that people quietly route around is a control in name only, and it tells leadership nothing about what is really happening.
 

3. The Speed of Change vs. The Speed of Policy

Policies are written slowly, and for good reason. They need drafting, legal review, stakeholder comments, committee approval and a communications plan. Six months is a respectable turnaround. Meanwhile the thing being governed has been through several release cycles, two vendor changes and probably a reorganization.

Attackers are not waiting on committees. The 2026 DBIR found that exploitation of vulnerabilities has overtaken stolen credentials as the most common way in, at 31% of breaches. At the same time, only 26% of known exploited vulnerabilities were fully fixed in 2025, down from 38% the year before, and the median time to remediate stretched from 32 days to 43. The gap between how fast the risk moves and how fast we respond is widening, and a policy that says “critical patches within 30 days” is describing an aspiration, not a fact.

Regulation has the same rhythm problem. Rules arrive years after the technology they address, and by the time they bite, the practice has shifted again. Generative AI is a good example: employees were pasting documents into chatbots long before most organizations had a position on it. The policy, when it arrived, was governing last year.

What helps is treating policy as a living product rather than a monument. Short principles that stay true for years, backed by operating standards that can be updated in weeks. Named owners who review them on a schedule and when something breaks. A habit of asking, after every incident or near miss, “which of our assumptions just turned out to be wrong?” Governance that cannot change its mind quickly is governance that is already out of date.
 

4. The Borderless Ecosystem (Third-Party Risk)

Not long ago, an organization had a perimeter. You could draw it, defend it and audit it. Today your data sits in a cloud provider, your payroll in one SaaS tool, your customer chat in another, your code in a repository maintained partly by strangers. Your risk is the sum of everyone you depend on, and most of them you have never met.

The 2026 DBIR counted a third party in 48% of breaches, a 60% jump on the previous year. The UK’s Financial Conduct Authority said something similar after the CrowdStrike outage: between 2022 and 2023, third-party problems were the leading cause of operational incidents reported to it, and many firms depend on unregulated providers to deliver important services. Some of the firms affected by the outage were themselves suppliers to other regulated firms, which stretched the damage along the chain.

Here is the uncomfortable part. The standard response is the vendor questionnaire, and a questionnaire is a snapshot of what a supplier says about itself on the day it answers. It says little about what the supplier’s own suppliers are doing, and nothing about next month. Data from Tenchi Security in the same DBIR shows how slowly the real work gets done: almost half of third-party cloud authentication and privilege issues were still unresolved after 350 days.

You cannot control a vendor’s engineers, their release process or their sub-contractors. What you can do is know where you are exposed. The firms that coped best in July 2024, according to the FCA, had mapped their important business services and the third and fourth parties behind them, and had existing lines of communication to share information quickly. That is not control. It is visibility and rehearsal, and it turned out to be worth far more.

Regulators have started to formalize this. The EU’s Digital Operational Resilience Act, applying to financial entities since 17 January 2025, requires a register of every ICT third-party arrangement, concentration-risk assessments and oversight of critical technology providers. Notably, it puts ultimate accountability for ICT risk on the management body, not on the IT department. The direction of travel is clear: you may outsource the service, but not the responsibility.
 

5. The Paradigm Shift: From Control to Resilience

If control is partly an illusion, what replaces it? I would argue the answer is resilience: the ability to absorb a hit, keep the important things running, recover quickly and learn from it. Control asks “how do we prevent this?” Resilience asks that too, but adds the harder follow-up: “when it happens anyway, what then?”

The two ideas are not enemies. Good controls reduce the number of bad days. Resilience decides how bad the bad days get. The shift is one of emphasis, and it changes what leaders spend their attention on.

5.1 What resilient governance looks like in practice

Start from the services that matter. Identify the handful of business services whose failure would really hurt customers or the market, then map the people, systems and suppliers each depends on. This is the heart of the UK operational resilience rules and of DORA, and it works for any organization.

Set impact tolerances, not just risk appetites. Decide in advance how long each service can be down before the damage becomes unacceptable. It forces honest conversations that a risk heat map never does.

Test against severe but plausible scenarios. Tabletop exercises, failover drills, a supplier going dark for three days. The FCA noted that firms with tested scenarios and rehearsed communications responded faster and with less harm. Aon’s post-incident polling found that although 76% of respondents said their incident response plan performed well, plenty of others had learned where theirs did not, which is exactly why you test.

Remove single points of failure where you can. Phase software rollouts, keep tested backups, maintain manual workarounds for critical processes, and avoid putting every important function on one vendor’s shoulders.

Plan the communication, not only the technology. In a crisis, customers and regulators remember how clearly you spoke to them. Decide who speaks, how quickly, and with what authority before you need it.
 

5.2 Culture beats paperwork

None of the above works if people are afraid to report a problem. A resilient organization is one where the junior analyst can say “I clicked something I shouldn’t have” within five minutes instead of five days. That is a leadership behaviour, not a policy clause. If the first response to a mistake is blame, the next mistake will be hidden, and hidden mistakes are the ones that become headlines.
 

5.3 Rethink what you report upward

Boards deserve better than a wall of green. Useful reporting shows how long critical issues stay open, how often the plan was exercised and what the exercise revealed, which suppliers carry concentrated risk, and where the organization is knowingly accepting exposure. Reporting that includes uncomfortable truths builds more trust, over time, than reporting that never does.
 

6. A Practical Starting Point

If this all sounds large, begin small. In the next quarter, pick three things. First, choose one critical service and map it end to end, including suppliers. Second, run a two-hour exercise on it with the people who would actually respond, and write down what surprised you. Third, take your most trusted control metric and ask what it would look like if it were green but wrong. Then fix what you find, and repeat. Resilience is built by repetition far more than by programmes.
 

7. Closing Thought

The goal was never to eliminate uncertainty. That was always a fantasy, and a slightly dangerous one, because it makes us stop looking. Frameworks, controls and audits are good tools, and I would not run an organization without them. But they work best in the hands of people who know their limits.

So hold your controls a little more loosely. Ask what they cannot see. Practise for the day they fail. The organizations that come through the next big disruption in good shape will not be the ones that felt most in control. They will be the ones that were honest about how little control they had, and prepared accordingly.
 

Sources and further reading

Saturday, November 14, 2026

Designing Consent Management for the DPDP Act: Requirements, Integration and a Reference Architecture

For years, consent in most Indian enterprises has meant a checkbox and a link to a privacy policy nobody reads. The Digital Personal Data Protection Act, 2023 and the DPDP Rules, 2025 put an end to that. Consent is now a record you have to prove, a choice the user can reverse, and a promise tied to a specific purpose. Every system that touches personal data has to respect it, which makes this as much an architecture problem as a legal one. In this post I'll walk through what the law asks for, what a Consent Management Solution (CMS) needs to do about it, how to wire it into the wider enterprise, and a reference architecture you can adapt.

The legal baseline in brief

Start with Section 6. Valid consent must be free, specific, informed, unconditional and unambiguous. It needs a clear affirmative action, and it can only cover the personal data necessary for the stated purpose. Section 6(10) puts the burden of proof on you, the Data Fiduciary: if there's a dispute, you have to show that a notice was given and that consent followed the rules. Sections 6(4) and 6(5) let the Data Principal withdraw consent, and once she does, processing has to stop. Sections 2(g) and 6(7) to 6(9) add the Consent Manager, a registered entity that acts as one point of contact where a person can give, manage, review and withdraw consent across fiduciaries.

Dates matter here. The Rules were notified on 13 November 2025 and come into force in phases. Rule 4, which covers Consent Manager registration, is computed to start on 13 November 2026. Rules 3 and 5 to 16 (notice, state processing, security safeguards, breach intimation, erasure timelines and rights) are computed to start on 13 May 2027. Treat those as interpreted dates until they are officially confirmed. Also note that, as of this writing, the Board hasn't published the application details or assurance standards for Consent Managers.

Consent and notice are one system

Section 5 says every request for consent must come with, or be preceded by, a notice. Rule 3 then spells out what that notice looks like. It has to make sense on its own, in clear and plain language. At a minimum it lists the personal data item by item, states the specific purposes, and describes the goods, services or uses the processing enables. It also has to give a link and explain how the person can withdraw consent (as easily as she gave it), exercise her rights and complain to the Board. Under Section 5(3) she can ask to read it in English or any Eighth Schedule language.

The practical takeaway is that a consent record is only as good as the notice version it points to. Part B of the First Schedule already makes Consent Managers keep the notices that came with each request, and your CMS should do the same. In practice that means three things: a notice service that versions, translates and publishes notices; a purpose registry that both the notice and the consent record refer to; and a consent receipt that ties together the person, notice version, purpose, data items and timestamp in one tamper-evident object.

Key characteristics of a DPDP-ready Consent Management Solution


Turning the law into platform capabilities, a good CMS should have these characteristics.

  • Purpose-granular and unbundled. Capture consent per purpose, never as one blanket flag. Section 6(1) limits consent to data necessary for the purpose, so your model has to link purposes to data items.
  • Affirmative and non-coercive. No pre-ticked boxes and no "by continuing you agree" tricks. The UI SDK should give accept and reject equal weight.
  • Withdrawal parity and propagation. Rule 3 says withdrawing must be as easy as consenting. Behind the scenes, a withdrawal has to reach every downstream system and processor quickly, and they must stop processing.
  • Immutable, verifiable evidence. Log every grant, denial, change and withdrawal as an append-only, hash-chained, signed event that records the notice version, language, channel and what was shown. This is your defence under Section 6(10).
  • Multilingual notices. Support English and the 22 Eighth Schedule languages, with versioned translations.
  • Machine-readable and portable. People should be able to see their history. Consent Managers must provide records in machine-readable form and keep them for at least seven years (First Schedule, Part B). Even as a fiduciary, matching that retention is a sensible benchmark.
  • Interoperable. Use open, documented APIs so you can work with registered Consent Managers and other fiduciaries, as the Act intends.
  • Child and guardian aware. Rules 10 and 11 require verifiable consent for children and for persons with disabilities who have lawful guardians, so you need to model guardian relationships and keep the verification evidence.
  • Policy-driven. Retention, legitimate-use exceptions (Section 7) and re-notice for legacy consent (Section 5(2)) should be configuration, not code.
  • Contact and grievance linked. Each request carries the Data Protection Officer's or another authorised contact, and consent events tie into the grievance workflow under Section 13.

Enterprise-wide integration requirements

A CMS that sits beside your estate instead of inside it won't survive an audit. You're responsible for what your processors do with the data, so integration is where compliance is won or lost.
 

Collection channels

Websites, mobile apps, call centres, branches, kiosks, IVR, partner portals and APIs should all call the same Consent API. Offer lightweight SDKs for JavaScript, Android and iOS, plus a headless mode for assisted channels. There, an agent records the consent and the system sends an OTP to the customer to confirm it.

Enforcement points

Consent you record but never enforce is just paperwork. Hook the CMS into these points:

  • API gateways and service mesh: a policy decision point (PDP) check on purpose before personal data is returned or shared.
  • Data platforms: data lake, warehouse and streaming layers filter or mask records by purpose-level consent, ideally through row and column-level policies.
  • Marketing, CRM and analytics tools: audience syncs consult the consent store, and withdrawal events trigger suppression.
  • Processors and SaaS vendors: contracts and technical connectors that deliver withdrawal and erasure instructions, and confirm completion.
 

Identity, rights and security tooling

Bind each consent to a stable, pseudonymous subject ID from your identity platform. Connect the CMS to your rights-request workflow (access, correction, erasure, nomination), to your data inventory so notices match real data flows, and to the SIEM for monitoring. Breach intimation under Rule 7 and the erasure timelines under Rule 8 both depend on knowing where consented data actually lives.

Integration patterns

I'd go event-driven. The CMS publishes ConsentGranted, ConsentModified and ConsentWithdrawn events to a broker, and each consumer keeps a cached view of consent with an agreed propagation SLA. Reserve synchronous policy calls for high-risk, real-time decisions. Make consumers idempotent, sign every message, and reconcile regularly so you catch drift early.
 

Reference architecture and ideal tech stack

The design below is layered and cloud-neutral, and it rests on one idea: the consent ledger is the source of truth, and everything else holds a derived view that can be verified against it. The product names are examples, so swap in equivalents that fit your hosting and data-residency constraints.


Layer Components Recommended tech stack Design intent
Experience Consent and preference UI, notice renderer, multilingual content React or Angular micro-frontend, native SDKs, WCAG 2.1 AA, i18n with Eighth Schedule fonts Notice-first, symmetric accept and withdraw, no dark patterns
Edge and access API gateway, WAF, bot control, rate limiting Kong, Apigee or Azure API Management; OAuth 2.1 and OIDC; mTLS Authenticated Data Principal sessions; abuse protection
Core services Consent, Notice and Purpose Registry, Preference, Guardian, Grievance services Java/Spring Boot, .NET or Go microservices on Kubernetes; OpenAPI contracts Stateless, versioned, idempotent APIs
Policy Policy decision and enforcement Open Policy Agent or Cedar; purpose-based access control Runtime check of purpose, consent and legitimate-use rules
Eventing Consent event backbone and propagation Kafka or Azure Event Hubs; schema registry; outbox pattern Near real-time withdrawal propagation, replayable
Evidence store Append-only consent ledger and receipts PostgreSQL with hash chaining, or a ledger database; object storage with WORM lock; HSM-backed signing Tamper evidence; retention at or above seven years
Security Identity, keys, secrets, tokenisation Keycloak, Entra ID or Okta; HashiCorp Vault or cloud KMS and HSM; field-level encryption Encryption, masking and virtual tokens per Rule 6
Observability Logs, metrics, traces, alerts, audit OpenTelemetry, ELK or Splunk, SIEM integration Access visibility and logs retained at least one year
Integration Connectors to CRM, data lake, marketing, processors Debezium CDC, Airbyte or custom adapters, a data catalogue for lineage Enterprise-wide enforcement and drift reconciliation

How the flow works


  1. The experience layer fetches the active notice version for a purpose and language from the Notice and Purpose Registry and renders it, itemising data and purposes.
  2. The Data Principal acts affirmatively. The Consent Service validates the request, writes an event with the notice hash, and issues a signed consent receipt.
  3. The outbox publishes ConsentGranted to the broker. Consumers update their local consent views.
  4. At runtime, gateways and data services ask the policy engine whether purpose P may use data D for subject S. Denials are logged.
  5. On withdrawal, the same path fires in reverse. Consumers stop processing, processors acknowledge, and the ledger records completion, which closes the loop for audit.

If you plan to operate as a registered Consent Manager and not just run a CMS for your own business, you'll need more. Add multi-fiduciary onboarding and consent routing between fiduciaries, and design the platform so it can't read the personal data it passes along, as Part B of the First Schedule requires. Part A also calls for independent certification against the Board's standards, and Part B bars you from sub-contracting your obligations.
 

Security integrity and compliance mapping

Rule 6 sets the minimum security bar for every Data Fiduciary, and it covers processing done by your processors too. It asks for encryption, obfuscation, masking or virtual tokens; access controls; logs and monitoring to spot unauthorised access; backups for continuity; one-year retention of relevant logs and data unless another law says longer; security clauses in processor contracts; and sensible technical and organisational measures. Here's how I'd translate that into design choices.

  • Encryption and tokenisation (Rule 6(1)(a)): TLS 1.3 in transit, AES-256 at rest, envelope encryption with HSM-held keys, and field-level encryption or tokens for identifiers such as mobile number and email in the consent store.
  • Access control (6(1)(b)): least privilege, RBAC plus attribute-based rules, privileged access management with just-in-time elevation, and mutual TLS between services.
  • Logging and monitoring (6(1)(c), (e)): immutable audit logs of every read of consent and personal data, streamed to the SIEM, with anomaly alerts and one-year minimum retention.
  • Resilience (6(1)(d)): multi-zone deployment, tested backups, defined RPO and RTO, and ledger replication so evidence survives an incident.
  • Integrity of evidence: hash-chained events, periodic anchoring of ledger digests in a separate store, digital signatures on receipts, and time-stamping from a trusted source.
  • Processor assurance (6(1)(f)): contractual clauses and automated attestations for withdrawal and erasure.
  • Data minimisation in the CMS itself: store identifiers and purpose references, not the personal data being consented to, which also fits the Consent Manager rule that contents must not be readable by it.
  • Breach readiness (Rule 7): runbooks that use consent and lineage data to scope affected Data Principals quickly, supporting the intimation duties and the 72-hour report to the Board.
  • Secure SDLC: threat modelling, SAST and DAST in the pipeline, dependency scanning, and penetration tests aligned with ISO/IEC 27001 and, for Significant Data Fiduciaries, the additional obligations in Rule 13.

Practical roadmap

Most obligations are computed to apply from 13 May 2027, so a phased plan is realistic.

  1. Discover (now): inventory personal data, purposes, processors and existing consents. Classify legitimate-use cases under Section 7 so you do not over-collect consent.
  2. Design: define the purpose taxonomy, consent data model and event schemas. Draft Rule 3-compliant notices and run them through legal review.
  3. Build the core: consent ledger, notice registry, policy engine and SDKs, then migrate one high-volume channel.
  4. Integrate and enforce: connect CRM, marketing and data platforms and onboard processors. Test withdrawal end to end.
  5. Operate: dashboards for consent rates and propagation latency, periodic reconciliation, notice re-versioning, and readiness to integrate with registered Consent Managers once the Board publishes its standards.
 

Conclusion

The DPDP Act makes consent a system of record. The notice says what the person agreed to, the ledger proves she agreed, and the enforcement layer makes sure every system acts on it, including when she changes her mind. Build those three as one platform, secure it to the Rule 6 standard, and expose it through open APIs. You'll be ready for the regulator and for Consent Managers when they arrive. This is an engineering view, not legal advice, so check your design with counsel and keep an eye on Board publications and any official confirmation of the commencement dates.

Monday, November 9, 2026

Cyber Recovery Readiness: The Dark Side of “We Have Backups”

Why recovery playbooks unravel under pressure—and how to stop familiar failures becoming expensive surprises.

Conceptual illustration: the gap between protected data
and a trustworthy return to business.
Picture a recovery call that begins with relief. The backups are intact. Someone announces that restoration can start. Then the questions arrive. Who can unlock the vault? Where are the encryption keys? Why does the restored application refuse to authenticate? And who is authorised to reconnect it?

This is an illustrative scene, not a reported incident. Its point is simple: a backup can survive while the ability to use it does not.

That is the dark side of cyber recovery readiness. The reassuring evidence—a green dashboard, a signed playbook, a successful file restore—may prove something much narrower than leaders think. The awkward question is not whether data exists somewhere. It is whether the organisation can rebuild a trustworthy service while its normal tools, identities and working assumptions are unavailable.

The threat to backups is not hypothetical. In a Sophos-commissioned survey conducted by Vanson Bourne in early 2024, 94% of 2,974 ransomware-hit respondents said attackers had attempted to compromise their backups; 57% of backup compromise attempts succeeded. These are self-reported findings from affected organisations, not a prediction for every business.

The failures below are recurring risk patterns drawn from recovery guidance, incident lessons and practical synthesis. They are not a statistically ranked league table: the available evidence does not establish which playbook failure is universally “most common”.

Recovery means rebuilding trust, not just restoring files

A conventional outage asks, “What broke?” A hostile incident adds, “What can we still trust?” That distinction changes the job. A recovery plan must account for compromised access, questionable restoration assets and the possibility that returning systems will recreate the conditions of the attack. The NIST Cybersecurity Framework 2.0 explicitly separates verification of restoration assets, verification of restored services, and criteria-based recovery closure.

Think of cyber recovery as restoring an operating capability, with evidence that it is safe enough to use. A server booting is a milestone. A customer transaction completing correctly, under restored controls, is closer to the outcome that matters.

Where the playbook breaks

1. The backup survives. Its control plane does not.

“Immutable” is a useful property, not a complete recovery strategy. A protected copy is little comfort if the attacker can remove access to it, compromise its administration, or make the decryption keys unavailable. The UK National Cyber Security Centre treats destructive actions, customer access, historical versions, key management and alerting as separate cloud-backup concerns.

Prevent the surprise: Separate backup administration from everyday production privileges. Protect retention settings and destructive operations with controls appropriate to the platform, including independent approval where supported. Establish an out-of-band recovery route with the provider. Test key retrieval from an approved independent location, rather than assuming the production secrets store will still work.

Prove it: Run a restore exercise with corporate authentication unavailable and the usual backup administrator absent. Retrieve the catalogues, credentials and keys through the approved emergency process. Record what genuinely worked, not what someone believes support could probably arrange.

2. The newest backup is not the safest backup.

Immutability protects a copy against subsequent alteration; it does not certify that the original contents were trustworthy. An older compromise or corrupted configuration may already be inside the data being preserved. NCSC therefore calls for historical recovery versions and regular monitoring and testing, while NIST calls for restoration-asset integrity verification before use.

Prevent the surprise: Make recovery-point selection a joint security and recovery decision. Use the investigation timeline, available logs, configuration baselines and isolated restore tests to assess candidate copies. Distinguish restoring business data from restoring an entire machine image: the latter also brings back operating-system state and settings.

A clean-room scan is one piece of evidence, not a certificate of innocence. Define who can approve a candidate, what unresolved uncertainty remains, and when to reject it. Have the business owner assess the operational consequences of an older restore point. Otherwise, the argument about missing transactions starts only after restoration has already begun.

3. Identity becomes a circular dependency.

The recovery team needs authentication to reach its tools. The authentication service needs those tools to be recovered. Meanwhile, privileged credentials may be untrustworthy. This is the access-denial problem NCSC warns about: attackers can obstruct recovery without deleting a single backup by disabling the identities used to reach it.

Prevent the surprise: Document how recovery starts without the normal directory, federation service, administrator workstation or multi-factor device. Maintain protected, monitored emergency access and clean administrative devices. Specify the sequence for recovering identity services and rotating affected secrets, including machine and application credentials—not just human passwords.

Emergency access needs ownership, secure custody, periodic testing and an auditable use record. It must not become an unmanaged shortcut around security.

Prove it: Begin the exercise from an untrusted-production assumption. Ask the team to establish the first trusted administrative session. If the answer is “log in with the usual account”, the bootstrap procedure needs another pass.

4. Recovery order ignores what services depend on.

A priority list can look perfectly sensible and still be impossible to execute. “Restore customer ordering first” says little about the identity, name resolution, network routes, database, certificates and partner interfaces that ordering requires. NIST recovery guidance explicitly highlights interdependencies across people, processes and technology.

Prevent the surprise: Build the sequence around minimum viable business services, not a list of important servers. Map each service to its technical dependencies, accountable owners, external connections and acceptance tests. Identify which foundations must return first and which integrations can temporarily remain disconnected.

For each dependency, record the recovery source, required access, fallback and evidence needed before the next step starts. Revisit the map after architectural changes; a forgotten integration can turn yesterday’s working runbook into today’s dead end.

Prove it: Have a business user complete a representative transaction across the recovered chain. Successful component restores are not a substitute for a working service.

5. There is nowhere viable to restore.

The British Library’s March 2024 incident review is a sobering example. It reported secure copies of its digital collections, but a lack of viable infrastructure on which to restore them. Major software systems could not simply return in their pre-attack form because they were unsupported or incompatible with the new secure infrastructure.

The lesson is not “buy more backup storage”. It is that surviving data and executable recovery are different things.

Prevent the surprise: Maintain a rebuild bill of materials: supported installation media, configuration exports, infrastructure definitions, licences, certificates, keys and supplier contacts. Validate replacement capacity and compatibility before the crisis. Identify legacy systems that need migration rather than restoration, and fund that work as a readiness gap.

Include cloud and hosted applications in the exercise scope. Ask exactly what can be recovered: records, attachments, permissions, configuration and integrations may require different procedures. Treat each provider’s documented capability as a boundary to test, not an assumption that “the cloud” will take care of recovery.

6. Recovery-time promises exclude most of the work.

A laboratory restore measures what happened in that laboratory. It does not automatically establish how long a real incident will take when access must be rebuilt, copies validated, infrastructure provisioned and services tested. NIST recommends realistic recovery scenarios, milestones and actionable metrics—not simply a document that describes intended timings.

Prevent the surprise: Measure the whole journey to an agreed usable service. Include declaration and mobilisation, trusted access, recovery-point selection, data transfer, rebuilding, security checks, business validation and controlled reconnection. Record delays separately so that an apparently slow restore is not blamed for a procurement or approval bottleneck.

Define both the recovery time objective—the recovery-phase duration before unacceptable business impact—and the recovery point objective—the point in time to which data must be recovered after an outage. Treat them as business requirements to validate, not product guarantees.

Test representative data volumes and concurrent demand. Pre-arrange required capacity and escalation paths. Publish measured results alongside targets, with assumptions visible. An honest gap can be funded; an invisible gap only becomes a surprise.

7. The application works, but the business records do not.

Imagine, illustratively, an order database restored to one point in time while a payment feed resumes from another. Screens load, yet staff cannot tell which orders were paid, shipped or duplicated. The service is technically available but operationally uncertain. NIST’s recovery outcomes include confirming normal operating status, not merely returning assets to service.

Prevent the surprise: Specify consistency checks across connected systems. Assign ownership of transaction reconciliation, duplicate detection, queue replay and records entered during manual workarounds. Identify which external records can support reconciliation and how access to them will be obtained.

Have business owners write acceptance tests before the incident: what must balance, which workflows must complete, and what temporary limitations are tolerable? Preserve a clear boundary between validated data and unresolved items.

Prove it: Exercise a deliberately mismatched recovery point and a backlog of manual transactions. The team should show how it resolves ambiguity without guessing or silently overwriting evidence. “The database restored successfully” is not the final sign-off.

8. Reconnection happens before trust is established.

The pressure to bring something back is understandable. But the decision to restore a workload and the decision to reconnect it should be separate. NIST places verification of restored assets and confirmation of normal operating status explicitly within recovery execution.

Prevent the surprise: Use an isolated recovery environment with controlled administration and connectivity. Before release, require documented checks appropriate to the incident: known entry weaknesses addressed, affected credentials replaced, security monitoring functioning, configurations reviewed and business tests passed. Confirm that connected systems and supplier interfaces are ready too.

Define a release authority and a rollback trigger. If suspicious behaviour appears, the team needs a pre-agreed way to isolate the service again without a fresh argument about who can interrupt business.

Do not demand an impossible promise of zero residual risk. Require an explicit, evidence-backed decision about what is known, what remains uncertain and what compensating controls are in place. Urgency should change prioritisation, not erase the release criteria.

9. The people and decision paths are missing.

The British Library’s account of its response describes alternative communication channels, staff cascades and in-person briefings, and stresses regular updates and staff wellbeing. It also highlights practising business continuity for total systems outages, rather than only single-system failures.

Prevent the surprise: Keep a securely accessible, independent copy of the playbook, contact tree, supplier escalation details and decision log. Agree approved alternative communications. Name deputies for key roles and prepare shift handovers so the response does not depend on one exhausted expert.

Clarify who can authorise isolation, emergency spending, external assistance, recovery-point selection and service release. Have legal counsel and insurance advisers help document applicable notification, evidence-preservation and supplier-approval requirements in advance; those obligations vary.

Coordinate containment and forensic preservation rather than letting recovery teams wipe systems independently. Predetermine how urgent safety or containment decisions will be recorded. A useful playbook makes the next decision easier when normal governance is under strain; it does not pretend that governance disappears.

10. The rehearsal is easy—and “recovered” is declared too soon.

A scripted demonstration can prove that a script works. It may say little about recovery with missing credentials, unavailable staff or compromised dependencies. NIST’s recovery guidance calls for realistic scenarios and continual improvement from exercises and past events. Its framework also requires criteria-based closure and completed incident documentation.

Prevent the surprise: Combine discussion-based exercises with controlled technical restores. Introduce plausible obstacles: an inaccessible key store, an older recovery point, a failed supplier escalation or a business owner who rejects inconsistent records. Do this within an approved exercise boundary; testing resilience should not endanger production.

Define recovery completion in business terms, including validated transactions, restored controls, reconciled backlogs, user communications and remaining restrictions. Assign every exercise finding an owner and a retest. Otherwise, the same surprise simply moves from the exercise report into the incident call.

Finally, resist closing the entire incident because services are available. Stolen information can still require a separate response: NCSC explicitly notes that ransomware-resistant backups do not address data-theft extortion.

A backup is an asset. Recovery is an organisational capability.

Make readiness uncomfortable before recovery becomes urgent

The following is a proposed exercise design, not a prescribed standard. Choose one critical business service and assume production identities, normal collaboration tools and the primary administrative environment cannot be trusted. Keep the test isolated and its boundaries agreed.

Ask the team to demonstrate five gates:

  • Access: Obtain the playbook, trusted administrative devices, backups and keys without relying on the failed environment.
  • Trust: Select and justify a recovery point, validate restoration assets, and record unresolved uncertainty.
  • Capability: Rebuild the dependencies and application in a supported, controlled environment.
  • Business acceptance: Complete representative workflows and reconcile missing, duplicated or manually entered records.
  • Release: Approve reconnection, demonstrate monitoring and rollback, and document residual restrictions.

Capture elapsed time at each gate, the people and approvals required, the failed assumptions and the evidence produced. Review the result with business owners, not just the infrastructure team. The useful measures are time to a validated minimum service, reconciliation effort, dependency gaps and whether emergency access actually worked.

Then fix and retest the failures. Schedule further exercises according to service criticality and change, rather than treating last year’s success as permanent evidence. CISA recommends offline, encrypted backups and regular backup testing; the broader exercise asks whether the organisation can turn those copies into service.

The uncomfortable question worth asking

Cyber recovery readiness is not pessimism. It is a willingness to challenge comforting assumptions while there is still time to change them.

The dark side is the gap between owning recovery technology and being able to execute recovery under hostile conditions. Close that gap with independent access, defensible recovery points, dependency-aware sequencing, realistic timings and business-owned acceptance.

At the next readiness review, replace “Do we have backups?” with a harder question: “Can we prove that the business will work again when the things we normally depend on cannot be trusted?”

That conversation may be uncomfortable. It is still the cheaper place to discover the answer.

Research and further reading

The following are the sources consulted. The survey is historical, the opening and transaction scenario are illustrative, and the exercise design and mitigations are practical synthesis—not claims of measured failure prevalence.


Tuesday, November 3, 2026

Beyond the HR File: Governing Employee Data Under India’s DPDP Act

Employee information travels far beyond the HR department. A phone number enters a customer WhatsApp group. A photograph appears in a promotional campaign. A résumé reaches a prospective client. A home address is sent to a courier. Family details reach an insurer. Cameras record movement through the office, while access systems capture fingerprints and payroll agencies receive bank details.

Each activity may have a legitimate business purpose. That does not mean every collection, disclosure, reuse, or retention practice is justified.

India’s Digital Personal Data Protection Act, 2023—the DPDP Act—requires organisations to examine the purpose of processing, the applicable legal ground, and the safeguards surrounding it. The central question is not merely, “Is this our employee?” It is: “What are we doing with this individual’s data, why, and within what boundaries?”

This distinction matters because the Act recognises certain employment-related uses without consent, but does not create an unrestricted exemption for employee information. Employer ownership of a device, mailbox, photograph repository, or HR system does not eliminate the personal-data character of the information inside it. The statutory definition turns on whether an individual is identifiable by or in relation to the data.

The legal foundation: employment is a ground, not a blanket waiver


Section 7(i) permits processing for purposes of employment, purposes related to safeguarding the employer from loss or liability, and provision of a service or benefit sought by an employee. It expressly refers to matters such as preventing corporate espionage and maintaining confidentiality of trade secrets and intellectual property.

The provision is commercially useful, but its boundaries matter. Routine payroll administration is a stronger employment-purpose case than using an employee’s portrait in an advertising campaign. Providing a requested benefit is different from automatically collecting additional family information for unrelated initiatives.

Legal commentary has highlighted the difference between the earlier draft’s broader language about purposes “related to employment” and the enacted wording, “purposes of employment.” That drafting history supports caution, although commentary is not a binding judicial determination. Businesses should avoid assuming that every activity benefiting the employer necessarily falls within section 7(i).

For each activity, document:
  • The precise purpose and minimum information needed.
  • The relevant consent or particular section 7 ground.
  • The people or organisations receiving the information.
  • Whether each recipient acts on instructions or determines its own purposes.
  • Security controls, retention rules, and deletion arrangements.
  • How questions, corrections, withdrawals, and complaints will be handled.

Where consent is used, section 6 requires it to be free, specific, informed, unconditional, unambiguous, and communicated through clear affirmative action. Consent must cover only data necessary for the specified purpose, and withdrawal must be comparably easy. Employment does not make valid consent impossible, but pressure, bundled permissions, or adverse consequences for declining an optional use can make it difficult to defend.

Ten everyday workplace scenarios, their legal ambiguities, and a practical path to defensible compliance

1. Using an employee’s personal mobile number for business

The compliance position

A personal mobile number is personal data when connected to an identifiable employee. Using it for emergency contact, essential work coordination, or an authentication process is materially different from publishing it as the organisation’s customer-service number.

Necessary internal communication may reasonably fit section 7(i). Public distribution, permanent customer contact, or addition to external messaging groups requires a more careful purpose analysis.

The ambiguity

The Act does not specify exactly when use of a personal number becomes “for purposes of employment.” A number supplied for HR emergencies is not automatically authorised for sales enquiries. Nor does reimbursement of a mobile bill establish unlimited permission to disclose the number.

Messaging groups create additional exposure: other participants can see and retain the number, and the employer may have limited control over those copies.

The lower-risk approach

Provide company-managed numbers, business calling tools, or role-based contact channels for customer-facing responsibilities. Restrict personal numbers in internal directories to those who need them.

For optional external use, obtain separate, recorded permission explaining the audience and purpose. Do not treat the employee’s submission of a number during onboarding as universal consent.

Offer an alternative authentication method where practical. At exit, remove the number from organisation-controlled directories and groups, update customer contact information, and end its use as a business contact. A BYOD policy should also distinguish business information from unrelated personal contacts and files.

Practical principle: 

A personal number may support employment; it should not silently become a permanent corporate asset.

2. Using employee photographs in social-media promotion

The compliance position

An identifiable employee photograph is personal data. Collection for an identity card or internal directory serves a different purpose from publication on social media.

Promotional publication is a weaker case for relying solely on the employment ground. The conservative approach is separate, genuinely optional consent.

The ambiguity

There is a spectrum between an incidental appearance in an office-event photograph and a named employee becoming the face of a paid advertising campaign. The Act does not provide a detailed employee-image rule resolving every point on that spectrum.

The public-data exclusion also requires care. It concerns data made publicly available by the individual, or by another person legally obliged to publish it. An employer should not assume that its own unauthorised publication creates an exemption. Nor should an employee’s public profile photograph be treated as unrestricted permission for a new promotional use.

The lower-risk approach

Separate photo permissions from mandatory employment documentation. Identify the campaign, platforms, photograph or recording, whether names and tags will appear, and intended duration.

Permit refusal without employment consequences. Provide photo-free participation arrangements for events and obtain additional permission for materially different uses, such as paid advertising or a new campaign.

Maintain a publication register linking assets to permissions and review dates. Explain withdrawal realistically: the organisation can stop future use and remove material it controls, but cannot guarantee removal of screenshots, reposts, or third-party caches.

Practical principle: 

Permission to take a photograph is not automatically permission to publish, tag, promote, or reuse it.

3. Sharing employee profiles with a prospective customer

The compliance position

Professional information remains personal data when it identifies an individual. Qualifications, project experience, certifications, and employment history do not lose protection merely because they concern work.

For a staffing or consulting business, sharing a limited profile for a genuine, proposed assignment may reasonably form part of employment. That assessment is stronger where employees understand that client deployment is part of their role.

The ambiguity

A customer may decide independently how to retain and use profiles. It should not automatically be labelled the employer’s Data Processor.

The boundary becomes less defensible when sales teams circulate complete résumés to many prospects, retain them indefinitely in customer databases, or include home addresses, personal numbers, compensation, identification documents, or family details.

An existing employee’s deployment is also different from recruiting an external candidate or arranging an unrelated placement.

The lower-risk approach

Use a standard, minimised client profile: relevant skills, verified experience, certifications, and availability. Use a profile identifier or de-identified summary at the early commercial stage where feasible; recognise that unusually specific experience can still identify someone.

Have the employee verify accuracy before disclosure. Explain the customer-sharing process and obtain specific consent where the proposed use falls outside the documented employment purpose.

Use secure, access-controlled sharing and agree restrictions on onward disclosure, unrelated recruitment, retention, and deletion. Release identification or clearance documents only at the justified stage, through a separate controlled workflow.

Practical principle: 

A customer needs evidence of suitability, not an unrestricted copy of the HR file.

4. Sharing home addresses with courier agencies

The compliance position

A home address and contact number are personal data. Delivery of work equipment may support an employment purpose. Delivery of a gift requested or accepted by the employee may support a sought benefit or a clearly specified voluntary disclosure.

The ambiguity

A surprise gift does not necessarily demonstrate that the employee sought home delivery. A residential address provided for statutory or emergency records should not automatically be repurposed for every distribution campaign.

Couriers may act on instructions for part of the delivery process and determine their own purposes for other processing, including legally required records. Role classification must follow the actual arrangement.

The lower-risk approach

Offer office collection or allow the employee to confirm a preferred delivery address. Explain the courier disclosure when offering the delivery.

Share only what is needed: recipient name, confirmed address, necessary contact information, and delivery instructions. Do not include employee IDs, departmental rosters, or unrelated HR information.

Use controlled transfers rather than wide email circulation. Contractually restrict mailing-list reuse, unrelated marketing, and unnecessary onward disclosure. Separate temporary distribution spreadsheets from delivery records that must be retained under applicable law.

Practical principle: 

Confirm the delivery choice before converting an HR address into a logistics list.

5. Collecting employees’ children’s data for family insurance

The compliance position

This scenario involves separate individuals, not merely extensions of the employee record. The employee, an adult dependant, and a child each have their own personal data.

Providing employee-requested family insurance may support an employment-benefit purpose. However, relying on section 7(i) for the employee does not automatically remove the special requirements attaching to a child’s information.

A child is an individual under eighteen. Under the notified framework, section 9 requires verifiable parental or lawful-guardian consent before processing, subject to applicable exemptions. Rule 10 sets out verification mechanisms, including use of reliable identity and age information already held or appropriate voluntarily supplied information or authorised tokens.

The ambiguity

Employers should not assume that insurance enrolment is automatically exempt under Rule 12 and the Fourth Schedule. Any exemption must match the actual class, purpose, and conditions; it is not a general waiver for all beneficial processing.

The October 2026 Removal of Difficulties Order clarified wording in section 9 and the terminology for Significant Data Fiduciary audits. It did not introduce an employment-family-insurance exemption or move the substantive commencement timetable.

The lower-risk approach

Use a dedicated insurance-enrolment notice identifying the employer, insurer, administrator, data fields, and purposes. Record verifiable parental consent before collecting a child’s information, unless counsel confirms a specific applicable exemption.

Use existing verified HR information to establish the consenting employee’s adulthood where appropriate, rather than routinely demanding additional identity copies. Establish the person’s stated parental or lawful-guardian authority and a process for resolving uncertainty.

Collect only fields genuinely required for enrolment. Where possible, have medical declarations and claim documents submitted directly to the insurer rather than stored in general HR folders.

Adult dependants require their own lawful-ground analysis; an employee’s workplace consent is not a universal authorisation for another adult. When a child turns eighteen, review the ongoing processing and transition to an adult-facing notice and appropriate ground.

Treat the insurer as an independent fiduciary where it determines underwriting and claims purposes. Clarify the administrator’s role separately.

Practical principle: 

An employee benefit does not erase the separate rights and protections of family members.

6. CCTV recordings inside the office

The compliance position

Digital footage is personal data where individuals can be identified, directly or through other information. Security-focused employee recording may reasonably fit safeguarding the employer from loss or liability under section 7(i).

That does not justify every camera location, analytic feature, or later reuse.

The ambiguity

Employees, visitors, contractors, customers, and children may appear in the same recording. The employee ground does not automatically cover everyone.

Clear signage supports transparency, but should not be mistaken for proof of valid consent. Whether entering a clearly notified monitored area constitutes voluntary provision under section 7(a) is an interpretive question, not a reliable blanket answer.

Retention is another significant issue. Rule 6 addresses retention of relevant security logs and personal data for one year. Rule 8(3) uses broad language requiring retention of personal data, associated traffic data, and processing logs for at least one year for Seventh Schedule purposes. Its interaction with short rolling footage-retention periods needs a documented legal assessment. It is unsafe to advertise a universal “30-day DPDP CCTV rule.”

The lower-risk approach

Document each camera’s purpose and coverage. Avoid private spaces, unnecessary audio, and unrelated monitoring. Treat facial recognition or other identity analytics as a separate processing decision.

Publish accessible camera notices and a fuller policy. Restrict viewing, downloading, and remote access; log exports and protect recording infrastructure.

Before the substantive Rules commence, establish a retention interpretation addressing original footage, access logs, incident extracts, legal holds, and the one-year provisions. Where retaining original footage is required or conservatively adopted, protect it in a restricted archive rather than leaving it broadly searchable.

Practical principle: 

Cameras should protect the workplace, not create an uncontrolled archive of everyone who enters it.

7. Sharing personal and bank information with a payroll agency

The compliance position

Payroll is a strong example of a core employment purpose. Necessary sharing can reasonably be analysed under section 7(i); separate DPDP consent should not automatically be treated as the only available ground.

Existing SPDI requirements concerning financial information must also be assessed during the transition.

The ambiguity

A payroll provider may act as a processor when calculating salary on instructions, yet determine independent purposes for another service. Contract labels alone do not resolve that distinction.

Section 8(2)’s valid-contract requirement is worded around processor engagement for activities related to offering goods or services to Data Principals. Its precise application should not be overstated. Nevertheless, a written, enforceable payroll-processing agreement is the prudent baseline, and Rule 6 specifically addresses contractual security safeguards where applicable.

The lower-risk approach

Share only required payroll fields. Validate bank-detail changes through authenticated processes and independent checks. Use secure portals or controlled transfers instead of recurring unprotected spreadsheet attachments.

Address instructions, confidentiality, security, subprocessors, locations, incident reporting, assistance with requests, retention, deletion, and exit support in the contract. Prohibit advertising, enrichment, or unrelated analytics using payroll data without a separate lawful basis.

Provide finance teams with the information needed for their responsibilities, not unrestricted access to individual banking records.

Practical principle: 

Outsourcing payroll transfers work, not the employer’s accountability for its own processing.

8. Is an official email address personal data?

The compliance position

Usually, yes—where it identifies an individual.

A named corporate address is personal data despite using the employer’s domain. A generic address such as “support” may not identify someone in isolation, but can become personal data when linked to a named account holder, shift allocation, or activity log.

Emails may contain personal data about several people: employees, customers, suppliers, family members, or other correspondents. Describing the mailbox as “official” does not remove those interests. This follows from the Act’s identification-based definition, not from ownership of the account.

The lower-risk approach

Include named addresses in inventories, authorised directories, security controls, and retention arrangements. Use role-based addresses where business continuity does not require public identification of a particular employee.

Explain access and monitoring practices. Do not interpret an acceptable-use policy as permission for unlimited reading, disclosure, or reuse.

Practical principle: 

“Professional” and “personal data” are not mutually exclusive categories.

9. Retaining official email after an employee leaves

The compliance position

Departure does not require destruction of every business record. Equally, it does not justify keeping an entire mailbox forever.

Business correspondence may be needed for transactions, statutory recordkeeping, disputes, or genuine continuity. These purposes must be distinguished from retaining unrelated personal material or continuing to operate the former employee’s identity.

The ambiguity

The continuing reach of the employment ground after departure is not expressly resolved for every purpose. A genuine legal-right or claim circumstance may engage section 17(1)(a), but that exemption should not be used as a blanket justification for speculative future usefulness.

The Act’s erasure provisions must also be reconciled with legal retention and the Rules’ one-year provisions. No universal mailbox retention period can be derived simply from employment ending.

The lower-risk approach

Disable sign-in, revoke sessions and delegated access, and prevent continued sending as the former employee.

Move important business records to governed repositories. Retain necessary correspondence under a category-based schedule identifying its purpose, legal authority where relevant, retention trigger, and review date.

Use restricted, logged archive access. Avoid permanent manager access to the complete mailbox. Apply legal holds narrowly and remove them when no longer justified.

For incoming correspondence, use a time-limited departure notice and a role-based alternative. Avoid indefinite forwarding that silently captures new personal communications. Do not reassign the departed employee’s named address to a successor.

Practical principle: 

Preserve business evidence without indefinitely preserving or operating the individual’s digital identity.

10. Biometric information for physical access control

The compliance position

Fingerprint, face, and iris templates linked to an employee are personal data. The DPDP Act does not create a separate statutory category called sensitive personal data, but absence of that category does not make biometrics low-risk. The existing SPDI Rules expressly address biometric information.

A justified access-security purpose may fit section 7(i). It would be equally misleading to say that biometrics always require DPDP consent or that section 7(i) permits any biometric implementation.

The ambiguity

The real issue is often necessity: could badges or other less intrusive methods adequately address the threat?

A template remains personal data when linked or linkable to the employee. Calling it encrypted, encoded, or “hashed” does not necessarily make it anonymous.

Using access templates later for attendance analytics or another purpose requires a fresh assessment.

The lower-risk approach

Assess alternatives before deployment and document why biometrics are justified. Where practical, offer a secure non-biometric method.

Prefer controlled templates over retained raw images. Separate the template database from the HR master record, protect keys independently, restrict access, and prohibit vendor reuse for model training or unrelated identity services.

Immediately revoke access at exit. Separately determine lawful template retention, deletion, vendor erasure, and backup handling; do not assume that disabling an account deletes its biometric record.

Practical principle: 

If an ordinary badge solves the problem, collecting an enduring bodily identifier may be unnecessary.

Governance controls that make all ten scenarios defensible

1 Provide transparency, without pretending every notice is consent

Section 5 and Rule 3 govern notices associated with consent requests. It is imprecise to claim that their exact notice mechanism automatically applies identically to every section 7(i) activity.

Nevertheless, a comprehensive employee privacy notice is sound governance. Explain routine employment processing, optional uses, recipients, monitoring, retention, and contact channels. Keep optional promotional permissions separate from payroll and mandatory administration.

2 Protect information across organisational boundaries

Rule 6 sets minimum security expectations, including appropriate data protection measures, access controls, visibility through logs, continuity measures, and contractual safeguards where applicable.

Select controls according to risk. Masked payroll views, secure family-insurance enrolment, restricted CCTV archives, and business-managed communication channels are more meaningful than a policy stating only that information will be kept “secure.”

3 Resolve retention before making deletion promises

Section 8(7) establishes erasure triggers, subject to lawful retention. The final Rules introduce additional retention requirements. Organisations should not copy GDPR-style deletion expectations into an Indian policy without reconciling the notified wording.

Create separate schedules for operational records, legally required evidence, security logs, vendor copies, backups, and legal holds. Do not apply the Third Schedule’s inactivity arrangements indiscriminately to every HR record. Obtain a documented interpretation of Rule 8(3), particularly for footage, biometrics, delivery records, and exited mailboxes.

4 Handle rights according to their statutory conditions

Sections 11 and 12 contain consent-linked wording, including section 7(a). It is therefore inaccurate to assume that their full access, correction, and erasure mechanics apply identically to all processing based solely on section 7(i).

That distinction should not become an excuse to ignore employees. Maintain practical correction and complaint channels, protect other people’s information when responding, and explain justified retention clearly. Section 13 separately addresses accessible grievance redressal.

5 Prepare for incidents and international processing

Once applicable, Rule 7 requires breach intimation to affected individuals without delay, initial information to the Board without delay, and detailed information within seventy-two hours or a permitted longer period. A vendor contract should require notification early enough to support the employer’s response.

For overseas HR platforms, shared-service centres, and vendors, examine section 16, Rule 15, any notified restrictions, and stricter sectoral requirements. The framework should not be reduced either to “everything must remain in India” or “all overseas transfers are unrestricted.”

6 A practical readiness programme

Begin with an inventory of the ten activities discussed here. Assign an accountable owner to each and record the information collected, exact purpose, proposed legal ground, recipients, protection measures, and retention interpretation.

Next, remove unnecessary disclosures: replace public personal numbers with business channels, minimise customer profiles, obtain optional photo permissions, confirm delivery addresses, and move medical submissions directly to insurers where feasible.

Then strengthen vendor arrangements and offboarding procedures. Test whether a withdrawn photo permission stops new publication, whether a changed address reaches the correct courier, whether a payroll vendor reports an incident promptly, and whether departed employees lose access without destroying legally required evidence.

Finally, obtain focused legal review of unresolved issues rather than settling for a generic compliance certificate. Employment-purpose boundaries, children’s exemptions, visitor CCTV grounds, and one-year retention interpretation deserve particular attention.

Conclusion: the goal is justified use, not maximum collection


Employee-data governance requires organisations to distinguish necessary administration from convenience, a requested benefit from an unsolicited disclosure, a security control from excessive monitoring, and a business record from an indefinitely retained identity.

The lowest-risk approach is not to obtain one sweeping consent form. It is to select the correct ground for each purpose, collect less, explain more, limit recipients, secure the information, and retain evidence of the decisions made.

No organisation can promise zero legal or operational risk. It can, however, build a defensible position: every significant use of employee data has a clear purpose, a reasoned legal basis, controlled implementation, and an accountable owner.

That is the difference between merely holding employee information and genuinely governing it.

Tuesday, October 6, 2026

Python vs. .NET Core in Regulated Industries: An Architect’s Guide

As a software architect, CTO, or technical lead in a highly regulated industry—such as Banking, Financial Services, and Insurance (BFSI) or Healthcare—you are frequently faced with a high-stakes decision: choosing the right technology stack for your next major enterprise initiative. It is a choice that will echo through your organization for years, impacting cloud costs, hiring pipelines, developer velocity, and crucially, system reliability and regulatory compliance.

When it comes to modern backend engineering in these sectors, two titans frequently dominate the conversation: Python and .NET Core (now officially known simply as .NET, from version 5 onwards).

On the surface, they represent completely different philosophies. Python is the dynamic, interpreted darling of the data science, quantitative analysis, and AI revolutions, known for its rapid prototyping capabilities. .NET is Microsoft’s battle-tested, statically-typed powerhouse, a compiled framework built for high throughput, massive scalability, and strict enterprise governance.

Relying on old stereotypes—like "Python is just for scripts" or ".NET is only for legacy Windows monoliths"—will lead to architectural malpractice. Both ecosystems have evolved dramatically over the last five years and offer unique strategic advantages in regulated environments.

This deep dive will unpack the architectural realities of Python and .NET tailored for BFSI and other regulated industries, exploring performance paradigms, maintainability, ecosystem gravity, and real-world scenarios to help you make the right choice for your specific project.

The Contenders at a Glance


Python: The Quantitative Juggernaut

Created by Guido van Rossum in 1991, Python’s design philosophy prioritizes code readability. It is dynamically typed, interpreted, and heavily relies on a massive open-source ecosystem. In recent years, Python has become the undisputed lingua franca of Artificial Intelligence (AI), Machine Learning (ML), quantitative finance (quant trading), and risk modeling.

Architectural Vibe: High velocity, exploratory, data-centric, and essential for algorithmic modeling.

.NET (Core): The Industrial Transaction Machine


Born from the ashes of the proprietary .NET Framework, Microsoft completely rewrote the platform as .NET Core in 2016. Today, it is open-source, cross-platform (running seamlessly on Linux), and engineered for raw performance. Powered primarily by C# (and F#), it offers strict static typing, advanced memory management, and world-class tooling designed for auditability and scale.

Architectural Vibe: Structured, predictable, highly scalable, auditable, and transaction-optimized.

Core Architectural Principles & Trade-offs for BFSI


When evaluating these two technologies, architects must look beyond syntax and examine how the runtime behaves under strict enterprise conditions.

A. Performance, Execution, and Latency


If your architectural principles prioritize raw CPU throughput, minimal latency (crucial for trading), and deterministic performance, the technical gap between the two is significant.

.NET is a compiled language leveraging a sophisticated Just-In-Time (JIT) compiler and, increasingly, Ahead-Of-Time (AOT) compilation. The underlying Kestrel web server consistently ranks near the top of industry benchmarks. .NET handles multithreading natively and elegantly, allowing you to maximize multi-core server utilization. When you need to process millions of payment transactions per second or execute high-frequency trades on minimal hardware, .NET is a tier-one choice. Its predictability under load makes it easier to guarantee Service Level Agreements (SLAs).

Python is an interpreted language, which inherently adds processing overhead. Furthermore, standard CPython is constrained by the Global Interpreter Lock (GIL), a mutex that prevents multiple native threads from executing Python bytecodes simultaneously. While Python achieves concurrency through asynchronous programming (asyncio) and multi-processing, it cannot match .NET in purely CPU-bound tasks or ultra-low latency scenarios.

The Architect's Nuance: Does raw compute speed matter for this specific microservice? For a High-Frequency Trading (HFT) execution engine or a core banking ledger processing millions of daily settlements, .NET’s performance advantage translates directly to competitive advantage and lower cloud hosting costs. However, if the application is heavily I/O-bound (e.g., pulling daily market data from external APIs) or involves running complex risk simulations overnight where execution takes hours anyway, the speed difference between Python and .NET execution times may be secondary to the speed of development.

B. Type Systems, Maintainability, and Auditability


The scale of your codebase, team size, and the strictness of regulatory audits should heavily influence your language choice.

Python’s dynamic typing is a massive accelerator during the initial phases of quantitative modeling or prototyping a new fraud detection algorithm. Developers and quants can move fast and iterate quickly. However, as a Python monolith grows within a bank, dynamic typing can become a liability. Refactoring becomes risky, and runtime errors can slip into production. To meet compliance standards, enterprise Python teams in BFSI must adopt strict linting, extensive unit testing, and type hints (mypy), essentially forcing Python to behave more like a statically typed language to pass technical audits.

.NET’s static typing via C# requires more upfront design and boilerplate. You must define your interfaces, classes, and data contracts explicitly. While this slows down day-one prototyping, it pays massive dividends on day one-hundred, especially in a regulated environment. The compiler catches a vast class of bugs before the code ever runs. Refactoring a massive .NET codebase is remarkably safe, supported by the deeply integrated intelligence of IDEs. For Domain-Driven Design (DDD)—essential for modeling complex banking products or insurance policies—.NET’s type system acts as a protective shield and naturally generates self-documenting, auditable code structures.

C. Ecosystem, Integration, and Security


The Python Ecosystem is unmatched in data science and quantitative analysis. If your architecture requires integrating Large Language Models (LLMs) for automated customer service, orchestrating complex data pipelines for anti-money laundering (AML) checks, or utilizing tools like Pandas and NumPy for pricing models, Python is the logical choice. The talent pool of quantitative analysts ("quants") speaks Python natively.

The .NET Ecosystem is deeply rooted in enterprise integration and security. It boasts flawless integration with Microsoft Azure, Active Directory (Entra ID)—often the backbone of corporate security in BFSI—and legacy corporate systems. The NuGet package manager is highly curated, making vulnerability scanning and compliance easier. Furthermore, .NET provides out-of-the-box, enterprise-grade security libraries for cryptography, identity management, and secure communication (gRPC), making it ideal for distributed microservices handling Personally Identifiable Information (PII) or Payment Card Industry (PCI) data.

Real-World Scenarios

To understand how these principles play out, let's examine common architectural patterns in Regulated Financial Services sector.

Scenario 1: The Core Banking Modernization (The .NET Stronghold)

The Challenge: A tier-1 retail bank needs to modernize its core banking ledger, moving from a monolithic mainframe to a cloud-native microservices architecture. The system must process millions of transactions daily, guarantee ACID properties across distributed databases, and maintain a rigorous audit trail for regulators.

The Architecture: The core transactional engine is built using .NET Core. Services handling account balances, fund transfers, and payment processing are designed using Domain-Driven Design (DDD) principles implemented in C#.

The Solution: The bank leverages .NET’s strict static typing to ensure that complex financial rules are enforced at compile time. They utilize gRPC for ultra-fast, strongly-typed internal communication between microservices. The predictable memory management and high throughput of the Kestrel server ensure that end-of-day batch processing and real-time payment SLAs are consistently met with a minimal cloud footprint.

The Takeaway: For the "system of record" where data integrity, auditability, and massive transactional throughput are non-negotiable, .NET provides the necessary industrial-grade scaffolding.

Scenario 2: Quantitative Trading and Risk Modeling (The Python Domain)

The Challenge: An asset management firm needs to develop a new algorithmic trading platform and a real-time risk simulation engine (e.g., calculating Value at Risk - VaR). The models require ingesting massive amounts of market data and utilizing advanced mathematical libraries.

The Architecture: The core quantitative models and data ingestion pipelines are built entirely in Python. Quants use libraries like Pandas, NumPy, and SciPy to develop and backtest trading strategies.

The Solution: The firm utilizes Python's massive data science ecosystem to accelerate the development of complex pricing models. To handle performance bottlenecks, they scale horizontally across cloud compute clusters, often wrapping critical performance-sensitive code in C or C++ (via Cython) while keeping the orchestration and logic in Python. They enforce strict CI/CD pipelines with mypy (type checking) to ensure the models are robust enough for production deployment.

The Takeaway: When the core business value lies in mathematical modeling, data science, and rapid algorithmic iteration, Python’s ecosystem and talent pool are unbeatable, even if it requires more effort to manage at scale.

The Decision Matrix: Choosing for Your Project


So, how do you decide? As an architect, base your decision on the specific bounded context of the service, not on a firm-wide language mandate. Here is a pragmatic decision matrix:

Choose Python If:

  • Quantitative Analysis and AI are Core: If the service is focused on risk modeling (VaR, credit scoring), algorithmic trading strategies, fraud detection using ML, or integrating GenAI for document processing, choose Python. The ecosystem advantage here is insurmountable.
  • The Team is Heavy on Quants/Data Scientists: Data scientists and quantitative analysts speak Python. If your engineering team needs to collaborate closely with them to productionize models, Python reduces the friction of translation.
  • Rapid Prototyping of Data Pipelines: For building out ETL (Extract, Transform, Load) pipelines to move regulatory data into data lakes, Python (often orchestrated by Airflow) is highly effective.

Choose .NET If:

  • Core Transaction Processing: For ledgers, payment gateways, trade execution engines (where latency matters), and policy administration systems.
  • Complex Domain Logic & Strict Auditability: If you are building a system that must rigorously enforce complex financial regulations or business rules, .NET’s strict typing, interfaces, and DDD capabilities create a more auditable and robust codebase.
  • Enterprise Security and Governance Priority: .NET’s deep integration with enterprise identity providers (Azure AD) and strong, curated foundational libraries make it easier to satisfy InfoSec and compliance teams out of the box.
  • High Throughput / Low Latency Requirements: If you are processing market data feeds in real-time or handling millions of concurrent API requests, .NET is vastly superior in resource utilization.

The Polyglot Reality: The Modern BFSI Architecture


In modern enterprise architecture, forcing a single language across the entire organization is an anti-pattern. The most successful BFSI organizations embrace a Polyglot Architecture, selecting the right tool for the specific bounded context.

A highly effective, modern architecture in a regulated environment looks like this:
 
  • The Transactional Core (.NET): Use .NET for your API gateways, identity servers, payment processing, core ledgers, and high-throughput transactional microservices. .NET handles the heavy lifting, concurrency, strict data contracts, and core business rules.
  • The Intelligence and Risk Layer (Python): Use Python for asynchronous workers calculating risk metrics, fraud detection models, recommendation engines for wealth management, and AI integrations.
  • The Bridge (gRPC/Kafka): Connect the .NET transactional core and the Python intelligence layer using high-performance protocols like gRPC (with strict Protobuf contracts) or enterprise event streams like Apache Kafka.

By adopting containerization (Docker) and orchestration (Kubernetes), your infrastructure team doesn't need to care what language a service is written in, provided it meets the firm's strict security and observability standards.

Conclusion


The debate between Python and .NET in regulated industries is not a battle to find a singular winner; it is a search for architectural alignment.

Python trades raw compute efficiency and strict compile-time safety for unparalleled agility in modeling and absolute dominance in the data and quant space. .NET trades the dynamic flexibility of scripting for industrial-grade performance, rigorous maintainability, and unmatched transactional throughput required by regulators.

As an architect in BFSI, your job is to assess the terrain. If you are building the brains of a smart, data-driven risk model, Python is your best friend. If you are building the highly reliable, high-speed nervous system that processes the firm's capital, .NET is your engine. Choose wisely, build defensively, and seamlessly integrate the two to build a truly modern, compliant enterprise architecture.