How to Run the Periodic Review of Automated Tools the IT Rules Require

The obligation to deploy automated tools comes with an obligation to look at them. The periodic review of automated tools required by the provisos to sub-rule (4) of rule 4 of the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021 has three stated criteria, and a review built around anything else does not answer the provision.
Step 1: Confirm the Duty Applies and to What
The second proviso binds the same entity as the sub-rule, a significant social media intermediary, and attaches to the measures deployed under that sub-rule. It requires that intermediary to implement mechanisms for appropriate human oversight of those measures, including a periodic review of any automated tools deployed by it.
So the first task is to list what has actually been deployed under the sub-rule, as distinct from everything else a large service runs. A tool that identifies information in the categories the sub-rule names is in scope. A tool deployed for some other purpose is not, and sweeping it in makes the review longer without making it responsive.
Step 2: Take the Agenda From the Third Proviso
The third proviso states what the review shall evaluate. It requires the automated tools to be evaluated having regard to the accuracy and fairness of such tools, the propensity of bias and discrimination in such tools, and the impact on privacy and security of such tools.
Those three heads are the agenda. A review organised around a vendor's own reporting, or around whatever the tool happens to measure, may be useful internally and still leave the provision unanswered. Head the document with the three and answer each separately.
Step 3: Measure Accuracy Against Something Fixed
Accuracy is only meaningful against a reference. Assemble a set of material whose correct treatment has been settled by people rather than by the tool, including material that should be identified and material that should not, and run the tool against it.
Record both directions of error. What the tool failed to identify and what it identified wrongly are different problems with different consequences, and a single headline figure hides the one that matters on any given day.
Step 4: Treat Fairness as a Separate Question
Fairness is listed alongside accuracy rather than inside it, which suggests they are not the same enquiry. A tool can be accurate overall and still behave differently across categories of material, language or speaker.
The practical form of the question is whether the error rates found at step three are evenly distributed. Where they are not, the review should say so plainly rather than report the aggregate and move on.
Step 5: Read the Word Propensity Carefully
The proviso asks about the propensity of bias and discrimination in the tools. Propensity is a tendency, not a tally. A review that counts complaints received is measuring something else, and a tool with no complaints against it may still have the tendency the provision is directed at.
Answering it means looking at how the tool was built and on what material, what it treats as a match, and where its design makes a particular kind of error more likely. That is a question about the tool rather than about its output log.
Step 6: Deal With Privacy and Security of the Tools
The third head is the impact on privacy and security of such tools. Note that the words point at the tools, so the question is what deploying them does, not whether the service as a whole is secure.
The reviewable facts are what the tool reads, what it retains after it has read it, where that material goes, who can reach the results, and what happens to all of it when a tool is replaced. Where a third party supplies or hosts the tool, say so in the review rather than leaving it to be inferred.
Step 7: Carry the First Proviso Into the Review
The first proviso requires the measures taken under the sub-rule to be proportionate having regard to the interests of free speech and expression and the privacy of users on the computer resource of that intermediary, including interests protected through the appropriate use of technical measures.
Proportionality is not one of the three heads, but it is the standard the measures themselves must meet, so a review that establishes what the tool does and never asks whether that is proportionate stops one step short. The honest form of the question is what the tool costs in speech and in privacy and whether a narrower configuration would do the same work.
Step 8: Make the Oversight a Mechanism, Not an Intention
The second proviso speaks of mechanisms for appropriate human oversight, implemented. A named person with no standing instruction, no interval and no power to change a setting is not a mechanism.
What makes it one is identifiable: who reviews, at what interval, on what material, with authority to do what, and reporting to whom. If the answer to the last of those is nobody, the review has no consequence and the oversight is nominal.
Step 9: Test the Notice the Sub-Rule Requires
The sub-rule requires a notice to be displayed to any user attempting to access information the intermediary has identified, stating that it has been identified under the categories referred to in the sub-rule. That is part of the deployed measure.
So the review should establish that the notice is in fact displayed, and displayed in those terms. A tool that identifies correctly behind a page that says nothing is a partial compliance that a review is well placed to catch and nobody else is.
Step 10: Write It So It Can Be Produced
Date the review, name the tools and versions examined, set out the material used, state the findings under each of the three heads, and record what was changed as a result and what was not and why.
A review exists to be relied on later, which means by someone who was not present when it was done. If it cannot be read on its own, it will not do that work.
Common Pitfalls to Avoid
Reviewing the wrong things: the proviso attaches to the automated tools deployed under the sub-rule, not to everything the service runs.
Letting the tool set the agenda: accuracy and fairness, propensity of bias and discrimination, and impact on privacy and security are the three heads stated.
Reporting one accuracy figure: what was missed and what was wrongly identified are separate findings.
Folding fairness into accuracy: the proviso lists them separately, which points to two enquiries.
Counting incidents instead of propensity: propensity is a tendency in the tool, and an empty complaint log does not answer it.
Answering privacy at the level of the service: the words point at the impact of the tools, so the subject is what the tools read, retain and transmit.
Leaving oversight as a name on a chart: a mechanism has an interval, a scope and the authority to change something.
Key Statutory Provisions
Second proviso to sub-rule (4) of rule 4 of the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021: such intermediary shall implement mechanisms for appropriate human oversight of measures deployed under that sub-rule, including a periodic review of any automated tools deployed by such intermediary.
Third proviso to the same sub-rule: the review of automated tools under that sub-rule shall evaluate the automated tools having regard to the accuracy and fairness of such tools, the propensity of bias and discrimination in such tools and the impact on privacy and security of such tools.
First proviso to the same sub-rule: the measures taken by the intermediary under that sub-rule shall be proportionate having regard to the interests of free speech and expression, privacy of users on the computer resource of such intermediary, including interests protected through the appropriate use of technical measures. No rule prescribing how the review is to be conducted was opened for this note, and none is assumed to exist.
Sources and References
The Rules as printed by the issuing authority, updated as on 10 February 2026
Independent printing of rule 4 carrying the same three provisos
Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021
Disclaimer: This article is for informational purposes only and does not constitute legal advice. Readers should consult a qualified legal professional for advice specific to their circumstances.



Comments