Safe by design, or risky by design?
Learn to tell the difference through real examples and what to ask from decision-makers
So how do experts actually explain Safety by Design in one sentence?
Safety by Design puts user safety and rights at the center of the design and development of online products and services.
That means that online products and services can be safe by design… or they can be risky by design.
Remember: online risks go beyond harmful content.
Online risks go beyond harmful content.
Using the 4C framework, match each feature to the risk it creates for children.
(You see, content is only one of them…)
Feature in an online product or service
Type of risk
A group messaging feature makes it easy to circulate a child's private images without their permission.
{{r0.status}}
A game pressures children to make in-app purchases through countdown timers and rewards.
{{r1.status}}
A recommendation system repeatedly exposes a child to content promoting self-harm.
{{r2.status}}
A platform allows unknown adults to send private messages to children by default.
{{r3.status}}
{{fbText}}
What does each risk look like for a child?
In Safety by Design, which comes first: prevention or cure?
Safety by Design follows the principle of hierarchy of control: prevent harm first, respond to it second.
Notice the difference between the two approaches in this example:
Rather than relying only on children to report unwanted messages, a platform can restrict unsolicited contact from unknown adults by default.
In practice, Safety by Design means prioritizing prevention over responding to harm after it occurs.
-
Eliminate risks: design out hazards wherever possible.
-
Manage and mitigate risks: where risks cannot be eliminated, reduce their likelihood and severity.
-
Provide remedies: when harm occurs, ensure accessible reporting, support and redress.
Hierarchy of control means Safety is built in, not added later.
A platform has every safety feature. Could children still be at risk?
Unfortunately they could. Why?
Because a safety button isn’t enough if the algorithm works against it.
Product entirety means safety must be considered across all aspects of a digital service, not just what users see. This includes algorithms, data collection, default settings, business models and how companies make money.
Notice what looks safe on the surface and what isn’t:
Product entirety means safety covers the whole service, not just the visible parts.
Which stages of a product’s life does Safety by Design cover?
Stretch or shorten the arrow to show the stages it covers.
{{lcFbTitle}}
Safety by Design applies to the entire product lifecycle.
That means safety must be considered throughout a product’s life, from initial design and development to launch, operation, updates and eventual closure. Risks change as technologies evolve, new features are introduced and children use services in unexpected ways.
For instance, before introducing an AI chatbot, a company should assess potential risks to children, test safeguards and continue monitoring the system after launch.
In other words, safety is an ongoing responsibility, not a one-off check.
What policy instruments can help put Safety by Design into practice?
Safety by Design should not depend solely on voluntary commitments. Governments and regulators can establish requirements that make companies responsible for preventing and mitigating risks.
Two examples of policy instruments are:
Child Rights Impact Assessments (CRIAs): they require companies to identify, assess and address how their products and services affect children’s rights.
Pre-certification or pre-market assessments: they require certain products or features to demonstrate that they meet defined safety requirements before being made available.
Picture this: a company launching a new social media feature could be required to assess its potential impact on children and demonstrate how identified risks have been addressed before release.
You like the idea? Children love it too.
‘We can't expect a seven-year-old to outwit a system designed by a thousand PhDs to be addictive’
Children can tell us what feels unsafe. It’s up to adults to design it out. Let’s see how you would do that.
Article completed
Up next
PracticeStep 3 of 5 of your FEED