Constarium
← Search

Data · dataset · 2026

BEFORE AUTONOMY: Earning the Right to Act

Listed in ZivaHub and Deakin Research Online and DMU Figshare — shown once because both records carry DOI 10.6084/m9.figshare.34032459.v1

<p dir="ltr">This book argues for a simple engineering principle: a system should not receive more freedom to act than we have the independent ability to verify, constrain, and stop.

Description

Five ideas carry the argument. 1. Safety Must Be Designed Before Capability Growth Boundaries, stop mechanisms, verification criteria, and rules for expanding authority must exist before the system receives the corresponding freedom. “We’ll patch it later” does not work when the consequences may be irreversible. 2.

A Claim Is Not Evidence Neither a developer’s statement (“we checked everything”) nor the system’s own statement (“I am safe”) constitutes engineering evidence. Trust must rest on checks that can be independently repeated, challenged, and traced to evidence. 3. Freedom Grows in Steps, Alongside Verifiability Autonomy is not a switch.

Read the rest (5 more)

It is a set of distinct authorities that can be granted, limited, or withdrawn. Each increase in authority requires its own evidentiary basis. As independent action becomes more consequential, verification must grow with it.

If verification falls, granted freedom must fall with it. 4. No Self-Authorization—and No Safety Only from the Outside The system must not decide for itself when the evidence is sufficient to receive more authority. But safety cannot consist only of an external fence around an otherwise unrestricted capability.

Control must also be built into the architecture and preserved as capabilities change. The goal is not to keep a system below some fixed level of intelligence. It is to ensure that control properties do not disappear as capability increases. 5.

Unknowns Must Remain Visible The absence of an observed failure does not prove the absence of failure. An unassessed item is not a pass. Every safety claim has boundaries: configuration, conditions, scope, evidence, and validity period.

What remains unknown must remain visible—and must not silently turn into authorization. In short: capability is not authority, authority is not operation, and a successful test is not a permanent guarantee.</p>

Links

Where it is published

Catalogue records · 1

Topics

Provenance · 3 source records, 35 field assertions
SourceKeyLast seenRaw
ZivaHuboai:figshare.com:article/340324595 d agoJSON v1
Deakin Research Onlineoai:figshare.com:article/340324595 d agoJSON v1
DMU Figshareoai:figshare.com:article/340324595 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0
concepts[field].anzsrc:field:460201mapping · dro deakin edu auvocabulary-mapper@1.0.0keywords['Artificial life and complex adaptive systems']
concepts[field].anzsrc:field:460201mapping · figshare dmu ac ukvocabulary-mapper@1.0.0keywords['Artificial life and complex adaptive systems']
concepts[field].anzsrc:field:460201mapping · zivahub uct ac zavocabulary-mapper@1.0.0keywords['Artificial life and complex adaptive systems']
concepts[field].anzsrc:field:460202mapping · figshare dmu ac ukvocabulary-mapper@1.0.0keywords['Autonomous agents and multiagent systems']
concepts[field].anzsrc:field:460202mapping · dro deakin edu auvocabulary-mapper@1.0.0keywords['Autonomous agents and multiagent systems']
concepts[field].anzsrc:field:460202mapping · zivahub uct ac zavocabulary-mapper@1.0.0keywords['Autonomous agents and multiagent systems']
concepts[field].anzsrc:field:460203mapping · zivahub uct ac zavocabulary-mapper@1.0.0keywords['Evolutionary computation']
concepts[field].anzsrc:field:460203mapping · figshare dmu ac ukvocabulary-mapper@1.0.0keywords['Evolutionary computation']
concepts[field].anzsrc:field:460203mapping · dro deakin edu auvocabulary-mapper@1.0.0keywords['Evolutionary computation']
concepts[field].anzsrc:field:460206mapping · figshare dmu ac ukvocabulary-mapper@1.0.0keywords['Knowledge representation and reasoning']
concepts[field].anzsrc:field:460206mapping · dro deakin edu auvocabulary-mapper@1.0.0keywords['Knowledge representation and reasoning']
concepts[field].anzsrc:field:460206mapping · zivahub uct ac zavocabulary-mapper@1.0.0keywords['Knowledge representation and reasoning']
concepts[field].anzsrc:field:460207mapping · zivahub uct ac zavocabulary-mapper@1.0.0keywords['Modelling and simulation']
concepts[field].anzsrc:field:460207mapping · dro deakin edu auvocabulary-mapper@1.0.0keywords['Modelling and simulation']
concepts[field].anzsrc:field:460207mapping · figshare dmu ac ukvocabulary-mapper@1.0.0keywords['Modelling and simulation']
concepts[field].anzsrc:field:460209mapping · figshare dmu ac ukvocabulary-mapper@1.0.0keywords['Planning and decision making']
concepts[field].anzsrc:field:460209mapping · zivahub uct ac zavocabulary-mapper@1.0.0keywords['Planning and decision making']
concepts[field].anzsrc:field:460209mapping · dro deakin edu auvocabulary-mapper@1.0.0keywords['Planning and decision making']
concepts[field].anzsrc:field:460210mapping · figshare dmu ac ukvocabulary-mapper@1.0.0keywords['Satisfiability and optimisation']
concepts[field].anzsrc:field:460210mapping · zivahub uct ac zavocabulary-mapper@1.0.0keywords['Satisfiability and optimisation']
concepts[field].anzsrc:field:460210mapping · dro deakin edu auvocabulary-mapper@1.0.0keywords['Satisfiability and optimisation']
concepts[field].local:field:computer-science-aimapping · figshare dmu ac ukconnector:figshare_dmu_ac_uk@1.0.0
concepts[field].local:field:computer-science-aimapping · dro deakin edu auconnector:dro_deakin_edu_au@1.0.0
concepts[field].local:field:computer-science-aimapping · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0
concepts[field].local:field:earth-environmentalmapping · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0
concepts[field].local:field:earth-environmentalmapping · dro deakin edu auconnector:dro_deakin_edu_au@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare dmu ac ukconnector:figshare_dmu_ac_uk@1.0.0
concepts[field].local:field:engineeringmapping · dro deakin edu auconnector:dro_deakin_edu_au@1.0.0
concepts[field].local:field:engineeringmapping · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0
concepts[field].local:field:engineeringmapping · figshare dmu ac ukconnector:figshare_dmu_ac_uk@1.0.0
descriptionsource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0/metadata/dc/description
licensesource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0/metadata/dc/rights
publication_datesource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0
titlesource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0/metadata/dc/title