AI Evaluation & Governance Advisory

I help organisations evaluate, govern and remain accountable for generative and agentic AI systems in real-world use.

Helping organisations evaluate, govern, and ethically deploy generative AI

My work focuses on how AI systems behave across prompts, tools, workflows, institutional settings and human judgement. I help teams move beyond broad AI principles toward practical evaluation, oversight and accountability.

I offer public speaking, training, advisory, and writing services at the intersection of philosophy, measurement theory, and AI ethics, especially for generative systems. My work helps organisations build capacity, strengthen oversight, and embed ethical practice into AI development and deployment.

AI evaluation design
Designing ways to assess how AI systems behave in deployment, not just benchmark tasks or isolated outputs. This includes prompt sensitivity, workflow behaviour, benchmark limitations and real-world evaluation methods.

AI governance and accountability
Mapping where judgement, responsibility and accountability move when AI enters organisational processes. This includes prompts, tools, retrieval, memory, interface defaults, evaluation metrics and human oversight.

Agentic AI risk
Helping organisations prepare for systems that retrieve, route, act, remember and trigger downstream consequences. This includes governance for tools, memory, permissions, logging, escalation and intervention points.

Executive briefings and workshops
Clear, senior-level briefings for leadership teams, boards, policy teams and professional audiences on generative AI, agentic AI, evaluation and governance.

Rare evaluation expertise
I have developed new approaches to AI evaluation and critically examined the limitations of widely used benchmarks.

Research and practice
My work combines doctoral research, Google Research experience, public policy engagement, media commentary and practitioner-facing advisory.

Systems-level perspective
I do not treat the model as the whole governance object. I look at the deployed configuration: model, prompts, tools, memory, retrieval, workflows, oversight and institutional context.

Clear translation
I help organisations understand complex AI issues without losing technical, ethical or governance depth.

In April 2026, I delivered an AI governance briefing for Maddocks on Australia’s National AI Plan, legal practice, agentic AI risk and evaluative infrastructure.

The session focused on a central governance challenge: AI systems are no longer only producing outputs. They are entering workflows, shaping judgement and creating new accountability demands.

Alongside advisory work, I am developing RAIR (Responsible AI Researchers) — a human-led, expert-driven system for evaluating and matching Responsible AI expertise to organisational needs.

View RAIR: https://rairconsulting.com/


  1. Contact me with your organisational context and the issue you are trying to solve.
  2. I will suggest a suitable format: briefing, workshop, advisory session, review or written report.
  3. We agree scope, timeline and deliverables.

For speaking, advisory or workshop enquiries, use the contact form below

← Back

Thank you for your response. ✨

Thank you for connecting with me. I will get back in touch as soon as possible. If you have a more urgent request you may contact me through the University of Sydney, School of History and Philosophy of Science. Have a wonderful day! Rebecca