Contract Monitoring and Evaluation of GenAI Technology

Contracts for the purchase of, or that include, GenAI may include unique, contract-specific requirements to ensure the State is adequately protected.

Contract Managers shall continuously monitor, assess, and validate GenAI contract deliverables for equitable outcomes, output inaccuracies, fabricated content, hallucinations, biases, and the need for human action for all decision-making processes, to ensure applicable state laws and policies are followed. State entities shall assign a GenAI subject matter expert to assist contract managers with assessing and validating contract deliverables.

Any contract that received a GenAI CDT consultation, and requires an amendment, must be re-evaluated. Any addition or modifications of GenAI technology by a vendor after contract award must be reported to the state entity CIO to complete a risk assessment prior to execution.

As a reminder it is a best practice for your state entity to continually engage with the communities you serve as you build out your program’s service delivery post-procurement. Surveys, user research, and focus groups may be useful ways to ask the Californians you serve how the GenAI updates to your program are useful to them – and how they think it could be improved.

State entities are also required to continuously engage with the state workforce on impacts to how work is performed.