SR-UW-0764 FLAG
On 2026-10-17, rx-score v3 (a third-party system from RxData Labs (fictional)) produced 'rate' in a CO life underwriting transaction. Inputs included rx history, credit, consumer report, application data. External consumer data and information sources were present. A consumer report was used. No human reviewed the output before it took effect. The outcome was adverse to the consumer; a notice was sent on 2026-10-22 with reasons stated. RegBench applied 10 rule(s) in force on 2026-10-17 and recorded 5 finding(s); the most serious is 'Adverse outcome from an ECDIS-driven model with no unfair-discrimination testing on record' (high, L2).
FLAG: 5 finding(s) under rules 2026.10+dbe5ddf6, corpus 2026-10-30-5f07c521. Routed to the carrier's compliance reviewer with cited findings.
Findings (5)
Adverse outcome from an ECDIS-driven model with no unfair-discrimination testing on record
Finding. External consumer data and information sources drove an adverse outcome, and the transaction references no testing showing the model does not unfairly discriminate.
Basis. C.R.S. § 10-3-1104.9 prohibits using ECDIS, algorithms or predictive models in a way that unfairly discriminates on the listed characteristics and directs the Commissioner's rules to establish how an insurer demonstrates it has tested for that; the Division's quantitative testing standards remain under development, so the finding asks for the insurer's own testing record.
Required action. Attach the system's unfair-discrimination testing report reference; route the outcome to compliance review.
Excerpt: co-crs-10-3-1104-9 · state statute (government edict) · in force from 2021-09-07
"[A]n insurer shall not, with regard to any insurance practice: (a) Unfairly discriminate based on race, color, national or ethnic origin, religion, sex, sexual orientation, disability, gender identity, or gender expression; or (b) [use any external consumer data and information source, algorithm or predictive model in a way that unfairly discriminates, as defined by rules adopted by the commissioner]." Subsection (3)(a) directs the commissioner to "adopt rules for specific types of insurance, by insurance practice" establishing means by which an insurer "may demonstrate, to the extent practicable, that it has tested whether its use" of such sources or models unfairly discriminates; subsection (3)(b) requires insurers to "establish and maintain a risk management framework or similar processes or procedures" and to "provide an attestation by one or more officers that the insurer has implemented the risk management framework". Subsection (8) defines an external consumer data and information source as "a data or an information source that is used by an insurer to supplement traditional underwriting" and defines unfair discrimination to include use that "results in a disproportionately negative outcome for such classification or classifications" beyond what is justified.
ECDIS used outside an attested governance and risk management framework (amended Regulation 10-1-1)
Finding. The decision used external consumer data and information sources, or a model built on them, in a line the amended regulation covers (individually issued life, private passenger auto, health benefit plans), and the system is not attested as covered by the governance and risk management framework.
Basis. Regulation 10-1-1 § 5.A, as amended effective 15 October 2025, requires covered insurers using ECDIS to establish a risk-based framework with documented governing principles, board oversight, senior management accountability, a cross-functional governance group, an up-to-date inventory with version control, documented testing and monitoring, vendor selection and annual reviews; § 6 requires an annual officer-attested compliance report.
Required action. Add the system to the Regulation 10-1-1 inventory, attest framework coverage, and include it in the next annual report filed through SERFF.
Excerpt: co-reg-10-1-1-s5 · state regulation (government edict) · in force from 2025-10-15
Applies to insurers offering individually issued life insurance, private passenger automobile insurance and health benefit plans. "Insurers ... that use ECDIS, as well as algorithms and predictive models that use ECDIS in any insurance practice, must establish a risk-based governance and risk management framework that facilitates and supports policies, procedures, systems, and controls designed to determine whether the use of such ECDIS, algorithms, and predictive models potentially result in unfair discrimination with respect to race and remediate unfair discrimination, if detected through quantitative testing requirements established by the Division." Required components include documented governing principles (1), board or board-committee oversight (2), senior management accountability with "regular reporting to senior management on the performance and potential risks" (3), a documented cross-functional governance group (4), for health plans a provider "ultimately responsible for the decisions" when ECDIS-based tools inform denials or modifications (5), documented policies and procedures (6), complaint and inquiry processes (7), risk assessment (8), a "documented up-to-date inventory, including version control" (9), explanation of material inventory changes (10), a "documented description of quantitative testing conducted pursuant to requirements established by the Division" (11), ongoing performance monitoring "accounting for model drift" (12), documented vendor selection (13) and annual reviews (14).
Excerpt: co-reg-10-1-1-s6 · state regulation (government edict) · in force from 2025-10-15
Insurers using ECDIS must submit a narrative progress report (life: 1 June 2024; private passenger auto and health: 1 December 2025) and, annually, "a report summarizing compliance with the requirements in Section 5 and the title and qualifications of each individual responsible for ensuring compliance" (life: 1 December 2024 and annually; auto and health: 1 July 2026 and annually), signed by an officer attesting to compliance, filed through SERFF; insurers not using ECDIS file an officer attestation to that effect.
Third-party ECDIS model without documentation of purpose, inputs and vendor oversight
Finding. A third-party model that consumes ECDIS produced the decision, and the transaction carries no reference to documentation of the model's purpose, inputs and vendor oversight.
Basis. Regulation 10-1-1 § 5.A.9 requires a documented up-to-date inventory with version control and a description and purpose for each ECDIS, algorithm and model; § 5.B keeps the insurer responsible for vendor-supplied models and requires documented vendor selection and oversight.
Required action. Record the vendor model's documentation reference in the inventory and the vendor oversight record.
Excerpt: co-reg-10-1-1-s5 · state regulation (government edict) · in force from 2025-10-15
Applies to insurers offering individually issued life insurance, private passenger automobile insurance and health benefit plans. "Insurers ... that use ECDIS, as well as algorithms and predictive models that use ECDIS in any insurance practice, must establish a risk-based governance and risk management framework that facilitates and supports policies, procedures, systems, and controls designed to determine whether the use of such ECDIS, algorithms, and predictive models potentially result in unfair discrimination with respect to race and remediate unfair discrimination, if detected through quantitative testing requirements established by the Division." Required components include documented governing principles (1), board or board-committee oversight (2), senior management accountability with "regular reporting to senior management on the performance and potential risks" (3), a documented cross-functional governance group (4), for health plans a provider "ultimately responsible for the decisions" when ECDIS-based tools inform denials or modifications (5), documented policies and procedures (6), complaint and inquiry processes (7), risk assessment (8), a "documented up-to-date inventory, including version control" (9), explanation of material inventory changes (10), a "documented description of quantitative testing conducted pursuant to requirements established by the Division" (11), ongoing performance monitoring "accounting for model drift" (12), documented vendor selection (13) and annual reviews (14).
Excerpt: co-reg-10-1-1-s5-b-vendors · state regulation (government edict) · in force from 2025-10-15
The insurer remains responsible for the ECDIS, algorithms and predictive models it obtains from vendors or other external resources, must document its vendor selection and oversight, and vendors may produce documents directly to the Division (summary of § 5.B).
Adverse outcome from a high-risk AI system with no human review
Finding. A high-risk system produced an adverse outcome that took effect without human review.
Basis. Doctrine: examiners applying the NAIC bulletin's governance and control expectations, and the AI Risk Evaluation Supplement's Exhibit B question on whether there is a human in the loop for direct-consumer-impact uses, ask first about human oversight of adverse automated outcomes; an unreviewed adverse decision is the case file most likely to be sampled.
Required action. Route to the carrier's reviewer; record the review and any override on the transaction.
Excerpt: naic-ai-bulletin-s3-1-ais-program · NAIC model guidance; binding in a state only as adopted (see adoptions register) · in force from 2023-12-04
"all Insurers authorized to do business in this state are expected to develop, implement, and maintain a written program (an 'AIS Program') for the responsible use of AI Systems that make, or support decisions related to regulated insurance practices. The AIS Program should be designed to mitigate the risk of Adverse Consumer Outcomes ... The Department also encourages the development and use of verification and testing methods to identify errors and bias in Predictive Models and AI Systems, as well as the potential for unfair discrimination in the decisions and outcomes resulting from the use of Predictive Models and AI Systems."
ECDIS model with no documented testing or performance monitoring reference
Finding. The decision used an ECDIS-driven model for which the transaction references no documented testing or ongoing performance monitoring.
Basis. Regulation 10-1-1 § 5.A.11 requires a documented description of quantitative testing conducted pursuant to the Division's requirements (which remain under development) and § 5.A.12 requires ongoing performance monitoring accounting for model drift.
Required action. Record the testing and monitoring documentation reference for the model.
Excerpt: co-reg-10-1-1-s5 · state regulation (government edict) · in force from 2025-10-15
Applies to insurers offering individually issued life insurance, private passenger automobile insurance and health benefit plans. "Insurers ... that use ECDIS, as well as algorithms and predictive models that use ECDIS in any insurance practice, must establish a risk-based governance and risk management framework that facilitates and supports policies, procedures, systems, and controls designed to determine whether the use of such ECDIS, algorithms, and predictive models potentially result in unfair discrimination with respect to race and remediate unfair discrimination, if detected through quantitative testing requirements established by the Division." Required components include documented governing principles (1), board or board-committee oversight (2), senior management accountability with "regular reporting to senior management on the performance and potential risks" (3), a documented cross-functional governance group (4), for health plans a provider "ultimately responsible for the decisions" when ECDIS-based tools inform denials or modifications (5), documented policies and procedures (6), complaint and inquiry processes (7), risk assessment (8), a "documented up-to-date inventory, including version control" (9), explanation of material inventory changes (10), a "documented description of quantitative testing conducted pursuant to requirements established by the Division" (11), ongoing performance monitoring "accounting for model drift" (12), documented vendor selection (13) and annual reviews (14).
Point in time
- Law as of
- 2026-10-17
- Rules version
- 2026.10+dbe5ddf6
- Corpus snapshot
- 2026-10-30-5f07c521
- Engine
- regbench-engine/0.4.0 · deterministic-1
- Fingerprint
- bd38f6a0266eb04bd48566a1
- Evaluated
- 2026-10-30 11:23:24 UTC
- Exhibit C case file
- yes
Ledger
- Entry
- #764 · assessment · recorded 2026-10-17T08:20:41+00:00
- Hash
- 4a8ca0f6ac6fd3bea2979fb92b873f867078bce6af2bf652302ea743938c8a4a
- Previous
- cc0fe49acc64fed4a19787fcfd872ca5aa4affdc931f6a652b615700ad602679
- Stored copy intact
- yes, hashes match
Carrier review
Resolved by underwriter · outcome escalated · 54.8 hours after it opened · Resolved in the carrier's review queue (synthetic).
Recorded facts
- AI system
- rx-score v3 · third party (RxData Labs (fictional)) · high-risk class: underwriting
- Governance attested
- False
- Testing report
- none recorded
- Model documentation
- none recorded
- Feature classes
- rx_history, credit, consumer_report, application_data
- Protected factors used
- none
- External data (ECDIS)
- True
- Consumer report / credit
- True / True
- Data sources
- vendor://rxdata/score, cra://demo-bureau/attributes
- Decision
- rate · score 0.65 · premium +15.3%
- Human review
- none
- Adverse to consumer
- True
- Notice
- sent 2026-10-22 · reasons: True · specific: False · external data disclosed: False
- Appeal channel
- –
- Consumer token
- tok_361d92dcfd
