Regulatory Assessment

SR-UW-0764 FLAG

CO · life · underwriting · decided 2026-10-17 08:19 UTC · Summit Range Life Assurance Company (fictional)

On 2026-10-17, rx-score v3 (a third-party system from RxData Labs (fictional)) produced 'rate' in a CO life underwriting transaction. Inputs included rx history, credit, consumer report, application data. External consumer data and information sources were present. A consumer report was used. No human reviewed the output before it took effect. The outcome was adverse to the consumer; a notice was sent on 2026-10-22 with reasons stated. RegBench applied 10 rule(s) in force on 2026-10-17 and recorded 5 finding(s); the most serious is 'Adverse outcome from an ECDIS-driven model with no unfair-discrimination testing on record' (high, L2).

FLAG: 5 finding(s) under rules 2026.10+dbe5ddf6, corpus 2026-10-30-5f07c521. Routed to the carrier's compliance reviewer with cited findings.

Findings (5)

high L2 black letter flag exhibit C co.sb169.ecdis-adverse-untested

Adverse outcome from an ECDIS-driven model with no unfair-discrimination testing on record

Finding. External consumer data and information sources drove an adverse outcome, and the transaction references no testing showing the model does not unfairly discriminate.

Basis. C.R.S. § 10-3-1104.9 prohibits using ECDIS, algorithms or predictive models in a way that unfairly discriminates on the listed characteristics and directs the Commissioner's rules to establish how an insurer demonstrates it has tested for that; the Division's quantitative testing standards remain under development, so the finding asks for the insurer's own testing record.

Required action. Attach the system's unfair-discrimination testing report reference; route the outcome to compliance review.

Excerpt: co-crs-10-3-1104-9 · state statute (government edict) · in force from 2021-09-07

"[A]n insurer shall not, with regard to any insurance practice: (a) Unfairly discriminate based on race, color, national or ethnic origin, religion, sex, sexual orientation, disability, gender identity, or gender expression; or (b) [use any external consumer data and information source, algorithm or predictive model in a way that unfairly discriminates, as defined by rules adopted by the commissioner]." Subsection (3)(a) directs the commissioner to "adopt rules for specific types of insurance, by insurance practice" establishing means by which an insurer "may demonstrate, to the extent practicable, that it has tested whether its use" of such sources or models unfairly discriminates; subsection (3)(b) requires insurers to "establish and maintain a risk management framework or similar processes or procedures" and to "provide an attestation by one or more officers that the insurer has implemented the risk management framework". Subsection (8) defines an external consumer data and information source as "a data or an information source that is used by an insurer to supplement traditional underwriting" and defines unfair discrimination to include use that "results in a disproportionately negative outcome for such classification or classifications" beyond what is justified.

medium L3 black letter flag exhibit A, B co.reg-10-1-1.governance-framework-amended

ECDIS used outside an attested governance and risk management framework (amended Regulation 10-1-1)

Finding. The decision used external consumer data and information sources, or a model built on them, in a line the amended regulation covers (individually issued life, private passenger auto, health benefit plans), and the system is not attested as covered by the governance and risk management framework.

Basis. Regulation 10-1-1 § 5.A, as amended effective 15 October 2025, requires covered insurers using ECDIS to establish a risk-based framework with documented governing principles, board oversight, senior management accountability, a cross-functional governance group, an up-to-date inventory with version control, documented testing and monitoring, vendor selection and annual reviews; § 6 requires an annual officer-attested compliance report.

Required action. Add the system to the Regulation 10-1-1 inventory, attest framework coverage, and include it in the next annual report filed through SERFF.

Excerpt: co-reg-10-1-1-s5 · state regulation (government edict) · in force from 2025-10-15

Applies to insurers offering individually issued life insurance, private passenger automobile insurance and health benefit plans. "Insurers ... that use ECDIS, as well as algorithms and predictive models that use ECDIS in any insurance practice, must establish a risk-based governance and risk management framework that facilitates and supports policies, procedures, systems, and controls designed to determine whether the use of such ECDIS, algorithms, and predictive models potentially result in unfair discrimination with respect to race and remediate unfair discrimination, if detected through quantitative testing requirements established by the Division." Required components include documented governing principles (1), board or board-committee oversight (2), senior management accountability with "regular reporting to senior management on the performance and potential risks" (3), a documented cross-functional governance group (4), for health plans a provider "ultimately responsible for the decisions" when ECDIS-based tools inform denials or modifications (5), documented policies and procedures (6), complaint and inquiry processes (7), risk assessment (8), a "documented up-to-date inventory, including version control" (9), explanation of material inventory changes (10), a "documented description of quantitative testing conducted pursuant to requirements established by the Division" (11), ongoing performance monitoring "accounting for model drift" (12), documented vendor selection (13) and annual reviews (14).

Excerpt: co-reg-10-1-1-s6 · state regulation (government edict) · in force from 2025-10-15

Insurers using ECDIS must submit a narrative progress report (life: 1 June 2024; private passenger auto and health: 1 December 2025) and, annually, "a report summarizing compliance with the requirements in Section 5 and the title and qualifications of each individual responsible for ensuring compliance" (life: 1 December 2024 and annually; auto and health: 1 July 2026 and annually), signed by an officer attesting to compliance, filed through SERFF; insurers not using ECDIS file an officer attestation to that effect.

medium L3 black letter flag exhibit A, D co.reg-10-1-1.vendor-ecdis-documentation

Third-party ECDIS model without documentation of purpose, inputs and vendor oversight

Finding. A third-party model that consumes ECDIS produced the decision, and the transaction carries no reference to documentation of the model's purpose, inputs and vendor oversight.

Basis. Regulation 10-1-1 § 5.A.9 requires a documented up-to-date inventory with version control and a description and purpose for each ECDIS, algorithm and model; § 5.B keeps the insurer responsible for vendor-supplied models and requires documented vendor selection and oversight.

Required action. Record the vendor model's documentation reference in the inventory and the vendor oversight record.

Excerpt: co-reg-10-1-1-s5 · state regulation (government edict) · in force from 2025-10-15

Applies to insurers offering individually issued life insurance, private passenger automobile insurance and health benefit plans. "Insurers ... that use ECDIS, as well as algorithms and predictive models that use ECDIS in any insurance practice, must establish a risk-based governance and risk management framework that facilitates and supports policies, procedures, systems, and controls designed to determine whether the use of such ECDIS, algorithms, and predictive models potentially result in unfair discrimination with respect to race and remediate unfair discrimination, if detected through quantitative testing requirements established by the Division." Required components include documented governing principles (1), board or board-committee oversight (2), senior management accountability with "regular reporting to senior management on the performance and potential risks" (3), a documented cross-functional governance group (4), for health plans a provider "ultimately responsible for the decisions" when ECDIS-based tools inform denials or modifications (5), documented policies and procedures (6), complaint and inquiry processes (7), risk assessment (8), a "documented up-to-date inventory, including version control" (9), explanation of material inventory changes (10), a "documented description of quantitative testing conducted pursuant to requirements established by the Division" (11), ongoing performance monitoring "accounting for model drift" (12), documented vendor selection (13) and annual reviews (14).

Excerpt: co-reg-10-1-1-s5-b-vendors · state regulation (government edict) · in force from 2025-10-15

The insurer remains responsible for the ECDIS, algorithms and predictive models it obtains from vendors or other external resources, must document its vendor selection and oversight, and vendors may produce documents directly to the Division (summary of § 5.B).

medium L6 doctrine advisory flag exhibit B, C doctrine.unreviewed-adverse-high-risk

Adverse outcome from a high-risk AI system with no human review

Finding. A high-risk system produced an adverse outcome that took effect without human review.

Basis. Doctrine: examiners applying the NAIC bulletin's governance and control expectations, and the AI Risk Evaluation Supplement's Exhibit B question on whether there is a human in the loop for direct-consumer-impact uses, ask first about human oversight of adverse automated outcomes; an unreviewed adverse decision is the case file most likely to be sampled.

Required action. Route to the carrier's reviewer; record the review and any override on the transaction.

Excerpt: naic-ai-bulletin-s3-1-ais-program · NAIC model guidance; binding in a state only as adopted (see adoptions register) · in force from 2023-12-04

"all Insurers authorized to do business in this state are expected to develop, implement, and maintain a written program (an 'AIS Program') for the responsible use of AI Systems that make, or support decisions related to regulated insurance practices. The AIS Program should be designed to mitigate the risk of Adverse Consumer Outcomes ... The Department also encourages the development and use of verification and testing methods to identify errors and bias in Predictive Models and AI Systems, as well as the potential for unfair discrimination in the decisions and outcomes resulting from the use of Predictive Models and AI Systems."

low L3 black letter flag exhibit C co.reg-10-1-1.monitoring-undocumented

ECDIS model with no documented testing or performance monitoring reference

Finding. The decision used an ECDIS-driven model for which the transaction references no documented testing or ongoing performance monitoring.

Basis. Regulation 10-1-1 § 5.A.11 requires a documented description of quantitative testing conducted pursuant to the Division's requirements (which remain under development) and § 5.A.12 requires ongoing performance monitoring accounting for model drift.

Required action. Record the testing and monitoring documentation reference for the model.

Excerpt: co-reg-10-1-1-s5 · state regulation (government edict) · in force from 2025-10-15

Applies to insurers offering individually issued life insurance, private passenger automobile insurance and health benefit plans. "Insurers ... that use ECDIS, as well as algorithms and predictive models that use ECDIS in any insurance practice, must establish a risk-based governance and risk management framework that facilitates and supports policies, procedures, systems, and controls designed to determine whether the use of such ECDIS, algorithms, and predictive models potentially result in unfair discrimination with respect to race and remediate unfair discrimination, if detected through quantitative testing requirements established by the Division." Required components include documented governing principles (1), board or board-committee oversight (2), senior management accountability with "regular reporting to senior management on the performance and potential risks" (3), a documented cross-functional governance group (4), for health plans a provider "ultimately responsible for the decisions" when ECDIS-based tools inform denials or modifications (5), documented policies and procedures (6), complaint and inquiry processes (7), risk assessment (8), a "documented up-to-date inventory, including version control" (9), explanation of material inventory changes (10), a "documented description of quantitative testing conducted pursuant to requirements established by the Division" (11), ongoing performance monitoring "accounting for model drift" (12), documented vendor selection (13) and annual reviews (14).

Point in time

Law as of
2026-10-17
Rules version
2026.10+dbe5ddf6
Corpus snapshot
2026-10-30-5f07c521
Engine
regbench-engine/0.4.0 · deterministic-1
Fingerprint
bd38f6a0266eb04bd48566a1
Evaluated
2026-10-30 11:23:24 UTC
Exhibit C case file
yes

Ledger

Entry
#764 · assessment · recorded 2026-10-17T08:20:41+00:00
Hash
4a8ca0f6ac6fd3bea2979fb92b873f867078bce6af2bf652302ea743938c8a4a
Previous
cc0fe49acc64fed4a19787fcfd872ca5aa4affdc931f6a652b615700ad602679
Stored copy intact
yes, hashes match

Verify the whole chain Case file JSON

Carrier review

Resolved by underwriter · outcome escalated · 54.8 hours after it opened · Resolved in the carrier's review queue (synthetic).

Recorded facts

AI system
rx-score v3 · third party (RxData Labs (fictional)) · high-risk class: underwriting
Governance attested
False
Testing report
none recorded
Model documentation
none recorded
Feature classes
rx_history, credit, consumer_report, application_data
Protected factors used
none
External data (ECDIS)
True
Consumer report / credit
True / True
Data sources
vendor://rxdata/score, cra://demo-bureau/attributes
Decision
rate · score 0.65 · premium +15.3%
Human review
none
Adverse to consumer
True
Notice
sent 2026-10-22 · reasons: True · specific: False · external data disclosed: False
Appeal channel
–
Consumer token
tok_361d92dcfd