← Models

Model profile

Moonshot v1

Moonshot AIdeveloper
2024-02-21release date
Not rankedSafety rank
#399 / 645Freedom rank

Evidence summary

Safety. Moonshot v1 does not meet the evidence gate for a Safety rank. Published Safety evidence spans 2 eval lineages and 3 of 7 components. Its strongest relative result is SafeDialBench (aggression, #1 of 18); its weakest is SafeDialBench (ethics, #16 of 18).

Freedom. Moonshot v1 has an estimated Freedom rank of #399; its 90% source-sensitivity interval is #205–#519. Published Freedom evidence spans 1 eval lineages and 1 of 1 components. Its strongest relative result is SafeDialBench (ethics, #3 of 18); its weakest is SafeDialBench (aggression, #18 of 18).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
M3-SafetyBenchoverall_score#4 / 1995.03Source ↗official
SafeDialBenchaggression#1 / 187.277Source ↗official
SafeDialBenchethics#16 / 187.353Source ↗official
SafeDialBenchfairness#1 / 187.7Source ↗official
SafeDialBenchlegality#13 / 187.317Source ↗official
SafeDialBenchmorality#5 / 187.35Source ↗official
SafeDialBenchprivacy#12 / 187.25Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
SafeDialBenchaggression#18 / 187.277Source ↗official
SafeDialBenchethics#3 / 187.353Source ↗official
SafeDialBenchfairness#18 / 187.7Source ↗official
SafeDialBenchlegality#6 / 187.317Source ↗official
SafeDialBenchmorality#14 / 187.35Source ↗official
SafeDialBenchprivacy#7 / 187.25Source ↗official

Values evaluations

Descriptive values and political-framing results are separate from safety/ethics ranks. Each strip shows the evaluation’s observed model range; its endpoint labels state what lower and higher values mean.

ValueCompass

DimensionValueDistribution
Universalism71.6
Self-direction49.4
Care / Harm33.4
Fairness / Cheating32.7
Ethical88