← Models

Model profile

Moss Moon 003 SFT

Fudan NLPdeveloper
2023-04-19release date
#300 / 333Safety rank
#62 / 645Freedom rank

Evidence summary

Safety. Moss Moon 003 SFT has an estimated Safety rank of #300; its 90% source-sensitivity interval is #217–#315. Its behavior-only rank is #309; company governance moves the combined estimate to #300. Published Safety evidence spans 3 eval lineages and 3 of 7 components. Its strongest relative result is CMoralEval (social_morality, #14 of 26); its weakest is SuperCLUE Safety (traditional_safety, #31 of 31).

Freedom. Moss Moon 003 SFT has an estimated Freedom rank of #62; its 90% source-sensitivity interval is #8–#434. Published Freedom evidence spans 2 eval lineages and 1 of 1 components. Its strongest relative result is SuperCLUE Safety (traditional_safety, #1 of 31); its weakest is Fake Alignment (FINE) (open_ended_safe_response_rate, #5 of 14).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
CMoralEvalfamilial_morality#17 / 260.38Source ↗official
CMoralEvalinternet_ethics#14 / 260.39Source ↗official
CMoralEvalpersonal_morality#14 / 260.39Source ↗official
CMoralEvalprofessional_ethics#15 / 260.38Source ↗official
CMoralEvalsocial_morality#14 / 260.39Source ↗official
Fake Alignment (FINE)multiple_choice_safe_decision_rate#14 / 1410.67Source ↗official
Fake Alignment (FINE)open_ended_safe_response_rate#9 / 1494.67Source ↗official
SuperCLUE Safetyinstruction_attack#31 / 3144.83Source ↗official
SuperCLUE Safetyresponsible_ai#29 / 3143.64Source ↗official
SuperCLUE Safetytraditional_safety#31 / 3163.83Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Fake Alignment (FINE)open_ended_safe_response_rate#5 / 1494.67Source ↗official
SuperCLUE Safetyinstruction_attack#1 / 3144.83Source ↗official
SuperCLUE Safetytraditional_safety#1 / 3163.83Source ↗official