We track 117 organisations across 16 countries working on AI safety in its various forms: from technical alignment research to government policy, from evaluations to field-building. This directory complements ourHumanoid Robotics Company Directory.
117 / 117 shown
TechnicalActive
ScopeBuilding 'safe superintelligence' as sole product/mission.
ProgramsSafe superintelligence developmentScalable alignment researchSafety-by-design AI systems
FundingUnknown
UnknownActive
ScopeIncluded only because user requested; safety mission not confirmed from strong primary sources in this batch.
ProgramsHealthcare AI developmentAgentic AI systems
FundingUnknown
TechnicalActive
ScopeTechnical research on alignment/control of advanced autonomous AI systems.
ProgramsAgent foundations researchDecision theoryAlignment theoryNontrivial alignment
FundingUnknown
MixedActive
ScopeReducing societal-scale risks from AI via research, field-building, and advocacy.
ProgramsAI safety research grantsStatement on AI RiskField-building programsCompute cluster for safety research
FundingUnknown
TechnicalActive
ScopeTechnical alignment/interpretability and related research.
ProgramsEliciting latent knowledgeAlignment theory researchModel evaluations
FundingUnknown
GovernanceActive
ScopeAI governance research for risk mitigation and policy design.
ProgramsAI governance researchPolicy fellowshipsCompute governanceInternational AI governance
FundingUnknown
EvalsActive
ScopeUnderstanding capabilities/impacts of advanced AI and testing risk mitigations.
ProgramsFrontier model evaluationsAI safety researchPre-deployment testingInternational safety cooperation
FundingUnknown
StandardsActive
ScopeRisk mitigation guidance and safety mechanisms for advanced AI models/systems (as stated by NIST).
ProgramsAI safety guidelinesRisk management frameworkPre-deployment model testingAI safety standards development
FundingUnknown
StandardsActive
ScopeTesting, evaluation, and collaborative research to harness and secure commercial AI systems.
ProgramsAI standards developmentCommercial AI testingSafety evaluation frameworksIndustry collaboration
FundingUnknown
TrainingActive
ScopeResearch training program in model safety: control, interpretability, oversight, evals/red teaming, robustness.
ProgramsAlignment research scholars programMentorship cohortsInterpretability trainingRed teaming curriculum
FundingUnknown
TrainingActive
ScopeStudent-led research group reducing risk from advanced AI.
ProgramsStudent alignment researchAI safety reading groupsTechnical workshops
FundingUnknown
Field-buildingActive
ScopeIncluded as a meta-resource; not an AI safety org doing safety work itself.
ProgramsInteractive safety org mapOrganization directory
FundingUnknown
Field-buildingActive
ScopeMeta-map; not itself doing AI safety work.
ProgramsAI safety landscape mappingOrganization categorization
FundingUnknown
GovernanceActive
ScopePublishes a report cataloguing AI Safety Institutes worldwide; included as governance/meta-source org.
ProgramsResponsible tech pipelineAI safety institute landscape mappingCommunity building
FundingUnknown
EvalsActive
ScopePublishes red-teaming methodology guidance on AI safety (documented).
ProgramsAI safety evaluationsInternational safety cooperationJapan AI safety standards
FundingUnknown
GovernanceActive
ScopeEvidence-based AI policy informed by scientific understanding of AI risks and mitigations.
ProgramsAI safety policy evidence baseResearch synthesisPublic education on AI risk
FundingUnknown
MixedActive
ScopeInternational scientific synthesis of capabilities/risks of general-purpose AI systems.
ProgramsExpert synthesis on AI safetyGlobal risk assessmentInternational consensus building
FundingUnknown
TechnicalActive
ScopeUnknown
ProgramsConstitutional AIResponsible scaling policyInterpretability researchModel evaluations
FundingUnknown
GovernanceActive
ScopeUnknown
ProgramsCanadian AI governanceSafety policy researchRegulatory advocacy
FundingUnknown
TechnicalActive
ScopeUnknown
ProgramsValue alignment technologySafe AI deployment toolsAlignment consulting
FundingUnknown
ALTER
T2
MixedActive
ScopeUnknown
ProgramsAI safety research in IsraelTechnical alignmentInternational collaboration
FundingUnknown
Astera
T2
TechnicalActive
ScopeUnknown
ProgramsScientific research incubationAI safety-adjacent fundingPublic benefit technology
FundingUnknown
TrainingActive
ScopeUnknown
ProgramsAI policy researchSafety communicationPolicy advocacy
FundingUnknown
TrainingActive
ScopeUnknown
ProgramsGlobal AI safety coordinationInternational safety community building
FundingUnknown
MixedActive
ScopeUnknown
ProgramsAI safety grants programOpen letters on AI riskEU AI Act advocacyExistential risk policy
FundingUnknown
TechnicalActive
ScopeUnknown
ProgramsValue alignment researchCooperative inverse reinforcement learningHuman-compatible AI theory
FundingUnknown
GovernanceActive
ScopeUnknown
ProgramsPublic awareness of x-riskMedia engagement on AI riskPolicy advocacy
FundingUnknown
TrainingActive
ScopeUnknown
ProgramsCareer advising for AI safetyMental health supportCommunity resources
FundingUnknown
GovernanceActive
ScopeUnknown
ProgramsResponsible AI practicesABOUT ML frameworkSafety-critical AI workstreamAI incident database
FundingUnknown
GovernanceActive
ScopeUnknown
ProgramsOECD AI PrinciplesNational AI policy trackerAI governance best practices
FundingUnknown
MixedActive
ScopeThreat assessment/mitigation for AI systems; applied alignment/control; evals.
ProgramsAdversarial training for safetyAlignment faking researchInterpretability researchControl evaluations
FundingUnknown
EvalsActive
ScopeIndependent evaluation of frontier models for catastrophic-risk-relevant capabilities.
ProgramsAutonomous capability evaluationsFrontier model threat assessmentsTask-based eval frameworks
FundingUnknown
MixedActive
ScopeReducing risks from dangerous capabilities in advanced AI systems; evaluations for scheming/deception; governance guidance.
ProgramsScheming evaluationsDeceptive alignment detectionIn-context scheming benchmarks
FundingUnknown
MixedActive
ScopeAI safety research & education nonprofit focused on safe and beneficial frontier AI.
ProgramsAdversarial robustness researchAI safety via debateRed teamingAlignment research incubation
FundingUnknown
TechnicalActive
ScopeAlignment research startup; building controllable, safe development of advanced AI.
ProgramsCognitive emulation theoryInterpretability researchCoEm alignment approach
FundingUnknown
EvalsActive
ScopeGovernment institute supporting safe and responsible AI development/deployment in Canada.
ProgramsAI safety standards for CanadaFrontier model evaluationsSafety research grants
FundingUnknown
GovernanceActive
ScopeCatalyzing Canada’s leadership in AI governance and safety.
ProgramsCanadian AI governance policySafety research coordinationRegulatory frameworks
FundingUnknown
TrainingActive
ScopeOnline, part-time AI safety research program organizing project teams.
ProgramsResearch bootcampsAlignment project mentorshipField-building retreats
FundingUnknown
GovernanceActive
ScopeGovernance research and talent development for managing risks/opportunities from advanced AI.
ProgramsAI governance researchPolicy fellowshipsCompute governanceInternational AI governance
FundingUnknown
TrainingActive
ScopeRuns free courses on AI safety and governance; builds community for contributors.
ProgramsAI safety fundamentals courseAI governance courseScalable safety education
FundingUnknown
Field-buildingActive
ScopeResource hub supporting AI existential safety ecosystem.
ProgramsAI safety resource hubOrganization directoryReading groups coordination
FundingUnknown
SaferAI
T1
MixedActive
ScopeAI risk measurement, risk management ratings, standards and policy work to make AI safer.
ProgramsAI risk management ratingsSafety benchmarkingResponsible scaling assessments
FundingUnknown
TechnicalActive
ScopeReorient AI research toward provably beneficial systems (mission).
ProgramsValue alignment researchCooperative inverse reinforcement learningHuman-compatible AI theory
FundingUnknown
GovernanceActive
ScopeAI risk governance research as part of global catastrophic risks analysis.
ProgramsGlobal catastrophic risk modelingAI risk analysisRisk assessment frameworks
FundingUnknown
GovernanceActive
ScopePolicy research challenging current AI trajectory; accountability and societal risk governance.
ProgramsAI accountability researchRegulatory policyAI industry analysisWorkers and AI
FundingUnknown
EvalsActive
ScopeAcademic program dedicated to AI evaluation focusing on capabilities and safety.
ProgramsInternational AI evaluation standardsCross-border model testingSafety eval harmonization
FundingUnknown
MixedActive
ScopeScientific synthesis of risks and mitigations for general-purpose AI.
ProgramsGlobal AI safety synthesis reportExpert consensus buildingInternational risk assessment
FundingUnknown
GovernanceActive
ScopeTrustworthy AI principles and global policy tracking and guidance.
ProgramsOECD AI PrinciplesAI policy observatoryNational AI strategies trackerAI incident monitoring
FundingUnknown
EvalsActive
ScopeCompany risk management practice ratings for frontier AI labs.
ProgramsAI company safety ratingsRisk management benchmarkingResponsible scaling assessments
FundingUnknown
TechnicalActive
ScopeMeta-profile; not distinct from Redwood org (kept for dedupe log).
ProgramsAdversarial trainingAlignment faking researchControl evaluations
FundingUnknown
EvalsActive
ScopeModel evaluation and threat research; formerly ARC Evals.
ProgramsAutonomous capability evaluationsTask-based model assessmentsThreat research
FundingUnknown
TechnicalActive
ScopeMultidisciplinary research program tackling AI safety issues.
ProgramsAI safety research grantsAcademic safety research coordination
FundingUnknown
StandardsActive
ScopePublishing norms to mitigate harms and risks from AI research dissemination.
ProgramsPublication norms for responsible AIDual-use research guidelines
FundingUnknown
GovernanceActive
ScopeIntergovernmental standard promoting trustworthy AI principles.
ProgramsAI governance principlesInternational policy standards
FundingUnknown
EvalsActive
ScopeJoint work on scheming evaluations; not a standalone org.
ProgramsScheming evaluation collaborationIn-context deception detection
FundingUnknown
GovernanceActive
ScopeAI policy, national security, and emerging tech governance; safety-adjacent.
ProgramsAI and national security researchEmerging technology policyAI workforce analysis
FundingUnknown
TechnicalActive
ScopeTrustworthy, open AI research; safety adjacent.
ProgramsTrustworthy AI developmentOpen-source AI safety toolsCommunity-driven AI safety
FundingUnknown
Field-buildingActive
ScopeFunding/support for safety research (ecosystem node).
ProgramsAI safety research grantsScientific computing infrastructureEmerging technology support
FundingUnknown
MixedActive
ScopeAcademic AI research umbrella; contains safety-aligned groups (e.g., CHAI).
ProgramsFoundational AI researchSafety-adjacent ML researchRobustness and fairness
FundingUnknown
StandardsActive
ScopeIndustry-supported nonprofit addressing significant risks to public safety and national security from frontier models.
ProgramsResponsible development guidelinesSafety best practicesAI safety fundRed teaming standards
FundingUnknown
MixedActive
ScopeResearch on existential and global catastrophic risks, including risks from artificial intelligence (technical + governance).
ProgramsExistential risk researchAI safety policyExtreme technological risk analysis
FundingUnknown
GovernanceActive
ScopeInterdisciplinary research on the future of intelligence and responsible AI development/governance.
ProgramsFuture of intelligence researchAI narratives projectKinds of intelligenceAI ethics and society
FundingUnknown
Field-buildingActive
ScopeCommunity that helps people navigate the AI safety ecosystem and find projects.
ProgramsAI safety educational gamesPublic engagement on AI risk
FundingUnknown
Field-buildingActive
ScopeFortnightly meetings discussing AI safety papers and essays (community).
ProgramsWeekly reading group sessionsAI safety paper discussions
FundingUnknown
Field-buildingActive
ScopeCommunity infrastructure mentioned as organizer for AISafety.com reading group.
ProgramsCommunity coordinationAlignment ecosystem development
FundingUnknown
Field-buildingActive
ScopeProgram empowering students to use theses as a pathway to impact (career support).
ProgramsThesis topic coachingAI safety research mentorshipAcademic career guidance
FundingUnknown
Field-buildingActive
ScopeFunding node for long-term survival and flourishing projects (funding).
ProgramsAI safety research grantsExistential risk fundingS-process grant allocation
FundingUnknown
Field-buildingActive
ScopeDirectory of funders offering financial support to AI safety projects.
ProgramsFunding directory for AI safetyDonor coordination
FundingUnknown
Field-buildingActive
ScopeDirectory to map current AI safety research teams and gaps.
ProgramsVolunteer project listingsCommunity contribution matching
FundingUnknown
Field-buildingActive
ScopeMeta-post documenting AISafety.com map categories and ecosystem.
ProgramsAI safety field mappingResearch landscape visualization
FundingUnknown
Field-buildingActive
ScopePublishes an impact assessment of AI Safety Camp.
ProgramsAI safety benchmarkingForecasting researchAlignment evaluation tools
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI policy researchEmerging technology analysisNational security and AI
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI policy researchNational security and AIRisk assessment frameworksTechnology governance
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI governance researchTechnology policy analysisResponsible AI frameworks
FundingUnknown
MixedActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI safety and ethics researchData science for public goodAI governance frameworks
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI accountability researchAlgorithmic auditingPublic engagement on AIRegulatory policy
FundingUnknown
TrainingActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI policy researchAI governance strategyEmerging technology policy analysis
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsEU AI Act implementationAI governance coordinationGPAI model oversight
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsGlobal AI governance recommendationsInternational AI safety normsCapacity building
FundingUnknown
StandardsActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsSafety-critical AI guidelinesIndustry safety standards
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsBio-AI risk assessmentDual-use technology governanceCross-domain risk analysis
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsBiosecurity researchAI misuse risk analysisHealth security policy
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsNuclear risk reductionAI and WMD riskBiosecurity governance
FundingUnknown
MixedActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsExistential risk researchAI governance theoryMacrostrategy research
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI governance researchDigital ethicsFuture of work and AI
FundingUnknown
GovernanceActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI and international orderTechnology and democracyDigital governance
FundingUnknown
MixedActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI Index reportPolicy researchInterdisciplinary AI researchAI audit tools
FundingUnknown
EvalsActive
ScopeIncluded as part of the AI safety ecosystem; mission verification may be needed for safety-first criteria.
ProgramsAI incident trackingIncident taxonomySafety learning from failures
FundingUnknown
GovernanceActive
ScopeWorks on preventing misuse of advanced AI and strengthening safeguards; mission verification needed.
ProgramsAI security advocacyPolicy engagement on AI risk
FundingUnknown
GovernanceActive
ScopePublishes analysis/forecasts of AI trajectories; safety-adjacent.
ProgramsAI governance researchFuture scenarios analysisPolicy recommendations
FundingUnknown
PauseAI
T2
GovernanceActive
ScopeAdvocacy group focused on slowing AI progress until safe.
ProgramsAI development moratorium advocacyPublic protests and campaignsInternational chapters
FundingUnknown
GovernanceActive
ScopeEU monitoring and policy support for AI.
ProgramsAI landscape monitoringPolicy analysis for EUAI uptake tracking
FundingUnknown
Field-buildingActive
ScopeEU community platform; not a dedicated safety org.
ProgramsStakeholder consultationAI policy input to EUCommunity engagement
FundingUnknown
GovernanceActive
ScopeAI governance think tank.
ProgramsAI governance researchUN and multilateral engagementResponsible AI frameworks
FundingUnknown
GovernanceActive
ScopeCatastrophic risk org with AI relevance.
ProgramsAI policy for UK governmentExtreme risk policyBiosecurity and AI governance
FundingUnknown
Field-buildingActive
ScopeFunder; ecosystem node.
ProgramsAI safety research grantsTechnical alignment fundingAI governance grantsBiosecurity and AI
FundingUnknown
GovernanceActive
ScopeAI policy research and advocacy.
ProgramsPublic opinion polling on AIAI policy advocacyCongressional engagement
FundingUnknown
Field-buildingActive
ScopeCommunity forum; meta node.
ProgramsTechnical alignment discussionResearch publication platform
FundingUnknown
Field-buildingActive
ScopeCommunity platform; meta node.
ProgramsRationality community platformAI safety discussion forumResearch publication
FundingUnknown
Epoch AI
T2
GovernanceActive
ScopeTracks AI progress; safety-adjacent metrics.
ProgramsAI trends forecastingCompute analysisKey trends in AI publication
FundingUnknown
TechnicalActive
ScopeResearch institute with safety-related initiatives.
ProgramsAI for humanity researchResponsible AI developmentAI safety researchTalent training
FundingUnknown
GovernanceActive
ScopeThink tank work on AI governance.
ProgramsDigital governance researchAI and data governanceInternational policy
FundingUnknown
GovernanceActive
ScopeAI accountability and governance work.
ProgramsOpen Technology Institute AI workTech policy researchAI accountability
FundingUnknown
GovernanceActive
ScopeInternational governance partnership.
ProgramsResponsible AI working groupsInternational AI governanceInnovation and commercialization
FundingUnknown
StandardsActive
ScopeInternational AI standardization committee.
ProgramsAI management system standardsAI risk management standardsAI terminology standards
FundingUnknown
StandardsActive
ScopeStandards work for A/IS.
ProgramsEthically aligned designP7000 series AI ethics standardsAutonomous systems standards
FundingUnknown
GovernanceActive
ScopeAI governance and risk work.
ProgramsAI governance frameworksResponsible AI toolkitGlobal technology governance
FundingUnknown
GovernanceActive
ScopeFairness/harms; safety-adjacent.
ProgramsAlgorithmic bias researchCoded Bias documentaryEquitable AI advocacy
FundingUnknown
GovernanceActive
ScopeAI governance/harms research.
ProgramsAI and automation researchMedia manipulation studiesLabor and technology
FundingUnknown
GovernanceActive
ScopeHuman rights risks; safety-adjacent.
ProgramsAI and human rights researchSurveillance technology advocacyBan on autonomous weapons
FundingUnknown
GovernanceActive
ScopePolicy and governance of AI risks.
ProgramsAI governance policyPrivacy and surveillanceFree expression and AI
FundingUnknown
EvalsActive
ScopeIncident tracking; evaluation data.
ProgramsAI incident trackingIncident taxonomy developmentSafety learning database
FundingUnknown
GovernanceActive
ScopePolicy work including AI governance.
ProgramsInternet governanceAI policy researchDigital rights
FundingUnknown
GovernanceActive
ScopeResearch on technology policy and AI governance.
ProgramsAI governance researchInternet and societyEthics of AI
FundingUnknown
MixedActive
ScopeAI safety interest group page.
ProgramsAI safety interest groupData science researchEthics advisory
FundingUnknown
GovernanceActive
ScopeAI ethics & governance org.
ProgramsAI and society researchAlgorithmic accountabilityPublic deliberation on AI
FundingUnknown
GovernanceActive
ScopeEU governance office.
ProgramsEU AI Act implementationAI governance coordinationGPAI oversight
FundingUnknown