Links

AI Safety

• AISafety.com – A global team of volunteers and professionals from various disciplines who believe AI poses a grave risk of extinction to humanity. AISafety.com is a dedicated online hub offering comprehensive, accurate, and up-to-date resources to educate and empower users in mitigating existential risks posed by artificial intelligence, with interactive features like a 3-minute survey to shape its content strategy and priorities.
• Center for AI Safety | CAIS (CAIS — pronounced ‘case’) – a nonprofit focused on reducing societal-scale and potentially catastrophic risks from advanced AI through technical research, field-building, and advocacy for safety standards. The site highlights core initiatives like safety research and publications, educational programs (e.g., fellowships/courses), and support infrastructure such as a compute cluster for ML safety work.
  • Statement on AI Risk | CAIS – A rare, cross-sector consensus: this one-sentence warning has been endorsed by leading AI lab CEOs (including OpenAI’s Sam Altman and Anthropic’s Dario Amodei), Turing Award–winning researchers, and experts spanning policy, security, law, economics, and philosophy—signaling that catastrophic AI risk is no longer a fringe concern, but a mainstream priority.
• Future of Life Institute – is a non-profit organization dedicated to reducing global catastrophic risks from powerful technologies, with a specific focus on artificial intelligence. They work to ensure that AGI (artificial general intelligence) is developed safely and remains beneficial to humanity through policy advocacy, safety research grants, and public outreach.
  • Contact your Legislators – If you live in the United States, you can use this form to contact your local representatives on the issue of unsafe AI development.
• Guard Rail Now | AI Extinction Risk Awareness & Action Movement – GuardRailNow is a 501(c)(3) nonprofit running urgent public-facing campaigns to prevent AI extinction risk. Dedicated to bringing the urgent conversations about AI extinction risk to everyone and amplifying the message that powerful AI systems must be developed with AI safety guardrails—before it’s too late.
• Human-Centered AI (HAI) 2025 AI Index Report – The Stanford Institute for Human-Centered AI (HAI) is an interdisciplinary institute established in 2019 to advance AI research, education, policy, and practice.
• International Association for Safe & Ethical AI (IASEAI, pronounced eye-see-eye) – an independent nonprofit organization founded to address the risks and opportunities associated with rapid advances in AI.
• Model Evaluation & Threat Research (METR) – mission is to develop scientific methods to assess catastrophic risks stemming from AI systems’ autonomous capabilities and enable good decision-making about their development.
• NIST AI Resources – A curated hub of authoritative U.S. government and standards-oriented links on AI governance, policy, and strategy. Includes references to NIST’s AI efforts plus key documents like executive order guidance, national AI R&D strategy materials, the DoD AI Strategy, OECD AI principles, and major national security AI reports. National Institute of Standards and Technology (NIST)
• NIST AI Risk Management Framework – Artificial Intelligence Risk Management Framework (AI RMF 1.0) by National Institute of Standards and Technology (NIST)
• Pause AI – A global grassroots movement calling for an international pause on training the most powerful “frontier” AI systems until they can be made demonstrably safe and kept under democratic control; it publishes a proposal, educational resources, and organizes local groups and public actions.
• Safe Superintelligence Inc (SSI) – is a company dedicated to developing safe superintelligence, prioritizing it as the most critical technical challenge of our era by advancing AI capabilities as rapidly as possible while ensuring safety measures always stay ahead, founded by a lean team of elite engineers and researchers.

AI Community and Personal Sites

• Dario Amodei – CEO of Anthropic, a public benefit corporation dedicated to building AI systems that are steerable, interpretable and safe.
• LessWrong – is a website and community with a strong interest in AI and specifically causing powerful AI systems to be safe and beneficial.
• P(doom) Calculator – an interactive online tool designed to help users estimate their personal probability of AI-induced catastrophe (“p(doom)”) by inputting best guesses and uncertainty levels (± points) across various development stages, generating outputs like 10th/90th percentiles and highlighting the widest uncertainty range. Users can share their parameters to contribute to aggregate community statistics, accessible via a dedicated stats page, fostering collective insights into AI existential risks without predefined methodologies or assumptions.
• Sam Altman – is a personal platform where the OpenAI CEO shares insights, updates, and reflections on artificial intelligence advancements, infrastructure developments, economic impacts, and ethical considerations in AI’s societal role.

Books

• If Anyone Builds It, Everyone Dies – “If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All” is a 2025 book by AI alignment pioneers Eliezer Yudkowsky and Nate Soares that urgently argues the development of artificial superintelligence poses an existential threat to humanity, detailing how misaligned systems could lead to extinction through scenarios like resource acquisition or unintended escalation. Through theory, evidence, a fictional extinction narrative, and calls for an immediate global halt to superintelligent AI research, the authors emphasize that humanity must prioritize survival over innovation to avert this “suicide race.” https://ifanyonebuildsit.com/
• Our Final Invention: Artificial Intelligence and the End of the Human Era. James Barrat. (October 2013) – The book discusses the potential benefits and possible risks of human-level or super-human artificial intelligence. Those supposed risks include extermination of the human race.

Podcasts

• AI Risk Network (The AI Risk Network – YouTube) – your home for humans-first AI risk content. From original podcasts to video ads, live specials, and documentaries, ARN is where we make AI risk a kitchen table conversation on every street in America.
• Doom Debates (www.youtube.com/@DoomDebates) – hosted by Liron Shapira that features debates, interviews, and discussions with AI experts, ethicists, and thinkers on the existential risks of artificial general intelligence (AGI) and superintelligence, aiming to raise mainstream awareness of potential human extinction scenarios.
• Future of Life Institute (https://www.youtube.com/@futureoflifeinstitute) – a nonprofit working to reduce global catastrophic and existential risk from powerful technologies. In particular, FLI focuses on risks from artificial intelligence (AI), biotechnology, and nuclear weapons. The Institute’s work is made up of three main strands: grantmaking for risk reduction, educational outreach, and advocacy within the United Nations, US government and European Union institutions. FLI has become one of the world’s leading voices on the governance of AI having created one of the earliest and most influential sets of governance principles: the Asilomar AI Principles.
• Rational Animations (https://www.youtube.com/@RationalAnimations) – we aim to promote good-thinking, altruistic causes and help ensure humanity’s future goes well. Among these topics, we are particularly focused on AI Safety and AI Alignment: making sure present and future AI Systems are aligned with human values and don’t cause our extinction.