• Incentive gradients and The Midas Project’s theory of change

    Incentive gradients and The Midas Project’s theory of change

    Why start an industry watchdog organization calling out irresponsible AI developers? Companies move along incentive gradients. Imagine this as a 3D landscape with peaks and valleys, downward slopes and upward climbs.  Companies move along this landscape. They want to follow the path of least resistance. They’re constantly moving in the easiest, cheapest direction, just as…

  • OpenAI

    Released the preparedness scorecard for GPT-4o (many months behind promised schedule)

  • Which tech companies are taking AI risk seriously?

    Which tech companies are taking AI risk seriously?

    Tech companies are locked in an all-out race to develop and deploy advanced AI systems. There’s a lot of money to be made, and indeed, plenty of opportunities to improve the world. But there are also serious risks — and racing to move as quickly as possible can make detecting and averting these risks a…

  • Magic.dev has finally released a risk evaluation policy. How does it measure up?

    Magic.dev has finally released a risk evaluation policy. How does it measure up?

    Big news: the AI coding startup Magic.dev has released a new risk evaluation policy this week. Referred to as their “AGI Readiness Policy” and developed in collaboration with the nonprofit METR, this announcement follows in the footsteps of Responsible Scaling Policies (RSPs) released by companies like Anthropic, OpenAI, and Google Deepmind. So how does it…

  • Magic.dev

    Released a responsible scaling policy, entitled their “AGI Readiness Policy.”

  • Meta

    Updated privacy policy to permit the use of personal user information (photos, posts, etc.) to train Meta AI models.

  • Why has Cognition fallen behind the industry standard for AI Safety?

    Why has Cognition fallen behind the industry standard for AI Safety?

    Amid fierce debates surrounding AI safety, it’s easy to forget that most disagreements concern what particular risks we face and how to address them. Very few people will try to argue that there are no risks or that serious caution isn’t warranted. In light of this, there is an emerging consensus among policy experts (and…

  • Sign the Cognition petition

    Sign the Cognition petition

    The Midas Project has written a petition to Cognition, asking them to adopt an industry standard risk-evaluation policy. There are two places you can sign our petition — on our website directly, and on Change.org. (Don’t worry about signing on both — we will be combining the signature totals and cross-checking to remove duplicates before…

  • Tweet at Cognition

    Tweet at Cognition

    Despite outreach from The Midas Project, Cognition has failed to provide any information about when they will release a comprehensive risk-evaluation policy — or if they will at all. Perhaps they think they can get away with this on account of the fact that they’re still relatively under-the-radar. It’s time for the public to demand…

  • Email Cognition

    Email Cognition

    Despite outreach from The Midas Project, Cognition has failed to provide any information about when they will release a comprehensive risk-evaluation policy — or if they will at all. Perhaps they think they can get away with this on account of the fact that they’re still relatively under-the-radar. It’s time for the public to demand…

Got any book recommendations?