Sixteen schemes for AI safety

These days, I often run across whippersnappers excited to do something for AI safety — but aren't quite sure what. One of the fun things about the Future Fund era were the big lists of project ideas; as we enter a new era of crazy money sloshing around, it might be time to bring back the lists!

Note that these ideas range from "very confident this is good" to "completely harebrained"; I'm not telling you which are which.

If you're excited for ideas like these, consider joining Surplus, our upcoming software incubator: https://manifund.org/surplus

Jobs, jobs, jobs

Already, the top problem for most AI safety orgs is hiring good people. Vast torrents of funding will only exacerbate the imbalance between available money and people to hire. So now is a great time to figure out how to discover new talent & match people to jobs.

1. Triplebyte for AI safety jobs

Triplebyte would interview a tech candidate once, then forward the results to a bunch of different companies. This would reduce the O(MN) problem in hiring between M orgs and N people to O(M+N), saving applicants and interviewers time. Most obviously, you could just do this for technical AI safety researchers, but maybe could extend to other subfields that are growing rapidly — policy work, generalists, etc. Also, there's probably room to "do hiring better" with AI-based interviewing. (How to do this effectively and respectfully remains an open problem, curious what the current SOTA is.) Warning: Triplebyte eventually went out of business, so you want to figure out how not to do that.

2. Database of every single AI safety person

Imagine a public query-able database that has every single human's employment info, current job status. Just starting with "Better LinkedIn" could go a long way. Can scrape LinkedIn, socials, personal websites, then allow the person to make edits. Sprinkle in some AI-powered features. Waypoint, Lightcone’s new conference app for LessOnline and Manifest this year, does a lot of this, so look at that for inspiration.

Beyond recruiting, this could help with outreach (eg for finding speakers for a conference), organizing (eg for canvassing voters for good candidates). See also my notes on EA/AIS People DB, see also LongtermWiki.

Related idea: database of every single AI safety org.

3. Intro AI safety megaconference

A large, open-access conference (2,000+ people, potentially up to 4,000) focused on introducing people to AI safety ideas and possibly finding jobs. Could be ungated (no application required), unlike EAG which rejects many applicants (eg me, the first time I applied) — see Scott Alexander's proposal to Open EAG. Key features: career fair with orgs hiring, talks from famous speakers, focus on recruiting and giving orgs access to candidates.

This seems especially tractable for Generator; both Manifest and Curve were organized in ~3 months. Would likely be in San Francisco/Bay Area. Could be self-funding by charging admission & charging orgs for sponsorships.

Alternative framings: less jobs-y and more fun, in the vein of large music festivals, or anime/comic conventions.

4. Unionize the lab employees

Frontier lab employees currently have significant bargaining power (as evidenced by high salaries), but this may not last. So: help lab employees organize to steer companies towards public good. Eg towards more permissibility & transparency, freedom of speech. Eg towards redistribution of windfall. Maybe OpenAI employees get to vote on a chunk of how OpenAI Foundation gives its funding. (Maybe OpenAI employees get regranting budgets to give to 501c3s.) Eg towards delaying dangerous capabilities, audits.

You might try to create one union per lab (one for A\, one for OAI, one for GDM). Or you might try to have all eg technical folks unionize, for cross lab solidarity. You might not want to call it a "union" or use typical union norms (eg standardizing pay based on seniority doesn't make much sense here). Lab employee interests may be more aligned with society than leadership?

Warning: very unclear if feasible, very unclear if good. By default, I'm anti- most unions (eg dockworker unions, trucker unions). And there are few examples of legit unions in tech or labs. Though there’s at least one recent precedent: during the OpenAI board drama, the letter to bring Sam back was kind of an impromptu union-y thing. Probably needs to be done by people with extensive lab experience.