PANTHEON
ExploreBuild My Library
© 2026 Pantheon — an atlas of the ideas that shaped how we think.
person1987–

John Schulman

Disciplines:
ai
artificial intelligence/openai
investment banking/reinforcement learning
rlhf

Summary

American AI researcher — co-founder of OpenAI — who invented Proximal Policy Optimization (PPO) and co-created RLHF (Reinforcement Learning from Human Feedback) — the training technique behind ChatGPT — who left OpenAI in 2024 to join Anthropic.

Core Contribution

Co-creates RLHF as the technique that made LLMs useful — Schulman's work on using human feedback to fine-tune language models (rather than just pretraining on data) produced the ChatGPT capability to follow instructions helpfully; every major useful LLM uses variants of his RLHF approach.

Key Spikes & Highlights

  • Left OpenAI for Anthropic in 2024 despite being a co-founder — his departure was described as wanting to focus more on technical research than organizational management; the move to Anthropic (founded by former OpenAI employees) makes him the most significant co-founder to leave for a direct competitor in AI history
  • His PPO algorithm was created specifically because the previous policy gradient methods were too unstable to train large neural networks reliably — a technical stability problem whose solution enabled the entire RLHF paradigm

Notable Works & Achievements

Proximal Policy Optimization Algorithms

Learning to summarize from human feedback

InstructGPT

Historical Influences

Pieter Abbeel Richard Sutton

Intellectual Lineage

Pittsburgh, PennsylvaniaCarnegie Mellon UC Berkeley OpenAI Anthropic

Contemporaries & Peers

Sam Altman Dario Amodei Ilya Sutskever

Minds Influenced

LLM training methodology

Intellectual Posterity

RLHF PPO algorithmChatGPT trainingOpenAI co-founder

Discussing

John Schulman

Ask anything about John Schulman — their ideas, influences, contradictions, legacy.

Sign in to start a conversation.