Stanford RAIN/OR Seminar

Stanford RAIN/OR (Recent advances in AI, INcentives, and Operations Research) is a seminar on the theory and practice of AI, incentives, and operations research. It serves as a hub for talks and discussion at the intersection of these fields and society. It is supported by Stanford’s Society & Algorithms Lab (SOAL), Stanford OpenLab, the Stanford Center for Computational Market Design, and the Stanford Computer Forum (and is open to Computer Forum affiliates).

Upcoming Talks

  1. Keegan Harris

    University of California, Berkeley
    4:30–5:30 PM PT Y2E2 299
    Inference Auctions
    Talk details When inference demand exceeds available compute capacity, model providers must decide which requests should be served first. Users have different tolerances for delay from an LLM API, but current priority pricing schemes compress these differences into coarse fixed-price service tiers. We design an inference auction that allows users to bid for faster service. Our auction allocates priority in an economically efficient way without sacrificing latency, and we develop fast algorithms for implementing prices that incentivize truthful bidding. We also design an autobidding agent for our inference auction, where users specify an inference budget and the autobidder dynamically adjusts its bids over time to maximize user utility subject to the budget constraint. Experiments validate the practicality of our auction: it increases system welfare while maintaining the cache utilization and latency advantages of SGLang, a state-of-the-art inference serving framework.
  2. Susan Murphy

    Harvard University
    4:30–5:30 PM PT Y2E2 299
  3. Eva Tardos

    Cornell University
    4:30–5:30 PM PT Y2E2 299
  4. Emily Aiken

    UC San Diego
    4:30–5:30 PM PT TBD
  5. Bailey Flanigan

    MIT
    4:30–5:30 PM PT Y2E2 101
  6. Dirk Bergemann

    Yale University
    4:00–5:00 PM PT Y2E2 101
  7. Vincent Cohen-Addad

    Google Research
    4:30–5:30 PM PT Y2E2 101
  8. Sharad Goel

    Harvard University
    4:30–5:30 PM PT Y2E2 299
  9. Kira Goldner

    Boston University
    4:30–5:30 PM PT Y2E2 299
  10. Hanlin Zhang

    Harvard University
    4:30–5:30 PM PT Y2E2 299

Browse the RAIN/OR seminar talk archive.

RAIN/OR Calendar

Open or subscribe to the RAIN/OR seminar calendar.

About the Seminar

Seminar Organizers: Amin Saberi and Ellen Vitercik.

Website template from the Stanford MLSys Seminar Series.