We consider an n-person sequential bargaining model in which both the surplus to be allocated as well as the identity of the proposer in each period follows a stochastic process. Assuming only one agent makes an offer in each period and agreement must be unanimous, we provide characterizations of both the sets of subgame perfect payoffs and stationary subgame perfect payoffs for the case where utility is transferable among the players. Our analysis incorporates several models of sequential bargaining which build on the work of Rubinstein (1982). We also investigate conditions under which agreement will be delayed and extend existing results for the uniqueness of subgame perfect and stationary subgame perfect payoffs to the stochastic game. JEL Classification Numbers: C73,C78. Key Words: Non Cooperative Bargaining, Dynamic Games, Stochastic Games.