The dataset chatgpt's models were trained on is unbelievably massive. it' microsoft so think about ever single email conversaion from outlook, every public/private github repo, all public data (wikipedia, reddit, 4chan, twitter, facebook, etc. etc.) and all their other platforms, spanning decades. We're talking trillions to quadrillions of individual conversations between billions of people over decades. Chatgpt is the appearance of intelligence. In reality all it is doing is regurgitating conversations it has already seen.