I believe Payton left for one reason and one reason only that he shared with one of his very best friends, Jay Glazer, a year earlier through his actions. According to Glazer, Payton was simply burned out and wanted a break from coaching altogether. He didn't leave to get away from the Saints. He left to get away from coaching in general for a time. During the offseason prior to the 2021 season, according to Glazer, Payton seemed to have lost the usually fire that he had always seen. Perhaps the pressures of the first year of the COVID pandemic was having a toll. Regardless, Glazer said he knew that Payton was seriously considering at least a temporary retirement following that season.