Jim Irsay, who grew up around the NFL’s Colts before assuming control of the team himself, died in his sleep Wednesday at 65, the team announced.

No details on the cause of death were provided, but Irsay had been facing health challenges over the past few years. When he showed up at the Colts’ training camp the previous summer, it marked his first public appearance since the last season, as reported by the Indianapolis Star. The team owner shared with the publication that he had been recovering after several surgeries following a fall at his residence.

Irsay was just 13 when his father, Robert, acquired the Baltimore Colts in 1972. After the team moved to Indianapolis in 1984, the younger Irsay was appointed as the team’s vice president and general manager, eventually becoming its chief operating officer in 1996.

Upon his father’s death in 1997, Irsay took over his family’s business as the team’s owner and chief executive.

“Jim’s passion and respect for the NFL, along with its history, traditions, and values, inspired him to become a guardian of the game during his more than 50 years in the League,” the Colts expressed in a statement.