NBC is hoping the popular sports program, long a ratings juggernaut, can teach the talk show a new play or two.

The Tonight Show will air four shows between September and December after NBC’s Sunday Night Football, immediately following ...