Dr. James L. Fisher, whose tenure as president of Towson University coincided with unparalleled physical expansion, increased student enrollment and a name change during the 1970s, died Wednesday of complications from a stroke.