The past tense of fall away from is fell away from.
The third-person singular simple present indicative form of fall away from is falls away from.
The present participle of fall away from is falling away from.
The past participle of fall away from is fallen away from.