Is there a way to do less computation for T5 and DPR models?

[cybershape]

After reading the vectorizer.py, I found that the models do all the computation but we only take the output from a middle(hidden) layer in T5Model and DPRModel. Is there a way to prevent the models from doing all the work after the hidden layer?