In most cases, yes, you can.
However, “complete” has the connotation of filling out something to make it a complete whole, where “finish” can mean just “bring something to an end.”
In the following examples, the second one does not work.
“I just finished breakfast.” vs. “I just completed...