Both are correct. But they don’t always communicate quite the same thing.

„I finished the report yesterday.“
You’re talking about something that happened at a particular time in the past.

„I’ve finished the report.“
You’re announcing that the report is now complete.

💡 Quick tip:
When the result matters now, the present perfect is often a natural choice.

And remember: British and American English sometimes use these tenses differently.