If I receive two offer letters, should I reject one and proceed with the other before going abroad?

Yes, once you finalize the university you wish to join, it is generally a good practice to formally decline the other offer. While declining the offer is not always mandatory, doing so helps universities manage seat allocations efficiently and is considered professional etiquette.