You’ve no idea how irritated Colombians get when people spell their country’s name wrong! (and I can certainly relate to that, after having my name [Naomi] spelled a thousand different ways!). I think some people think that ‘Colombia’ is just the Spanish spelling and that ‘Columbia’ is the English spelling. In fact, ‘Colombia’, the country, is spelled the same way in both languages!
To briefly summarize:
Colombia = the South American country.