It is easy to cross the border but most rental cars will not let you take the car across for insurance reasons (see the other posts on this page). Depending on the time of year it is possible to walk to Famagusta from the border. Just cross on foot and take a stroll...