From an 11th-century castle to dramatic gorges, this compact country delivers outsized beauty and history.