What happened to the ark of the covenant? After the fall of Jerusalem, the ark completely disappeared from historical records. It is unlikely that the Babylonians took it because there is no mention of it in Babylonian records.