Broadcom interview question

An encryption problem designed to test your logic.